00000100:00100000:2.0:1782757557.168077:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211447552:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.168086:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1782757557.168097:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1782757557.168102:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211447424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168127:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211447424:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.168132:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1782757557.168154:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211447680 00000100:00100000:2.0:1782757557.168158:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211447680 00000100:00100000:2.0:1782757557.168181:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211447936 00000100:00100000:2.0:1782757557.168184:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211447936 00000100:00100000:2.0:1782757557.168202:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1782757557.168208:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211447680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168236:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211447680:12345-0@lo:400:kworker.0 Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.168242:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1782757557.168252:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1782757557.168257:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b373ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211447936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168279:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b373ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211447936:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.168284:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00080000:2.0:1782757557.168301:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757557.168304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757557.168307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757557.168347:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211447424:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168372:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211447936:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168382:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211447552:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168413:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211447296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168423:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211447808:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.168432:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211447680:0@lo:400:kworker.0 00000100:00100000:2.0:1782757557.896422:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594048 00000100:00100000:2.0:1782757557.896438:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594048 00000100:00100000:2.0:1782757557.896518:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 521 00000100:00100000:2.0:1782757557.896529:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:39968:x1869355196594048:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757557.896551:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757557.896626:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d91fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf645d6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.896689:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.896704:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.896717:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757557.896964:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782757557.896969:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757557.897047:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.897074:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d91fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645d6 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.897093:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645d6 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.897102:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757557.897105:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757557.897108:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782757557.897172:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:39968:x1869355196594048:12345-192.168.204.31@tcp:101:rm.0 Request processed in 645us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.897180:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 521 00000100:00100000:2.0:1782757557.905921:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594176 00000100:00100000:2.0:1782757557.905939:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594176 00000100:00100000:2.0:1782757557.906017:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:2.0:1782757557.906028:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:39968:x1869355196594176:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757557.906049:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757557.906071:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d920b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf645dd expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906134:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906148:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906160:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906173:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906179:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906185:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906458:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906467:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906473:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906479:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757557.906483:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906490:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906505:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757557.906508:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757557.906513:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906518:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906530:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906537:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906542:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906547:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757557.906550:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906565:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906573:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1100) 00010000:00010000:2.0:1782757557.906576:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757557.906578:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906583:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906613:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d920b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645dd expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906623:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757557.906626:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757557.906629:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d920b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645dd expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.906644:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757557.906711:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:39968:x1869355196594176:12345-192.168.204.31@tcp:101:rm.0 Request processed in 685us (2519us total) trans 0 rc 301/301 00000100:00100000:2.0:1782757557.906720:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:2.0:1782757557.984671:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594560 00000100:00100000:2.0:1782757557.984684:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594560 00000100:00100000:2.0:1782757557.984752:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 523 00000100:00100000:2.0:1782757557.984767:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:39972:x1869355196594560:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782757557.984885:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757557.984915:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645d6 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757557.984936:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757557.984948:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757557.985579:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594304 00000100:00100000:2.0:1782757557.985588:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594304 00000100:00100000:2.0:1782757557.985639:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 524 00000100:00100000:2.0:1782757557.985649:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196594304:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782757557.985681:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782757557.985764:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196594304:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757557.985772:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 524 00000100:00100000:2.0:1782757558.104263:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594688 00000100:00100000:2.0:1782757558.104279:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594688 00000100:00100000:2.0:1782757558.104445:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:2.0:1782757558.104467:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:39976:x1869355196594688:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:2.0:1782757558.104493:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757558.104518:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d922e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf645e4 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104584:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104597:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104609:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757558.104686:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782757558.104691:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757558.104718:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104741:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d922e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645e4 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104759:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645e4 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.104768:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757558.104771:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757558.104774:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757558.104893:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:39976:x1869355196594688:12345-192.168.204.31@tcp:101:chown.0 Request processed in 438us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757558.104905:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:2.0:1782757558.109883:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196594816 00000100:00100000:2.0:1782757558.109893:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196594816 00000100:00100000:2.0:1782757558.109950:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 526 00000100:00100000:2.0:1782757558.109960:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:39976:x1869355196594816:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:2.0:1782757558.109983:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757558.110004:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d923c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf645eb expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110075:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110089:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110101:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110117:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110124:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110130:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110290:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110303:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110310:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757558.110361:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1782757558.110365:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757558.110390:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110403:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110410:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110417:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110423:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757558.110427:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110435:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.110448:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757558.110451:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757558.110457:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.111965:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.111987:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.111994:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112000:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112006:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757558.112010:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112017:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112030:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1100) 00010000:00010000:2.0:1782757558.112033:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757558.112037:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112043:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d924a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112087:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d923c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645eb expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112101:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf645eb expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.112108:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782757558.112111:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757558.112114:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782757558.112358:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:39976:x1869355196594816:12345-192.168.204.31@tcp:101:chown.0 Request processed in 2397us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757558.112370:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 526 00000100:00100000:2.0:1782757558.124385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782757558.137492:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137512:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137520:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137527:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757558.137532:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137540:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137560:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75a00) 00010000:00010000:2.0:1782757558.137563:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757558.137568:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757558.137574:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757559.030239:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211448192 00000100:00100000:2.0:1782757559.030247:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211448192 00000100:00100000:2.0:1782757559.030369:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782757559.030378:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:67835:x1869355211448192:12345-0@lo:104: 00010000:00010000:2.0:1782757559.030391:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181525600/0xdd99f5c4777d91ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d91f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757559.030459:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757559.030465:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:67835:x1869355211448192:12345-0@lo:104: Request processed in 88us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757559.030471:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000001:00080000:2.0:1782757559.816601:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00000080:2.0:1782757559.929033:0:67884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd263c4d40 20000000:00000080:2.0:1782757559.929052:0:67884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171a0c2a000 uarg=0000000000000000 00000100:00100000:2.0:1782757560.236770:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211448576 00000100:00100000:2.0:1782757560.236778:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211448576 00000100:00100000:2.0:1782757560.236869:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1782757560.236878:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211448576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757560.236913:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757560.236965:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211448576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757560.236982:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1782757561.540243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757561.540310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757561.540340:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196595328 00000100:00100000:2.0:1782757561.540349:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196595328 00000100:00100000:2.0:1782757561.540411:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1116 00000100:00100000:2.0:1782757561.540422:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196595328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757561.540516:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196595328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757561.540525:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1116 00000100:00080000:2.0:1782757561.540547:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757562.292371:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211449088:0@lo:400:kworker.0 00000100:00100000:2.0:1782757562.797947:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211449472 00000100:00100000:2.0:1782757562.797964:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211449472 00000100:00100000:2.0:1782757562.798022:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1782757562.798032:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211449472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757562.798069:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757562.798126:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211449472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757562.798134:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00010000:00010000:2.0:1782757564.844930:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757566.893033:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757566.956914:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757566.956921:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757566.956925:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757566.956971:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9282 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757566.956983:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9282 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757566.956994:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9282 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757566.957027:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b373e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211449984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757566.957092:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757566.957136:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b766a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782757567.917510:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211450752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757568.047597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757570.486975:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211451136 00000100:00100000:2.0:1782757570.486985:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211451136 00000100:00100000:2.0:1782757570.487042:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1782757570.487053:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211451136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757570.487091:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757570.487159:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211451136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757570.487166:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1782757570.487211:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b373ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211451136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757572.268383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757572.273603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757572.277800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757572.323107:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b373e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196597504:12345-192.168.204.31@tcp:2:touch.0 Request processed in 44969us (45309us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1782757572.323121:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 281 00000100:00100000:2.0:1782757572.327032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757572.394931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782757572.402115:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757572.402126:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757572.402140:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757572.402147:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757572.402162:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757572.402179:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:2.0:1782757572.402185:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782757572.402194:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9362 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757572.402214:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9362 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757572.402236:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757572.402240:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757572.402242:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757572.529081:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211451776:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.529159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.529223:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782757572.529231:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211451392:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.529259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.529285:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211451904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.529311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.529341:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211451520:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.530407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.530441:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211452032:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.530480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.530502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757572.530508:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211451648:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.530529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757572.530563:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211451776 00000100:00100000:2.0:1782757572.530570:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211451776 00000100:00100000:2.0:1782757572.530637:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211452032 00000100:00100000:2.0:1782757572.530640:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211452032 00000100:00100000:2.0:1782757572.532569:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1782757572.532582:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211452032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.532634:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211452032:12345-0@lo:400:kworker.0 Request processed in 55us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757572.532641:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1782757572.533088:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211451648:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.533106:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211451520:0@lo:400:kworker.0 00000100:00100000:2.0:1782757572.533117:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211452032:0@lo:400:kworker.0 00000100:00100000:2.0:1782757573.036147:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211452160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757573.036223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782757573.036299:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757573.985118:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211452544 00000100:00100000:2.0:1782757573.985126:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211452544 00000100:00100000:2.0:1782757573.985209:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1782757573.985218:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:68574:x1869355211452544:12345-0@lo:104: 00010000:00010000:2.0:1782757573.985231:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777d92c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d92cf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757573.985299:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757573.985304:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:68574:x1869355211452544:12345-0@lo:104: Request processed in 88us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757573.985310:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00010000:00010000:2.0:1782757574.063555:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757576.887454:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196598528 00000100:00100000:2.0:1782757576.887469:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196598528 00000100:00100000:2.0:1782757576.887652:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00100000:2.0:1782757576.887667:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196598528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757576.887981:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196598528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 307us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757576.887990:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 971 00010000:00010000:2.0:1782757577.132588:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757578.157095:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757578.157125:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211453824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757578.157222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757578.160466:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211453824 00000100:00100000:2.0:1782757578.160479:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211453824 00000100:00100000:2.0:1782757578.161843:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1782757578.161859:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211453824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757578.161916:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757578.162041:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211453824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (4818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757578.162049:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1782757578.162129:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211453824:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782757578.602625:0:68771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc90283450 20000000:00000080:2.0:1782757578.602651:0:68771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc0c00 uarg=0000000000000000 00010000:00010000:2.0:1782757578.604125:0:68771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757578.604152:0:68771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757578.604170:0:68771:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757578.604195:0:68771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777d939a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757578.604217:0:68771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181524c00/0xdd99f5c4777d937e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9377 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757578.604227:0:68771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695600/0xdd99f5c4777d939a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757578.604579:0:68771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181524c00/0xdd99f5c4777d937e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9377 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757578.604601:0:68771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181524c00/0xdd99f5c4777d937e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9377 expref: 18 pid: 5796 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757578.604619:0:68771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68771:1869355211453952:0@lo:104: 00000100:00100000:2.0:1782757578.604717:0:68771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757578.604790:0:68771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171907e7600 going to sleep for 11 seconds 10000000:01000000:2.0:1782757580.206094:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757580.206102:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757580.206107:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757580.206153:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d93a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757580.206165:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d93a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757580.206177:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d93a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757580.206202:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211454208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757580.206267:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757580.206321:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182ca80 going to sleep for 11 seconds 00010000:00010000:2.0:1782757581.228449:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757581.835491:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196599552 00000100:00100000:2.0:1782757581.835501:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196599552 00000100:00100000:2.0:1782757581.835550:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 540 00000100:00100000:2.0:1782757581.835559:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40399:x1869355196599552:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782757581.835582:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757581.835601:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d93cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64631 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836320:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836336:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836348:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836362:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836370:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836377:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757581.836502:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:2.0:1782757581.836524:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836532:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836538:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836545:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757581.836549:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836556:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836569:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782757581.836573:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757581.836577:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836584:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d93d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836595:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836605:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836610:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836616:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757581.836618:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836624:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836632:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff917182dd1d00) 00010000:00010000:2.0:1782757581.836634:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757581.836637:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836644:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d93d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836674:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d93cb lrc: 1/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64631 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836684:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782757581.836686:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757581.836690:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d93cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64631 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757581.836704:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757581.836886:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40399:x1869355196599552:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1326us (1697us total) trans 0 rc 301/301 00000100:00100000:2.0:1782757581.836894:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 540 00000100:00100000:2.0:1782757582.010138:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196600064 00000100:00100000:2.0:1782757582.010150:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196600064 00000100:00100000:2.0:1782757582.010229:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 813 00000100:00100000:2.0:1782757582.010239:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196600064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757582.010304:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196600064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757582.010311:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 813 00000100:00100000:2.0:1782757583.283349:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211455232 00000100:00100000:2.0:1782757583.283360:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211455232 00000100:00100000:2.0:1782757583.283419:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1782757583.283429:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211455232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757583.283464:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757583.283530:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211455232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757583.283537:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1782757585.773322:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211455616 00000100:00100000:2.0:1782757585.773330:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211455616 00000100:00100000:2.0:1782757585.773386:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1782757585.773396:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211455616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757585.773409:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757585.773422:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777d9418 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9411 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757585.773446:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777d9418 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9411 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757585.773470:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695600/0xdd99f5c4777d9418 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9411 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757585.773480:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782757585.773519:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211455616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757585.773525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1782757585.838659:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211455744 00000100:00100000:2.0:1782757585.838667:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211455744 00000100:00100000:2.0:1782757585.838730:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1782757585.838741:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211455744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757585.838776:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757585.838851:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211455744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757585.838858:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00010000:00010000:2.0:1782757586.348938:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757587.520002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757587.535091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757587.535131:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196600832 00000100:00100000:2.0:1782757587.535140:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196600832 00000100:00100000:2.0:1782757587.535195:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:2.0:1782757587.535206:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40486:x1869355196600832:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782757587.535265:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757587.535294:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64646 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757587.535311:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d93c4) 00010000:00010000:2.0:1782757587.535315:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:2.0:1782757587.535326:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757587.535354:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d942d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757587.535367:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d942d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757587.535377:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d942d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757587.535967:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000831116f5 reply state 0000000090b367d4 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d942d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757587.535980:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782757587.536198:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:2.0:1782757587.536292:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40486:x1869355196600832:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 1085us (1211us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1782757587.536301:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:2.0:1782757588.397196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757588.397216:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211456640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757588.397277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757588.397334:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211456640 00000100:00100000:2.0:1782757588.397341:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211456640 00000100:00100000:2.0:1782757588.397393:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1782757588.397401:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211456640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757588.397438:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757588.397481:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211456640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757588.397489:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1782757588.397536:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211456640:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1782757588.451523:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 10000000:01000000:2.0:1782757589.811152:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757589.811159:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757589.811164:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757589.811204:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757589.811215:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757589.811225:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757589.811251:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211457024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757589.811321:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757589.811386:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782757589.813644:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211457024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757589.813661:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9442 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757589.813670:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9442 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757589.813697:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757589.813703:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9442 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757589.813710:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777d943b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9442 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757590.956151:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757590.956172:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211457152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757590.956233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757590.956291:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211457152 00000100:00100000:2.0:1782757590.956298:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211457152 00000100:00100000:2.0:1782757590.956339:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1782757590.956348:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211457152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757590.956378:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757590.956414:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211457152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757590.956420:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00080000:2.0:1782757590.956437:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757590.956467:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211457152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757592.142147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:2.0:1782757592.142588:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757592.164459:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757592.182631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757592.236179:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196602112 00000100:00100000:2.0:1782757592.236189:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196602112 00000100:00100000:2.0:1782757592.236307:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 549 00000100:00100000:2.0:1782757592.236318:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:40574:x1869355196602112:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782757592.236338:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757592.236359:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777d9450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6464d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236421:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236434:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236447:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236459:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236466:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236472:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.236999:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237008:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237016:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757592.237086:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1782757592.237090:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757592.237157:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237169:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237174:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237181:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237186:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757592.237190:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237197:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237210:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782757592.237213:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757592.237217:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237223:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237234:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237243:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237247:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237251:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757592.237254:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237259:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237265:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1900) 00010000:00010000:2.0:1782757592.237267:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757592.237269:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237273:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d945e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237339:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777d9450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6464d expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237353:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6464d expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.237360:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782757592.237362:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757592.237365:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782757592.237433:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40574:x1869355196602112:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1116us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757592.237440:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 549 00000100:00100000:2.0:1782757592.241160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757592.252357:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196602624 00000100:00100000:2.0:1782757592.252368:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196602624 00000100:00100000:2.0:1782757592.252426:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 289 00000100:00100000:2.0:1782757592.252437:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40574:x1869355196602624:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782757592.252454:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757592.252473:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777d948f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6465b expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782757592.252499:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782757592.252519:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=1660s v=(0 0) 00010000:00010000:2.0:1782757592.252524:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757592.252534:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777d948f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6465b expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.252552:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777d948f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6465b expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757592.252565:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782757592.252621:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40574:x1869355196602624:12345-192.168.204.31@tcp:101:dd.0 Request processed in 186us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757592.252628:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 289 00000100:00100000:2.0:1782757592.270075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757592.328248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:2.0:1782757592.370856:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000001:00080000:2.0:1782757592.434639:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000100:00100000:2.0:1782757592.441776:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:40574:x1869355196603264:12345-192.168.204.31@tcp:35:dd.0 Request processed in 5115us (5390us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1782757592.441789:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:2.0:1782757593.517788:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211458048 00000100:00100000:2.0:1782757593.517798:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211458048 00000100:00100000:2.0:1782757593.517871:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1782757593.517881:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211458048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757593.517905:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782757593.517970:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211458048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757593.517978:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000004:00080000:2.0:1782757595.261974:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 45 committed 00000004:00080000:2.0:1782757595.261991:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000100:00100000:2.0:1782757596.076476:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211458176 00000100:00100000:2.0:1782757596.076484:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211458176 00000100:00100000:2.0:1782757596.076542:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1782757596.076551:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211458176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757596.076603:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757596.076651:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211458176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757596.076658:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1782757596.094866:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211458176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757597.567643:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196603904 00000100:00100000:2.0:1782757597.567654:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196603904 00000100:00100000:2.0:1782757597.567703:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:2.0:1782757597.567713:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40767:x1869355196603904:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757597.567813:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40767:x1869355196603904:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 101us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757597.567847:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:2.0:1782757597.585815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757597.606248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757597.611108:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196604288 00000100:00100000:2.0:1782757597.611118:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196604288 00000100:00100000:2.0:1782757597.611170:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 553 00000100:00100000:2.0:1782757597.611180:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40767:x1869355196604288:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757597.611631:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:40767:x1869355196604288:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 452us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757597.611640:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 553 00010000:00010000:2.0:1782757597.744781:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744796:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744803:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744809:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757597.744814:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744862:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744878:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff91718bcfdc00) 00010000:00010000:2.0:1782757597.744882:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757597.744886:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757597.744892:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d949d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782757600.796646:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000004:00080000:2.0:1782757600.796662:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 46 committed 00000100:00100000:2.0:1782757600.809266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:2.0:1782757601.165649:0:69607:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1669568823669ns, next at 1641805058861ns, rc = 0 00000004:00080000:2.0:1782757601.165750:0:69607:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1669568926946ns, next at 1667137720982ns, rc = 0 00000100:00100000:2.0:1782757601.196843:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757601.196869:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211459456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757601.196942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782757601.198663:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757601.198717:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211459456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757602.485512:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196605312 00000100:00100000:2.0:1782757602.485519:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196605312 00000100:00100000:2.0:1782757602.485556:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 984 00000100:00100000:2.0:1782757602.485564:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196605312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757602.502358:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196605312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 16782us (17229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757602.502374:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 984 00010000:00010000:2.0:1782757602.732921:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782757602.879472:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00000100:00080000:2.0:1782757603.274066:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757603.274146:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211459840:0@lo:400:kworker.0 00000100:00100000:2.0:1782757603.274160:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211459712:0@lo:400:kworker.0 00000100:00100000:2.0:1782757603.760536:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211460352 00000100:00100000:2.0:1782757603.760544:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211460352 00000100:00100000:2.0:1782757603.760594:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1782757603.760603:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211460352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757603.760636:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757603.760687:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211460352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757603.760694:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00010000:00010000:2.0:1782757605.806083:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757606.317729:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757606.317751:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211460480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757606.317838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757606.317902:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211460480 00000100:00100000:2.0:1782757606.317909:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211460480 00000100:00100000:2.0:1782757606.317962:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1782757606.317971:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211460480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757606.318010:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757606.318057:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211460480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757606.318064:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1782757606.318114:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211460480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757606.319927:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757607.609325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196605824 00000100:00100000:2.0:1782757607.609336:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196605824 00000100:00100000:2.0:1782757607.609396:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00100000:2.0:1782757607.609407:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196605824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757607.609470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196605824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 65us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757607.609477:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00080000:2.0:1782757607.612097:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757607.612101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757607.613095:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757608.366487:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211460608:0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757608.366568:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211461120:0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757608.366623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757608.366630:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211460992:0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757608.366692:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211461248 00000100:00100000:2.0:1782757608.366696:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211461248 00000100:00100000:2.0:1782757608.366723:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211460992 00000100:00100000:2.0:1782757608.366725:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211460992 00000100:00100000:2.0:1782757608.366746:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1782757608.366752:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211461248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366784:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211461248:12345-0@lo:400:kworker.0 Request processed in 32us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757608.366791:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1782757608.366806:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1782757608.366813:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366871:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211460992:12345-0@lo:400:kworker.0 Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757608.366878:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1782757608.366898:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211461120 00000100:00100000:2.0:1782757608.366902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211461120 00000100:00100000:2.0:1782757608.366928:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1782757608.366939:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211460864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.366985:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211460864:12345-0@lo:400:kworker.0 Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757608.366991:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1782757608.367040:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211460992:0@lo:400:kworker.0 00000100:00080000:2.0:1782757608.367111:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757608.367116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757608.367118:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757608.369612:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211461120:0@lo:400:kworker.0 00000100:00100000:2.0:1782757608.377269:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211460608:0@lo:400:kworker.0 00010000:00010000:2.0:1782757608.879135:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757611.442848:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757611.442870:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082fea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211461504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757611.442937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782757611.948053:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757612.743053:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196606336 00000100:00100000:2.0:1782757612.743064:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196606336 00000100:00100000:2.0:1782757612.743131:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00100000:2.0:1782757612.743143:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196606336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757612.743220:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196606336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757612.743227:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00100000:2.0:1782757613.489696:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211461632 00000100:00100000:2.0:1782757613.489715:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211461632 00000100:00100000:2.0:1782757613.489793:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1782757613.489805:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211461632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757613.489935:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211461632:12345-0@lo:400:kworker.0 Request processed in 133us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757613.489941:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1782757614.007512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757614.007540:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211462400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757614.007626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782757615.019997:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757616.556609:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211462528 00000100:00100000:2.0:1782757616.556627:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211462528 00000100:00100000:2.0:1782757616.556695:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1782757616.556706:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211462528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757616.556742:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757616.559226:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211462528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2514us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757616.559240:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1782757617.098772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757617.104169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757617.128115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757617.128159:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196607232 00000100:00100000:2.0:1782757617.128199:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196607232 00000100:00100000:2.0:1782757617.128252:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:2.0:1782757617.128261:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40949:x1869355196607232:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757617.128708:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:40949:x1869355196607232:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 447us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757617.128717:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:2.0:1782757617.162220:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782757618.092042:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757619.117212:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782757620.200707:0:69830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe13fb3010 20000000:00000080:2.0:1782757620.200724:0:69830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917183838800 uarg=0000000000000000 00010000:00010000:2.0:1782757620.201632:0:69830:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782757620.201761:0:69830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782757620.201766:0:69830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757620.201780:0:69830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6464d expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757620.201804:0:69830:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782757620.207889:0:69830:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757620.207921:0:69830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777d94b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757620.207940:0:69830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9442 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d943b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757620.207950:0:69830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d94b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757620.208004:0:69830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9442 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d943b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757620.208021:0:69830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9442 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d943b expref: 18 pid: 5796 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757620.208036:0:69830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69830:1869355211463552:0@lo:104: 00000100:00100000:2.0:1782757620.208099:0:69830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757620.208169:0:69830:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191f51a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782757621.684213:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757621.684245:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211463808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757621.684325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757621.684383:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211463808 00000100:00100000:2.0:1782757621.684390:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211463808 00002000:00000024:2.0:1782757621.697355:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757621.697473:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211463808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2883us (13142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757621.697485:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1782757621.697566:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211463808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757624.237259:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757624.238985:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211464832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757624.239107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757624.239952:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211464832:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782757625.049362:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757625.103099:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196609152 00000100:00100000:2.0:1782757625.103114:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196609152 00000100:00100000:2.0:1782757625.103196:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:2.0:1782757625.103211:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41038:x1869355196609152:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782757625.103316:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757625.103363:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d94d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64662 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757625.103389:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9465) 00010000:00010000:2.0:1782757625.103394:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:2.0:1782757625.103410:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757625.103449:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d94dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757625.103468:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d94dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757625.103480:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d94dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757626.796306:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211464960 00000100:00100000:2.0:1782757626.796315:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211464960 00000100:00100000:2.0:1782757626.796379:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1782757626.796388:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211464960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757626.796423:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757626.796468:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211464960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757626.796475:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000020:00000080:2.0:1782757626.904159:0:70028:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd1fa7df0 20000000:00000080:2.0:1782757626.904181:0:70028:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30db800 uarg=0000000000000000 00010000:00010000:2.0:1782757626.904809:0:70028:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757626.904855:0:70028:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757626.904872:0:70028:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757626.904893:0:70028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.904912:0:70028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181525200/0xdd99f5c4777d94c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d94c0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.904921:0:70028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.904963:0:70028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181525200/0xdd99f5c4777d94c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d94c0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.904977:0:70028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181525200/0xdd99f5c4777d94c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d94c0 expref: 18 pid: 5793 timeout: 1795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757626.916592:0:70028:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70028:1869355211465088:0@lo:104: 00000100:00100000:2.0:1782757626.916675:0:70028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757626.916882:0:70028:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171811cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1782757626.926355:0:70028:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70028:1869355211465088:0@lo:104: 00010000:00010000:2.0:1782757626.926382:0:70028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757626.927040:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757626.927055:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211465216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757626.927099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782757626.927909:0:70028:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.927917:0:70028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757626.927923:0:70028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777d94e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782757628.102101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757628.102116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757628.102120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757628.346111:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757628.844858:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211465856:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.844931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.844999:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782757628.845020:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211465472:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.845070:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211465984:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.845118:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211465728:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.845158:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782757628.845164:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211465600:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.845201:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211466112:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757628.845422:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211465856 00000100:00100000:2.0:1782757628.845430:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211465856 00000100:00100000:2.0:1782757628.845486:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211466112 00000100:00100000:2.0:1782757628.845489:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211466112 00000100:00100000:2.0:1782757628.845515:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1782757628.845524:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211465856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845576:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211465856:12345-0@lo:400:kworker.0 Request processed in 53us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757628.845583:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1782757628.845599:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1782757628.845606:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211466112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.845923:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211466112:12345-0@lo:400:kworker.0 Request processed in 316us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757628.845930:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1782757628.845961:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211465472 00000100:00100000:2.0:1782757628.845966:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211465472 00000100:00100000:2.0:1782757628.845991:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1782757628.845997:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211465472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.846094:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211465472:12345-0@lo:400:kworker.0 Request processed in 97us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757628.846101:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1782757628.846137:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211465984 00000100:00100000:2.0:1782757628.846141:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211465984 00000100:00100000:2.0:1782757628.846177:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211465728 00000100:00100000:2.0:1782757628.846180:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211465728 00000100:00100000:2.0:1782757628.846198:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211465600 00000100:00100000:2.0:1782757628.846201:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211465600 00000100:00100000:2.0:1782757628.852001:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782757628.852034:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211465728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.852149:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211465728:12345-0@lo:400:kworker.0 Request processed in 129us (7006us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757628.852157:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782757628.852177:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1782757628.852183:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211465600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.852210:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211465600:12345-0@lo:400:kworker.0 Request processed in 28us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757628.852216:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1782757628.852264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211465472:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.852280:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211465984:0@lo:400:kworker.0 00000100:00100000:2.0:1782757628.852291:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211465856:0@lo:400:kworker.0 00010000:00010000:2.0:1782757631.428058:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757631.920080:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211466368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757631.920180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782757631.922699:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757631.922811:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211466368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757632.098857:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757632.137869:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196610304 00000100:00100000:2.0:1782757632.137882:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196610304 00000100:00100000:2.0:1782757632.138772:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:2.0:1782757632.138788:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41115:x1869355196610304:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:2.0:1782757632.139353:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757632.139394:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64670 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.139416:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:2.0:1782757632.139431:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757632.139483:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9537 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.139500:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.139511:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757632.139655:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005bdce807 reply state 0000000059e04f69 transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757632.139665:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757632.142976:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41115:x1869355196610304:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 4174us (5234us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782757632.142993:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:2.0:1782757632.155250:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196610432 00000100:00100000:2.0:1782757632.155264:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196610432 00000100:00100000:2.0:1782757632.155332:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:2.0:1782757632.155345:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41115:x1869355196610432:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757632.155378:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757632.155405:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d953e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64677 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.155479:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d953e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64677 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.155495:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d953e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64677 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.155515:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757632.155519:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782757632.155522:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782757632.155601:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41115:x1869355196610432:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 258us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757632.155609:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00080000:2.0:1782757632.160165:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757632.188576:0:6790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6790:1869355211466496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782757632.188600:0:6790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:2.0:1782757632.329508:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196610944 00000100:00100000:2.0:1782757632.329522:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196610944 00000100:00100000:2.0:1782757632.329599:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:2.0:1782757632.329612:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:41119:x1869355196610944:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:2.0:1782757632.329646:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757632.329675:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6467e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329770:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329802:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329817:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329872:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329880:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.329899:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330084:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330092:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330100:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757632.330143:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00000004:00200000:2.0:1782757632.330148:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757632.330171:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330186:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330196:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330202:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330209:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330215:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757632.330220:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330228:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330242:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:2.0:1782757632.330246:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757632.330253:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330260:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d954c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330277:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330284:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330290:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330295:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757632.330298:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330303:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330310:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff917182dd1700) 00010000:00010000:2.0:1782757632.330312:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757632.330315:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330321:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330356:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6467e expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330370:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6467e expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.330377:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757632.330380:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782757632.330382:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694600, rc 0) 00000100:00100000:2.0:1782757632.330468:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:41119:x1869355196610944:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 858us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757632.330476:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:2.0:1782757632.346035:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196611328 00000100:00100000:2.0:1782757632.346052:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196611328 00000100:00100000:2.0:1782757632.346140:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:2.0:1782757632.346153:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:41119:x1869355196611328:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782757632.346234:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757632.346272:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d955a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6467e expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346315:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d953e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64677 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346335:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757632.346348:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757632.346380:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9568 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346397:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9568 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346409:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9568 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346425:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d956f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346433:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d956f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346440:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d956f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346595:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9576 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346605:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9576 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757632.346613:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9576 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757633.451982:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757633.974941:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1782757633.974958:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757633.975039:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211466880:12345-0@lo:400:kworker.0 Request processed in 87us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757633.975046:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1782757633.975071:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1782757633.975078:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211466752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757633.975107:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211466752:12345-0@lo:400:kworker.0 Request processed in 29us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757633.975113:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1782757634.476359:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211467392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757634.476452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1782757634.629643:0:70273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff831c7910 20000000:00000080:2.0:1782757634.629662:0:70273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc3800 uarg=0000000000000000 00010000:00010000:2.0:1782757634.630426:0:70273:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782757634.630464:0:70273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:2.0:1782757634.630468:0:70273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757634.630480:0:70273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d950d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64669 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.630510:0:70273:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782757634.630526:0:70273:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757634.630540:0:70273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.630553:0:70273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.630567:0:70273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.630604:0:70273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.630618:0:70273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 18 pid: 5793 timeout: 1803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757634.630635:0:70273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70273:1869355211467520:0@lo:104: 00000100:00100000:2.0:1782757634.630703:0:70273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757634.630868:0:70273:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782757634.631653:0:70273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70273:1869355211467520:0@lo:104: 00010000:00010000:2.0:1782757634.631673:0:70273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757634.632022:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211467648 00000100:00100000:2.0:1782757634.632028:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211467648 00010000:00010000:2.0:1782757634.632122:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 19 pid: 5793 timeout: 1803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757634.632317:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1782757634.632326:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211467648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757634.632338:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757634.632344:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 19 pid: 5793 timeout: 1803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632356:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 19 pid: 5793 timeout: 1803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632370:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d94f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d94ea expref: 19 pid: 5793 timeout: 1803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632384:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632392:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632405:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632412:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632418:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632423:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632428:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757634.632432:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632439:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632460:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694600/0xdd99f5c4777d9584 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757634.632474:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757634.632515:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211467648:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757634.632522:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:2.0:1782757635.503269:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757635.634651:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211467904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782757635.634687:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757635.634937:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196611968 00000100:00100000:2.0:1782757635.634945:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196611968 00010000:00010000:2.0:1782757635.635002:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042a82125/0xdd99f5c4777d9561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64685 expref: 6 pid: 9120 timeout: 1804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757635.635059:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 323 00000100:00100000:2.0:1782757635.635069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196611968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757635.635084:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757635.635089:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042a82125/0xdd99f5c4777d9561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64685 expref: 6 pid: 9120 timeout: 1804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635103:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042a82125/0xdd99f5c4777d9561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64685 expref: 6 pid: 9120 timeout: 1804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635144:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a82125/0xdd99f5c4777d9561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64685 expref: 6 pid: 9120 timeout: 1804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635168:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757635.635172:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757635.635178:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635188:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635213:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757635.635274:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196611968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 206us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757635.635281:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 323 00010000:00010000:2.0:1782757635.635389:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635398:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635408:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635417:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.635434:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782757635.635950:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211467776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16237us (16389us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782757635.635959:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00010000:2.0:1782757635.635987:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757635.635993:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.636001:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757635.636006:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.636014:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.636029:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.636035:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777d958b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757635.636055:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757635.636057:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757635.636059:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782757635.636092:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082bb5500/2, rc 0, transno 4294967333 00000100:00100000:2.0:1782757635.636099:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211467776:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782757637.559151:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757638.572453:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782757638.751136:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782757638.751150:0:7507:0:(genops.c:906:class_export_put()) final put ffff91708297c800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782757638.751191:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff91708297c800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:2.0:1782757638.751252:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91708297f000 for lustre-OST0001 00000100:00100000:2.0:1782757639.139652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:2.0:1782757639.273061:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00010000:00010000:1.0:1782757639.273940:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d95ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757639.273948:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757639.273954:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d95ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757639.273962:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d95ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757639.273984:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75600) 00010000:00010000:1.0:1782757639.273988:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757639.273994:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d95ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757639.274001:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d95ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757639.597883:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757639.601927:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211469056:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782757640.211757:0:70472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff95bb8cc0 20000000:00000080:2.0:1782757640.211777:0:70472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bcfa5400 uarg=0000000000000000 00010000:00010000:2.0:1782757640.214579:0:70472:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757640.214601:0:70472:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757640.214630:0:70472:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757640.214651:0:70472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.216119:0:70472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d9599 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9592 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.216131:0:70472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.216172:0:70472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d9599 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9592 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.216187:0:70472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d9599 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9592 expref: 18 pid: 5796 timeout: 1808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757640.216201:0:70472:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70472:1869355211469184:0@lo:104: 00000100:00100000:2.0:1782757640.216265:0:70472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757640.216536:0:70472:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782757640.220092:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211469184 00000100:00100000:1.0:1782757640.220110:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211469184 00000100:00100000:1.0:1782757640.220193:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1782757640.220205:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:70472:x1869355211469184:12345-0@lo:104: 00010000:00010000:1.0:1782757640.220224:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9592 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9599 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757640.220324:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757640.220331:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:70472:x1869355211469184:12345-0@lo:104: Request processed in 128us (4066us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757640.220338:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00010000:2.0:1782757640.222246:0:70472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d9599 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9592 expref: 18 pid: 5796 timeout: 1808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757640.222269:0:70472:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70472:1869355211469184:0@lo:104: 00010000:00010000:2.0:1782757640.222298:0:70472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.222311:0:70472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.222319:0:70472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.222327:0:70472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777d95b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757640.623998:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757641.650955:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757642.157721:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211469440 00000100:00100000:1.0:1782757642.157733:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211469440 00000100:00100000:1.0:1782757642.157807:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1782757642.157818:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211469440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757642.157875:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757642.157951:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211469440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757642.157958:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1782757642.158010:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211469440:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782757642.221895:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757642.221904:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757642.221909:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757642.221959:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757642.221972:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757642.221983:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757642.222012:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211469568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757642.222084:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757642.222136:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b32370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782757643.453482:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196612992 00000100:00100000:1.0:1782757643.453488:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196612992 00000100:00100000:1.0:1782757643.453515:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:1.0:1782757643.453522:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196612992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757643.453550:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196612992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757643.453559:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:2.0:1782757643.453564:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196613248 00000100:00100000:2.0:1782757643.453570:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196613248 00000100:00100000:2.0:1782757643.453620:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 856 00000100:00100000:2.0:1782757643.453629:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196613248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757643.453660:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196613248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757643.453680:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 856 00010000:00010000:2.0:1782757643.694191:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757644.097427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757644.097474:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196613376 00000100:00100000:2.0:1782757644.097483:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196613376 00000100:00100000:2.0:1782757644.097539:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:2.0:1782757644.097550:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41288:x1869355196613376:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757644.097570:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757644.097595:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d95ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64693 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097675:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097689:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097702:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097715:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097723:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.097730:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098205:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098214:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098227:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757644.098311:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1782757644.098315:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757644.098394:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098407:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098414:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098421:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098427:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757644.098431:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098438:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098451:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757644.098454:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757644.098459:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098465:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d95d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098480:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098486:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098492:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098498:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757644.098500:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098506:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098514:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1700) 00010000:00010000:2.0:1782757644.098516:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757644.098519:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098525:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d95d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098555:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d95ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64693 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098572:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64693 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757644.098585:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782757644.098587:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757644.098589:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782757644.098652:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41288:x1869355196613376:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1104us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757644.098671:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:2.0:1782757644.206294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211469952:0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.206365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757644.206428:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757644.206435:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211470080:0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.206463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757644.206500:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211469952 00000100:00100000:2.0:1782757644.206509:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211469952 00000100:00100000:2.0:1782757644.206563:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1782757644.206572:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211469952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.206623:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211469952:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757644.206630:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1782757644.206671:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211470080 00000100:00100000:2.0:1782757644.206675:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211470080 00000100:00100000:2.0:1782757644.206706:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1782757644.206713:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211470080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.206744:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211470080:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757644.206750:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:2.0:1782757644.206767:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757644.206772:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757644.206807:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211470080:0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.206817:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211469952:0@lo:400:kworker.0 00000100:00100000:1.0:1782757644.207534:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211470336 00000100:00100000:1.0:1782757644.207538:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211470336 00000100:00100000:1.0:1782757644.207578:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1782757644.207585:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757644.207627:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211470336:12345-0@lo:400:kworker.0 Request processed in 42us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757644.207633:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1782757644.207674:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211470336:0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.208122:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211469696 00000100:00100000:2.0:1782757644.208126:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211469696 00000100:00100000:2.0:1782757644.208154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1782757644.208160:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211469696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757644.208196:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211469696:12345-0@lo:400:kworker.0 Request processed in 37us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757644.208201:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:2.0:1782757644.208232:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757644.208235:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757644.208253:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211469696:0@lo:400:kworker.0 00010000:00010000:2.0:1782757644.717456:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757644.717595:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211470464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757644.717675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1782757646.281132:0:70716:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9c0c8970 20000000:00000080:1.0:1782757646.281154:0:70716:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2b9e400 uarg=0000000000000000 00010000:00010000:1.0:1782757646.281608:0:70716:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782757646.281657:0:70716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:1.0:1782757646.281661:0:70716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757646.281671:0:70716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d95df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64693 expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757646.281691:0:70716:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782757646.281704:0:70716:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757646.281715:0:70716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757646.281728:0:70716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757646.281735:0:70716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757646.281767:0:70716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757646.281785:0:70716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 18 pid: 5794 timeout: 1814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757646.281799:0:70716:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70716:1869355211470592:0@lo:104: 00000100:00100000:1.0:1782757646.281886:0:70716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757646.281936:0:70716:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067e40 going to sleep for 11 seconds 00010000:00010000:2.0:1782757646.283164:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757646.283173:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283183:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757646.283187:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283196:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757646.283207:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757646.283212:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757646.283258:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283264:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757646.283289:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283295:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777d95bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d95c3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283312:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757646.283313:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757646.283315:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757646.283329:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211470720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757646.283378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757646.283437:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211470720 00000100:00100000:2.0:1782757646.283442:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211470720 00010000:00010000:2.0:1782757646.283465:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 19 pid: 5794 timeout: 1814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757646.283491:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1782757646.283499:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211470720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757646.283511:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757646.283516:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 19 pid: 5794 timeout: 1814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283527:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d95bc expref: 19 pid: 5794 timeout: 1814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283546:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283556:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283571:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283578:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283585:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283592:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283598:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757646.283603:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283622:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283633:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d95e6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757646.283655:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757646.283686:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211470720:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757646.283694:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1782757646.283759:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211470720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757646.764321:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757647.306782:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757647.306805:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211470848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757647.306897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782757647.308484:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782757647.795165:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757648.564810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757648.564888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757648.564962:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196613504 00000100:00100000:1.0:1782757648.564968:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196613504 00000100:00100000:1.0:1782757648.565021:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:1.0:1782757648.565034:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196613504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782757648.565112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757648.565157:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196613504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 126us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757648.565165:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:1.0:1782757648.573424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757648.573456:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196613760 00000100:00100000:1.0:1782757648.573464:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196613760 00000100:00100000:1.0:1782757648.573511:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 859 00000100:00100000:1.0:1782757648.573519:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196613760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757648.573583:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196613760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757648.573590:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 859 00000100:00080000:1.0:1782757648.573624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757649.324696:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211471232:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.324727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757649.324755:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211471744:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.324788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757649.324819:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757649.324851:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211471360:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.324873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757649.324903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471104 00000100:00100000:2.0:1782757649.324907:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471104 00000100:00100000:2.0:1782757649.324935:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1782757649.324942:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.324979:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211471104:12345-0@lo:400:kworker.0 Request processed in 37us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757649.324985:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1782757649.325013:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471616 00000100:00100000:2.0:1782757649.325017:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471616 00000100:00100000:2.0:1782757649.325047:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471232 00000100:00100000:2.0:1782757649.325050:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471232 00000100:00100000:2.0:1782757649.325065:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471360 00000100:00100000:2.0:1782757649.325067:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471360 00000100:00100000:2.0:1782757649.325081:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1782757649.325086:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211471616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325116:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211471616:12345-0@lo:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757649.325122:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1782757649.325134:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1782757649.325139:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211471232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325170:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211471232:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757649.325176:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1782757649.325188:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1782757649.325195:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211471360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325222:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211471360:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757649.325228:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1782757649.325245:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471744 00000100:00100000:2.0:1782757649.325248:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471744 00000100:00100000:2.0:1782757649.325272:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1782757649.325278:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211471744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325307:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211471744:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757649.325313:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:2.0:1782757649.325342:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757649.325345:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757649.325364:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211471360:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325373:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211471232:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325381:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211471744:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325407:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211471104:0@lo:400:kworker.0 00000100:00100000:2.0:1782757649.325417:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211471616:0@lo:400:kworker.0 00010000:00010000:2.0:1782757649.836798:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757649.837091:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211471872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757649.837161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757649.837345:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211471872 00000100:00100000:1.0:1782757649.837354:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211471872 00000100:00100000:1.0:1782757649.837407:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1782757649.837417:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211471872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757649.837450:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757649.837497:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211471872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757649.837504:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1782757649.837603:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211471872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757649.932137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757649.942085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757649.942183:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196614144 00000100:00100000:1.0:1782757649.942195:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196614144 00000100:00100000:1.0:1782757649.942252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:1.0:1782757649.942261:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41379:x1869355196614144:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782757649.942311:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782757649.942336:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6469a expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757649.942350:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d95df) 00010000:00010000:1.0:1782757649.942354:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782757649.942365:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757649.942388:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9609 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757649.942401:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757649.942410:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757649.943294:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a27b3421 reply state 00000000a50ca85f transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757649.943306:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757649.943380:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:1.0:1782757649.946604:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41379:x1869355196614144:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 4332us (4518us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1782757649.946616:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 573 00010000:00010000:2.0:1782757650.862089:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757650.943355:0:70914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce4d0ce70 20000000:00000080:1.0:1782757650.943374:0:70914:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5b800 uarg=0000000000000000 00010000:00010000:1.0:1782757650.944229:0:70914:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757650.944247:0:70914:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757650.944260:0:70914:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757650.944280:0:70914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757650.944302:0:70914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d95ed expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757650.944312:0:70914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757650.944357:0:70914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d95ed expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757650.944373:0:70914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777d95f4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d95ed expref: 18 pid: 5794 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757650.944389:0:70914:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70914:1869355211472000:0@lo:104: 00000100:00100000:1.0:1782757650.945110:0:70914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757650.945218:0:70914:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782757650.945770:0:70914:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70914:1869355211472000:0@lo:104: 00010000:00010000:2.0:1782757650.945791:0:70914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757650.951465:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211472128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757650.951549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782757650.952274:0:70914:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757650.952281:0:70914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757650.952291:0:70914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9610 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757650.953289:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211472128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757652.014463:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211472256 00000100:00100000:1.0:1782757652.014473:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211472256 00000100:00100000:1.0:1782757652.014546:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1782757652.014558:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211472256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757652.014575:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757652.014591:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9617 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757652.014617:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757652.014629:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757652.014639:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782757652.014693:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211472256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757652.014700:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1782757652.413876:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211472384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757652.413953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757652.414028:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211472384 00000100:00100000:1.0:1782757652.414036:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211472384 00000100:00100000:1.0:1782757652.414095:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1782757652.414104:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211472384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757652.414138:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757652.414177:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211472384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757652.414184:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:1.0:1782757652.414205:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757652.414237:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211472384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757652.908145:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757653.686486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757653.686532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757653.686559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757653.686592:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196614272 00000100:00100000:2.0:1782757653.686605:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196614272 00000100:00100000:2.0:1782757653.686657:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:2.0:1782757653.686666:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196614272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757653.686729:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196614272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757653.686737:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:2.0:1782757653.686768:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196614528 00000100:00100000:2.0:1782757653.686771:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196614528 00000100:00100000:2.0:1782757653.686804:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 862 00000100:00100000:2.0:1782757653.686810:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196614528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757653.686858:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196614528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757653.686864:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 862 00000100:00080000:2.0:1782757653.686953:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757653.688716:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757653.933277:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757654.452181:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211472512:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.454289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757654.454485:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211473024:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.456737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757654.461897:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211472512 00000100:00100000:2.0:1782757654.461919:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211472512 00000100:00100000:2.0:1782757654.462016:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1782757654.462029:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.462138:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211472512:12345-0@lo:400:kworker.0 Request processed in 112us (7867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757654.462147:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1782757654.466429:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1782757654.472882:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211472768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757654.473028:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211472768:12345-0@lo:400:kworker.0 Request processed in 6585us (18252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757654.473040:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1782757654.473121:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211472768:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.473558:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473152 00000100:00100000:2.0:1782757654.473568:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473152 00000100:00100000:2.0:1782757654.473621:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211472896 00000100:00100000:2.0:1782757654.473624:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211472896 00000100:00100000:2.0:1782757654.473647:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1782757654.473656:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211473152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.473719:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211473152:12345-0@lo:400:kworker.0 Request processed in 64us (19082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757654.473726:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1782757654.473739:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1782757654.473745:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.473905:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211472896:12345-0@lo:400:kworker.0 Request processed in 159us (17906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757654.473912:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00080000:2.0:1782757654.473940:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757654.473944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757654.473947:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757654.473979:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211472512:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.473999:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211473024:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.474040:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211473152:0@lo:400:kworker.0 00000100:00100000:2.0:1782757654.474077:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211472896:0@lo:400:kworker.0 00000100:00100000:1.0:1782757654.956979:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473280 00000100:00100000:1.0:1782757654.956988:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473280 00000100:00100000:1.0:1782757654.957042:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1782757654.957052:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211473280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757654.957087:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757654.957148:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211473280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757654.957155:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1782757654.993009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757655.142580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757655.143058:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196614784 00000100:00100000:2.0:1782757655.143067:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196614784 00000100:00100000:2.0:1782757655.143139:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00100000:2.0:1782757655.143149:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41464:x1869355196614784:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757655.143668:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41464:x1869355196614784:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 519us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757655.143677:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00100000:2.0:1782757655.164070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757655.170020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757655.176934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757655.177044:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196615168 00000100:00100000:2.0:1782757655.177055:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196615168 00000100:00100000:2.0:1782757655.177123:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:2.0:1782757655.177133:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41464:x1869355196615168:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757655.177611:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41464:x1869355196615168:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 478us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757655.177620:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:1.0:1782757655.196329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757655.350732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757655.367928:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196615552 00000100:00100000:2.0:1782757655.367938:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196615552 00000100:00100000:2.0:1782757655.367998:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 309 00000100:00100000:2.0:1782757655.368007:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41464:x1869355196615552:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757655.368366:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41464:x1869355196615552:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 359us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757655.368374:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 309 00000100:00100000:1.0:1782757655.371590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757655.679208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:1.0:1782757655.704467:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00000100:00100000:3.0:1782757655.704862:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757655.704919:0:7941:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46180 going to sleep for 11 seconds 00010000:00010000:1.0:1782757655.707450:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d965d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707468:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d965d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707479:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d965d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707516:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707524:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707531:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707537:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757655.707541:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707548:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707571:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782757655.707575:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757655.707580:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707586:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d964f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757655.707605:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c58efd8 reply state 000000006b5b04ce transno 4294967520 ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757655.707614:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782757655.707645:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9648 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646a8 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707660:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d965d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646a8 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757655.707667:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782757655.707669:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757655.707672:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757655.707740:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41468:x1869355196616064:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 7185us (7593us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1782757655.707756:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 579 00010000:00010000:3.0:1782757655.716371:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716389:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716396:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716402:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757655.716408:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716416:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716444:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff91718bcfdd00) 00010000:00010000:3.0:1782757655.716448:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757655.716453:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757655.716459:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757655.748384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757655.837574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757655.839103:0:7941:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1869355211473408:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782757655.839121:0:7941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1782757655.839317:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196616320 00000100:00100000:1.0:1782757655.839325:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196616320 00002000:00100000:1.0:1782757655.839386:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff917081ad6d80 x1869355196616320/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:326/0 lens 488/0 e 0 to 0 dl 1782757666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1782757655.839397:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081ad6d80 with x1869355196616320 ext(0->1048575) 00002000:00010000:1.0:1782757655.839404:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917081ad6d80 00000100:00100000:1.0:1782757655.839464:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1782757655.839475:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196616320:12345-192.168.204.31@tcp:4:dd.60003 00000001:00100000:2.0:1782757655.986924:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:2.0:1782757655.986953:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00010000:00010000:1.0:1782757655.987015:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757656.062651:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196616320:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 223168us (225084us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782757656.062670:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00002000:00100000:3.0:1782757656.062684:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff917081ad6d80 x1869355196616320/t4294967332(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:326/0 lens 488/448 e 0 to 0 dl 1782757666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1782757656.062693:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081ad6d80 with x1869355196616320 ext(0->1048575) 00002000:00010000:3.0:1782757656.062701:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917081ad6d80 00000001:00080000:2.0:1782757656.063855:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:3.0:1782757656.066056:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196616448 00000100:00100000:3.0:1782757656.066065:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196616448 00000100:00100000:3.0:1782757656.066121:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:3.0:1782757656.066131:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41468:x1869355196616448:12345-192.168.204.31@tcp:44:dd.60003 00000100:00100000:3.0:1782757656.097925:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41468:x1869355196616448:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 31784us (31951us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757656.097940:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:3.0:1782757656.100152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757656.100251:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196616576 00000100:00100000:1.0:1782757656.100260:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196616576 00000100:00100000:1.0:1782757656.100318:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:1.0:1782757656.100328:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196616576:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:1.0:1782757656.100554:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196616576:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757656.100562:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:1.0:1782757656.103106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782757657.023742:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757657.529488:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473536 00000100:00100000:3.0:1782757657.529498:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473536 00000100:00100000:3.0:1782757657.529562:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1782757657.529572:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211473536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757657.529618:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757657.529665:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211473536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757657.529672:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1782757658.830216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757658.830261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757658.830298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757658.830332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757658.830475:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617344 00000100:00100000:2.0:1782757658.830484:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617344 00000100:00100000:2.0:1782757658.830542:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617216 00000100:00100000:2.0:1782757658.830545:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617216 00000100:00100000:2.0:1782757658.830577:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 865 00000100:00100000:2.0:1782757658.830587:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196617344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757658.830655:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196617344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757658.830677:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 865 00000100:00100000:2.0:1782757658.830693:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 866 00000100:00100000:2.0:1782757658.830699:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196617216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757658.830720:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196617216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757658.830727:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 866 00000100:00100000:3.0:1782757658.830941:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617088 00000100:00100000:3.0:1782757658.830946:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617088 00000100:00100000:3.0:1782757658.830986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1190 00000100:00100000:3.0:1782757658.830994:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196617088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757658.831036:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196617088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757658.831043:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1190 00000100:00080000:1.0:1782757658.835032:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757658.835041:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757658.835044:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782757659.053832:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757659.566037:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211474048:0@lo:400:kworker.0 00000100:00100000:3.0:1782757659.566108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757659.566180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757659.566187:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211473920:0@lo:400:kworker.0 00000100:00100000:3.0:1782757659.566215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757659.566324:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473920 00000100:00100000:1.0:1782757659.566332:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473920 00000100:00100000:1.0:1782757659.566401:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1782757659.566413:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211473920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.566470:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211473920:12345-0@lo:400:kworker.0 Request processed in 60us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757659.566477:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1782757659.566530:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211473920:0@lo:400:kworker.0 00000100:00100000:2.0:1782757659.567032:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474048 00000100:00100000:2.0:1782757659.567037:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474048 00000100:00100000:2.0:1782757659.567072:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474304 00000100:00100000:2.0:1782757659.567074:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474304 00000100:00100000:2.0:1782757659.567093:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1782757659.567099:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211474048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757659.567136:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211474048:12345-0@lo:400:kworker.0 Request processed in 37us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757659.567142:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1782757659.567151:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1782757659.567156:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211474304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757659.567181:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211474304:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757659.567186:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1782757659.567203:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473664 00000100:00100000:2.0:1782757659.567205:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473664 00000100:00100000:2.0:1782757659.567224:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1782757659.567229:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211473664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757659.567253:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211473664:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757659.567258:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1782757659.567287:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211473664:0@lo:400:kworker.0 00000100:00100000:2.0:1782757659.567296:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:2.0:1782757659.567305:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211474304:0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.567378:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211473792 00000100:00100000:1.0:1782757659.567382:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211473792 00000100:00100000:1.0:1782757659.567412:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474176 00000100:00100000:1.0:1782757659.567415:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474176 00000100:00100000:1.0:1782757659.567436:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1782757659.567442:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211473792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.567481:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211473792:12345-0@lo:400:kworker.0 Request processed in 38us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757659.567487:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1782757659.567500:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1782757659.567506:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211474176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.567533:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211474176:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757659.567538:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1782757659.567569:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211474176:0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.567579:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211473792:0@lo:400:kworker.0 00000100:00100000:1.0:1782757659.567602:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211474048:0@lo:400:kworker.0 00000100:00080000:3.0:1782757659.567666:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757659.567671:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757659.567674:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1782757659.844497:0:71161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1728247670720ns, next at 1701752285653ns, rc = 0 00000004:00080000:1.0:1782757659.845118:0:71161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1728248293895ns, next at 1667137720982ns, rc = 0 00000100:00100000:2.0:1782757660.076765:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211474432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757660.076895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782757660.077224:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757660.077518:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474432 00000100:00100000:3.0:1782757660.077529:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474432 00000100:00100000:3.0:1782757660.077591:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1782757660.077601:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211474432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757660.077659:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782757660.079078:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211474432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1467us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757660.079093:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1782757660.086338:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211474432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757662.124168:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757662.377172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757662.378451:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617472 00000100:00100000:1.0:1782757662.378471:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617472 00000100:00100000:1.0:1782757662.378599:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00100000:1.0:1782757662.378614:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617472:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757662.379124:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617472:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 511us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.379134:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00080000:3.0:1782757662.379594:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757662.403950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757662.413137:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617600 00000100:00100000:2.0:1782757662.413164:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617600 00000100:00100000:3.0:1782757662.415582:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 313 00000100:00100000:3.0:1782757662.415602:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41661:x1869355196617600:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757662.416599:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41661:x1869355196617600:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 997us (12660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757662.416613:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 313 00000100:00080000:1.0:1782757662.418667:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757662.420963:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617728 00000100:00100000:1.0:1782757662.420987:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617728 00000100:00100000:1.0:1782757662.421081:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 314 00000100:00100000:1.0:1782757662.421098:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41661:x1869355196617728:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:3.0:1782757662.422001:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757662.424350:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41661:x1869355196617728:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 3243us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.424369:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 314 00000100:00100000:1.0:1782757662.439715:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617856 00000100:00100000:1.0:1782757662.439728:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617856 00000100:00100000:1.0:1782757662.439803:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:1.0:1782757662.439816:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617856:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757662.441104:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617856:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1286us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.441115:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:2.0:1782757662.464368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757662.464993:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196617984 00000100:00100000:1.0:1782757662.465010:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196617984 00000100:00100000:1.0:1782757662.465086:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:1.0:1782757662.465098:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617984:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757662.465243:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196617984:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 146us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.465251:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:1.0:1782757662.469811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757662.470106:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618112 00000100:00100000:3.0:1782757662.470119:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618112 00000100:00100000:3.0:1782757662.470184:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 315 00000100:00100000:3.0:1782757662.470195:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41661:x1869355196618112:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757662.471227:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41661:x1869355196618112:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1025us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757662.471240:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 315 00000100:00100000:2.0:1782757662.482632:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618240 00000100:00100000:2.0:1782757662.482647:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618240 00000100:00100000:2.0:1782757662.482724:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 316 00000100:00100000:2.0:1782757662.482737:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41661:x1869355196618240:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757662.483868:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41661:x1869355196618240:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1128us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757662.483889:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 316 00000100:00100000:2.0:1782757662.490469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757662.490589:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618368 00000100:00100000:1.0:1782757662.490602:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618368 00000100:00100000:1.0:1782757662.491022:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:1.0:1782757662.491040:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196618368:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757662.492563:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41661:x1869355196618368:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1516us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.492579:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:1.0:1782757662.613699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757662.613854:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618624 00000100:00100000:2.0:1782757662.613868:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618624 00000100:00100000:2.0:1782757662.613945:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:2.0:1782757662.613957:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41665:x1869355196618624:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782757662.614033:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757662.614070:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d965d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646a8 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614095:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782757662.614111:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757662.614141:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614158:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614168:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614188:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614195:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614201:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614657:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614668:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.614676:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757662.616011:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9344 00000004:00080000:2.0:1782757662.616026:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1731019202923ns, next at 1732019200345ns, rc = 0 00010000:00010000:2.0:1782757662.616147:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616162:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616173:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616184:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616196:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616202:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9687 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616243:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757662.616277:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616284:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616301:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616308:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757662.616313:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616321:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616336:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:2.0:1782757662.616340:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757662.616345:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616351:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9680 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616376:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616383:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616389:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616394:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757662.616397:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616403:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616411:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782757662.616413:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757662.616417:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757662.616423:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9672 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757662.616433:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014e108d3 reply state 0000000037bdbcb5 transno 4294967523 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757662.616444:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757662.616561:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41665:x1869355196618624:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 2601us (2874us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1782757662.616572:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 585 00010000:00010000:3.0:1782757662.622637:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622660:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622669:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622675:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757662.622681:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622690:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622711:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff917182dd1000) 00010000:00010000:3.0:1782757662.622714:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757662.622727:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757662.622735:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9679 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757662.636451:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757662.636478:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211474560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757662.636565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757662.636941:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474560 00000100:00100000:1.0:1782757662.636951:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474560 00000100:00100000:1.0:1782757662.637027:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1782757662.637038:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211474560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757662.637091:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757662.637157:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211474560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757662.637165:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1782757662.637230:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211474560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782757662.639228:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757663.924787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757663.924859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757663.924887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757663.924916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757663.924946:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618880 00000100:00100000:1.0:1782757663.924957:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618880 00000100:00100000:1.0:1782757663.925013:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:1.0:1782757663.925023:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196618880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757663.925179:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196619008 00000100:00100000:2.0:1782757663.925183:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196619008 00000100:00100000:2.0:1782757663.925225:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196619136 00000100:00100000:2.0:1782757663.925229:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196619136 00000100:00100000:2.0:1782757663.925250:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 869 00000100:00100000:2.0:1782757663.925258:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196619008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757663.925330:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196619008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757663.925338:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 869 00000100:00100000:2.0:1782757663.925356:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 870 00000100:00100000:2.0:1782757663.925363:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196619136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757663.925389:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196619136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757663.925395:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 870 00000100:00100000:1.0:1782757663.925872:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196618880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 850us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757663.925881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:3.0:1782757663.926452:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196618752 00000100:00100000:3.0:1782757663.926458:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196618752 00000100:00100000:3.0:1782757663.926532:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1014 00000100:00100000:3.0:1782757663.926540:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196618752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757663.926591:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196618752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757663.926608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1014 00010000:00010000:2.0:1782757664.172108:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757664.684115:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211474688:0@lo:400:kworker.0 00000100:00100000:3.0:1782757664.684237:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211474816:0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.684340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757664.684387:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708364aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211475200:0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.684413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757664.684456:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474688 00000100:00100000:2.0:1782757664.684463:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474688 00000100:00100000:2.0:1782757664.684506:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1782757664.684514:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.684564:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211474688:12345-0@lo:400:kworker.0 Request processed in 51us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757664.684641:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1782757664.684675:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475200 00000100:00100000:2.0:1782757664.684679:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475200 00000100:00100000:2.0:1782757664.684711:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1782757664.684716:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211475200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.684746:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211475200:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757664.684751:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:2.0:1782757664.684768:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757664.684794:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211474688:0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.684805:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708364aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211475200:0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.698500:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474944 00000100:00100000:2.0:1782757664.698505:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474944 00000100:00100000:2.0:1782757664.698540:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1782757664.698547:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211474944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.698600:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211474944:12345-0@lo:400:kworker.0 Request processed in 53us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757664.698606:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1782757664.698910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757664.698939:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211475328:0@lo:400:kworker.0 00000100:00100000:3.0:1782757664.698964:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757664.698994:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475328 00000100:00100000:3.0:1782757664.698997:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475328 00000100:00100000:3.0:1782757664.699024:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1782757664.699031:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211475328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757664.699065:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211475328:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757664.699072:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1782757664.699101:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211475328:0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.703138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211474816 00000100:00100000:2.0:1782757664.703152:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211474816 00000100:00100000:2.0:1782757664.703216:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1782757664.703224:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211474816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757664.703320:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211474816:12345-0@lo:400:kworker.0 Request processed in 96us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757664.703327:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00010000:00010000:2.0:1782757665.204470:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757665.211337:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1733614512120ns, next at 1734614510270ns, rc = 0 00000100:00100000:3.0:1782757665.211367:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757665.211386:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211475456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757665.211460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757665.211523:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475456 00000100:00100000:3.0:1782757665.211530:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475456 00000100:00100000:3.0:1782757665.211579:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1782757665.212443:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211475456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757665.212488:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782757665.212562:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211475456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 972us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757665.213301:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000001:00080000:1.0:1782757665.308948:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000004:00080000:1.0:1782757665.308961:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000100:00100000:1.0:1782757665.309089:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211475584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782757665.309158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757665.309230:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475584 00000100:00100000:1.0:1782757665.309237:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475584 00000100:00100000:1.0:1782757665.309296:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1782757665.309304:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211475584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782757665.309332:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:1.0:1782757665.309356:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757665.309379:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757665.309386:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x12:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1782757665.309390:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782757665.309394:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757665.309435:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757665.309449:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 5 pid: 9120 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757665.309462:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211475712:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782757665.309521:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c2adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782757665.324220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757665.324426:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196619264 00000100:00100000:2.0:1782757665.324439:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196619264 00010000:00010000:2.0:1782757665.324500:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 6 pid: 9120 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757665.324543:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 327 00000100:00100000:2.0:1782757665.324554:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196619264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757665.324575:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757665.324580:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 6 pid: 9120 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.324594:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 6 pid: 9120 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.324619:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d966b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646af expref: 6 pid: 9120 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.324634:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757665.324638:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757665.324644:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.324654:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.324687:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757665.324737:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196619264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 185us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757665.324761:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 327 00010000:00010000:2.0:1782757665.325085:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.325096:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.325106:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.325113:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757665.328453:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782757665.329124:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211475584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19817us (19962us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782757665.329134:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:1.0:1782757665.329882:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782757665.330045:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917190267480/2, rc 0, transno 4294967333 00000100:00100000:1.0:1782757665.330055:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211475584:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782757665.339729:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757665.339742:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757665.339766:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757665.339772:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757665.339784:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757665.339806:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757665.339819:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f358c2cc/0xdd99f5c4777d968e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757665.344626:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757665.344635:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757665.344638:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757666.124797:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000004:00080000:3.0:1782757666.124819:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000004:00080000:3.0:1782757666.124867:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00010000:00010000:2.0:1782757666.246384:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757667.314089:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000100:00100000:3.0:1782757667.763419:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782757667.763442:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211475840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757667.763524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757667.763587:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475840 00000100:00100000:3.0:1782757667.763613:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475840 00000100:00100000:3.0:1782757667.763685:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1782757667.763694:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211475840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757667.763728:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782757667.763974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757667.764053:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211475840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 359us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757667.764062:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1782757667.764148:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211475840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757668.333370:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757669.056135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757669.056206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757669.056248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757669.056280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757669.056315:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196619520 00000100:00100000:1.0:1782757669.056328:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196619520 00000100:00100000:1.0:1782757669.056403:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1198 00000100:00100000:1.0:1782757669.056417:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196619520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757669.056961:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196619520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 547us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757669.056970:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1198 00000100:00080000:1.0:1782757669.057004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757669.057008:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757669.057011:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757669.057029:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 874 00000100:00100000:1.0:1782757669.057037:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196619776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757669.057359:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196619392 00000100:00100000:3.0:1782757669.057366:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196619392 00000100:00100000:3.0:1782757669.057407:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1016 00000100:00100000:3.0:1782757669.057415:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196619392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757669.060752:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196619776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 3712us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757669.060767:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 874 00000100:00100000:3.0:1782757669.065796:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196619392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 8364us (9674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757669.065817:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1016 00010000:00010000:1.0:1782757669.366215:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757669.804559:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211476352:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.804627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.804688:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782757669.804695:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211475968:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.804726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.804749:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211476480:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.804775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.804803:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211476096:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.804857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.804877:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211476608:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.804899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.804916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757669.804921:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211476224:0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.805475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757669.806280:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476352 00000100:00100000:1.0:1782757669.806289:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476352 00000100:00100000:1.0:1782757669.806348:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476608 00000100:00100000:1.0:1782757669.806352:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476608 00000100:00100000:1.0:1782757669.806372:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1782757669.806380:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211476352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.806433:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211476352:12345-0@lo:400:kworker.0 Request processed in 53us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757669.806439:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1782757669.806458:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1782757669.806464:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.806494:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211476608:12345-0@lo:400:kworker.0 Request processed in 30us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757669.806499:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1782757669.806518:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211475968 00000100:00100000:1.0:1782757669.806521:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211475968 00000100:00100000:1.0:1782757669.806544:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1782757669.806550:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211475968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757669.806581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211475968:12345-0@lo:400:kworker.0 Request processed in 31us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757669.806588:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:2.0:1782757669.806659:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757669.806664:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757669.810213:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476480 00000100:00100000:2.0:1782757669.810227:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476480 00000100:00100000:2.0:1782757669.810291:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476096 00000100:00100000:2.0:1782757669.810295:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476096 00000100:00100000:2.0:1782757669.810313:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476224 00000100:00100000:2.0:1782757669.810316:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476224 00000100:00100000:2.0:1782757669.810339:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1782757669.810347:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211476480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757669.810436:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211476480:12345-0@lo:400:kworker.0 Request processed in 89us (5659us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757669.810442:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1782757669.810457:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1782757669.810463:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211476096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757669.810507:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211476096:12345-0@lo:400:kworker.0 Request processed in 44us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757669.810513:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1782757669.810524:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1782757669.810529:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211476224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757669.810559:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211476224:12345-0@lo:400:kworker.0 Request processed in 30us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757669.810565:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:2.0:1782757669.810582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757669.812737:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211475968:0@lo:400:kworker.0 00000100:00100000:3.0:1782757669.812754:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211476480:0@lo:400:kworker.0 00000100:00100000:3.0:1782757669.812767:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211476352:0@lo:400:kworker.0 00000100:00100000:1.0:1782757670.316173:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211476736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757670.316248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757670.316349:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476736 00000100:00100000:3.0:1782757670.316358:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476736 00000100:00100000:3.0:1782757670.316415:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1782757670.316424:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211476736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757670.316471:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757670.316518:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211476736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757670.316526:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1782757670.316705:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211476736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757670.381780:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757671.411779:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757672.428239:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757672.876540:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476864 00000100:00100000:3.0:1782757672.876548:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476864 00000100:00100000:3.0:1782757672.876615:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1782757672.876626:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211476864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757672.876664:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757672.876716:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211476864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757672.876724:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00080000:2.0:1782757672.876792:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757673.452186:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757674.164713:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757674.164759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757674.164802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757674.164879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757674.164966:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196620032 00000100:00100000:2.0:1782757674.164977:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196620032 00000100:00100000:2.0:1782757674.165047:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00100000:2.0:1782757674.165058:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196620032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757674.165155:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196620032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757674.165163:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00080000:1.0:1782757674.165889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757674.165894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757674.165897:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757674.476096:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757674.924311:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211477248:0@lo:400:kworker.0 00000100:00100000:1.0:1782757674.924355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757674.924380:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782757674.924388:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211477120:0@lo:400:kworker.0 00000100:00100000:1.0:1782757674.924412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757674.924431:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211477632:0@lo:400:kworker.0 00000100:00100000:1.0:1782757674.924461:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477504 00000100:00100000:1.0:1782757674.924468:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477504 00000100:00100000:3.0:1782757674.924519:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211476992 00000100:00100000:3.0:1782757674.924526:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211476992 00000100:00100000:1.0:1782757674.924545:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477248 00000100:00100000:1.0:1782757674.924549:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477248 00000100:00100000:1.0:1782757674.924574:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477120 00000100:00100000:1.0:1782757674.924578:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477120 00000100:00100000:1.0:1782757674.924599:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1782757674.924667:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1782757674.924677:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211477248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757674.924728:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211477248:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757674.924736:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1782757674.924756:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1782757674.924762:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211477120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757674.924807:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211477120:12345-0@lo:400:kworker.0 Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757674.924813:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1782757674.924889:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1782757674.924898:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211476992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757674.924934:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211476992:12345-0@lo:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757674.924941:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00080000:3.0:1782757674.925011:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757674.925035:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477376 00000100:00100000:3.0:1782757674.925039:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477376 00000100:00100000:2.0:1782757674.925075:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757674.925118:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211477504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757674.925156:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211477504:12345-0@lo:400:kworker.0 Request processed in 550us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757674.925163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1782757674.925250:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211477248:0@lo:400:kworker.0 00000100:00100000:2.0:1782757674.925273:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211477120:0@lo:400:kworker.0 00000100:00080000:2.0:1782757674.925295:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757674.926013:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477632 00000100:00100000:3.0:1782757674.926020:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477632 00000100:00100000:2.0:1782757674.926037:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1782757674.926048:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211477376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757674.926076:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1782757674.926084:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757674.926141:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211477376:12345-0@lo:400:kworker.0 Request processed in 95us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757674.926150:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211477632:12345-0@lo:400:kworker.0 Request processed in 63us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757674.926154:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1782757674.926164:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:3.0:1782757674.926189:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757674.926210:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211477632:0@lo:400:kworker.0 00000100:00100000:1.0:1782757675.436634:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477760 00000100:00100000:1.0:1782757675.436642:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477760 00000100:00100000:1.0:1782757675.436700:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1782757675.436710:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211477760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757675.436747:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757675.436808:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211477760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757675.436816:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00010000:00010000:3.0:1782757675.500536:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757676.525140:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757677.548479:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757677.996646:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211477888 00000100:00100000:3.0:1782757677.996655:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211477888 00000100:00100000:3.0:1782757677.996721:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1782757677.996732:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211477888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757677.996773:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757677.996849:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211477888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757677.996856:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:2.0:1782757677.997024:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757678.573846:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757679.285633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757679.285677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757679.285712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757679.285745:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196620416 00000100:00100000:2.0:1782757679.285757:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196620416 00000100:00100000:1.0:1782757679.285775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757679.286069:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196620672 00000100:00100000:3.0:1782757679.286075:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196620672 00000100:00100000:3.0:1782757679.286115:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196620800 00000100:00100000:3.0:1782757679.286118:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196620800 00000100:00100000:3.0:1782757679.286143:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 881 00000100:00100000:3.0:1782757679.286151:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196620672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757679.286195:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196620672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757679.286203:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 881 00000100:00100000:2.0:1782757679.286322:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:2.0:1782757679.286330:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196620416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757679.286359:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196620416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757679.286365:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1020 00010000:00010000:1.0:1782757679.597502:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757680.044143:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211478144:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757680.044271:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211478656:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757680.044321:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757680.044326:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211478272:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757680.044376:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478144 00000100:00100000:3.0:1782757680.044383:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478144 00000100:00100000:3.0:1782757680.044422:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478272 00000100:00100000:3.0:1782757680.044426:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478272 00000100:00100000:3.0:1782757680.044456:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1782757680.044464:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211478144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044515:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211478144:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.044522:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1782757680.044538:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1782757680.044544:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211478272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044572:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211478272:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.044577:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1782757680.044596:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478656 00000100:00100000:3.0:1782757680.044600:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478656 00000100:00100000:3.0:1782757680.044626:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1782757680.044633:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211478656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044661:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211478656:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.044666:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:3.0:1782757680.044683:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757680.044687:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757680.044715:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211478272:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044726:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211478144:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.044735:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211478656:0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.044871:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211478400:0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.044902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757680.044931:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782757680.044936:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211478016:0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.044974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757680.044999:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211478528:0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.045021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757680.045047:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478016 00000100:00100000:2.0:1782757680.045052:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478016 00000100:00100000:2.0:1782757680.045079:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1782757680.045086:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211478016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.045119:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211478016:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757680.045125:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1782757680.045159:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211478016:0@lo:400:kworker.0 00000100:00100000:1.0:1782757680.046866:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478528 00000100:00100000:1.0:1782757680.046877:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478528 00000100:00100000:1.0:1782757680.046948:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1782757680.046967:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211478528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757680.047043:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211478528:12345-0@lo:400:kworker.0 Request processed in 78us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757680.047050:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1782757680.047140:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478400 00000100:00100000:3.0:1782757680.047144:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478400 00000100:00100000:3.0:1782757680.047188:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1782757680.047195:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211478400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.047231:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211478400:12345-0@lo:400:kworker.0 Request processed in 36us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.047237:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:2.0:1782757680.047459:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757680.047463:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757680.047496:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211478528:0@lo:400:kworker.0 00000100:00100000:2.0:1782757680.047507:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211478400:0@lo:400:kworker.0 00000100:00100000:3.0:1782757680.557335:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757680.557361:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211478784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757680.557437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757680.557504:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478784 00000100:00100000:3.0:1782757680.557512:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478784 00000100:00100000:3.0:1782757680.557556:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1782757680.557565:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211478784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757680.557603:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757680.557647:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211478784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.557656:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1782757680.557716:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211478784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757680.620247:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757680.897063:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196620928 00000100:00100000:3.0:1782757680.897076:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196620928 00000100:00100000:3.0:1782757680.897148:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:3.0:1782757680.897158:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196620928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757680.897267:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196620928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 110us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.897275:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:3.0:1782757680.911169:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621056 00000100:00100000:3.0:1782757680.911180:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621056 00000100:00100000:3.0:1782757680.911243:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 318 00000100:00100000:3.0:1782757680.911490:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621056:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757680.912026:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621056:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 773us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.912045:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 318 00000100:00100000:2.0:1782757680.933202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757680.945176:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621184 00000100:00100000:3.0:1782757680.945191:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621184 00000100:00100000:3.0:1782757680.945469:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 319 00000100:00100000:3.0:1782757680.945482:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757680.946737:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1254us (13541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757680.946748:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 319 00000100:00100000:1.0:1782757680.955538:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621312 00000100:00100000:1.0:1782757680.955548:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621312 00000100:00100000:1.0:1782757680.955609:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00100000:1.0:1782757680.955619:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621312:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757680.956391:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621312:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 771us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757680.956399:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00100000:1.0:1782757680.973867:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621440 00000100:00100000:1.0:1782757680.973883:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621440 00000100:00100000:1.0:1782757680.973957:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:1.0:1782757680.973968:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621440:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757680.974094:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621440:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 127us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757680.974103:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:2.0:1782757680.978359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757680.989615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757680.992156:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621696 00000100:00100000:1.0:1782757680.992170:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621696 00000100:00100000:1.0:1782757680.992259:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 321 00000100:00100000:1.0:1782757680.992269:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621696:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757680.992660:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41843:x1869355196621696:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 391us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757680.992668:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 321 00000100:00100000:1.0:1782757680.997559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757681.003866:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621824 00000100:00100000:3.0:1782757681.003884:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621824 00000100:00100000:3.0:1782757681.003991:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:3.0:1782757681.004003:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621824:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00080000:2.0:1782757681.004132:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757681.004505:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41843:x1869355196621824:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 492us (6944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757681.004513:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:2.0:1782757681.068957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757681.069069:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196621952 00000100:00100000:1.0:1782757681.069078:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196621952 00000100:00100000:1.0:1782757681.069141:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:1.0:1782757681.069151:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41844:x1869355196621952:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757681.069172:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757681.069194:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646b6 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069273:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069295:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069306:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757681.069487:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:1.0:1782757681.069492:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757681.069592:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069624:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646b6 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069655:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646b6 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.069664:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782757681.069667:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757681.069670:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782757681.069733:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41844:x1869355196621952:12345-192.168.204.31@tcp:101:rm.0 Request processed in 584us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757681.069740:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:1.0:1782757681.081634:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196622208 00000100:00100000:1.0:1782757681.081646:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196622208 00000100:00100000:1.0:1782757681.081716:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 591 00000100:00100000:1.0:1782757681.081726:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41844:x1869355196622208:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757681.081747:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757681.081772:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d96a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646bd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757681.082061:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:1.0:1782757681.082491:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d96a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646bd expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.082775:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:1.0:1782757681.082778:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782757681.082785:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d96a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646bd expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757681.082803:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782757681.082921:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41844:x1869355196622208:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1196us (2462us total) trans 4294967524 rc 301/301 00000100:00100000:1.0:1782757681.082928:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 591 00000100:00100000:2.0:1782757681.098200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757681.132993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757681.133101:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196622592 00000100:00100000:1.0:1782757681.133111:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196622592 00000100:00100000:1.0:1782757681.133162:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1782757681.133173:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41844:x1869355196622592:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:1.0:1782757681.133732:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41844:x1869355196622592:12345-192.168.204.31@tcp:35:rm.0 Request processed in 558us (751us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1782757681.133742:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:3.0:1782757681.150181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757681.150214:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196622848 00000100:00100000:3.0:1782757681.150223:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196622848 00000100:00100000:3.0:1782757681.150672:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 592 00000100:00100000:3.0:1782757681.150684:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41844:x1869355196622848:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782757681.150742:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782757681.150769:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d969c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646b6 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150789:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646a1 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150798:0:5801:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9297) 00010000:00010000:3.0:1782757681.150802:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757681.150813:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757681.150860:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150873:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150884:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150896:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150902:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.150909:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153595:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153617:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153630:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153885:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153893:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153901:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153907:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757681.153911:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153919:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153940:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782757681.153944:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757681.153949:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153955:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153977:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153983:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153989:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.153995:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757681.153997:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154004:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154011:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782757681.154014:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757681.154016:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154026:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154054:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154061:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154067:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154072:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757681.154075:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154082:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154089:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917191f75b00) 00010000:00010000:3.0:1782757681.154091:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757681.154094:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757681.154100:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757681.154197:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41844:x1869355196622848:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3511us (4020us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782757681.154206:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 592 00010000:00010000:3.0:1782757681.645213:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757681.693712:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00010000:00010000:1.0:1782757682.674489:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757683.116354:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757683.116377:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211478912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757683.116443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757683.116544:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211478912 00000100:00100000:3.0:1782757683.116552:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211478912 00000100:00100000:3.0:1782757683.116609:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1782757683.116617:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211478912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757683.116652:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757683.116696:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211478912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757683.116702:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1782757683.116742:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211478912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757683.116859:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757683.692026:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757684.404329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757684.404435:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196622976 00000100:00100000:1.0:1782757684.404445:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196622976 00000100:00100000:1.0:1782757684.404503:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1022 00000100:00100000:1.0:1782757684.404514:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196622976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757684.404586:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196622976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757684.404597:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1022 00000100:00100000:1.0:1782757684.413725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757684.413900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757684.413936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757684.413966:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196623360 00000100:00100000:1.0:1782757684.413975:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196623360 00000100:00100000:1.0:1782757684.414030:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196623232 00000100:00100000:1.0:1782757684.414033:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196623232 00000100:00100000:1.0:1782757684.414057:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 885 00000100:00100000:1.0:1782757684.414067:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757684.414141:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757684.414148:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 885 00000100:00100000:1.0:1782757684.414170:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 886 00000100:00100000:1.0:1782757684.414176:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757684.415135:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 955us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757684.415144:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 886 00000100:00080000:1.0:1782757684.415173:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757684.415177:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757684.429983:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757684.716928:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757685.164470:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211479168:0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.164551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757685.164622:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211479680:0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.164649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757685.164677:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757685.164683:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211479296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.164705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757685.164741:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479680 00000100:00100000:2.0:1782757685.164750:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479680 00000100:00100000:2.0:1782757685.164808:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1782757685.164817:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211479680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.164906:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211479680:12345-0@lo:400:kworker.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757685.164913:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1782757685.164938:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479168 00000100:00100000:2.0:1782757685.164942:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479168 00000100:00100000:2.0:1782757685.164967:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479296 00000100:00100000:2.0:1782757685.164969:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479296 00000100:00100000:2.0:1782757685.164987:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1782757685.164994:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211479168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.165028:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211479168:12345-0@lo:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757685.165034:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1782757685.165046:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1782757685.165052:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211479296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.165078:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211479296:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757685.165087:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00080000:2.0:1782757685.165102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757685.165106:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757685.165139:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211479296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.165151:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211479168:0@lo:400:kworker.0 00000100:00100000:2.0:1782757685.165160:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211479680:0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.165476:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211479040:0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.165519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757685.165557:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211479552:0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.165583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757685.165601:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757685.165607:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211479424:0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.165648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757685.165677:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479424 00000100:00100000:1.0:1782757685.165681:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479424 00000100:00100000:1.0:1782757685.165718:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1782757685.165725:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211479424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.165762:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211479424:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757685.165768:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1782757685.165799:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211479424:0@lo:400:kworker.0 00000100:00080000:1.0:1782757685.165872:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757685.165931:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479040 00000100:00100000:3.0:1782757685.165936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479040 00000100:00100000:3.0:1782757685.165969:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1782757685.165976:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211479040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757685.166019:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211479040:12345-0@lo:400:kworker.0 Request processed in 44us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757685.166026:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1782757685.166054:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479552 00000100:00100000:3.0:1782757685.166058:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479552 00000100:00100000:3.0:1782757685.166088:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1782757685.166094:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211479552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757685.166125:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211479552:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757685.166131:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00080000:3.0:1782757685.166145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757685.166163:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211479040:0@lo:400:kworker.0 00000100:00100000:3.0:1782757685.166388:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211479552:0@lo:400:kworker.0 00000100:00100000:1.0:1782757685.704213:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211479808 00000100:00100000:1.0:1782757685.704221:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211479808 00000100:00100000:1.0:1782757685.704274:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1782757685.704283:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211479808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757685.704320:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757685.704378:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211479808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757685.704385:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1782757685.704442:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211479808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757685.740786:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782757685.942431:0:71580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd37b18d20 20000000:00000080:2.0:1782757685.942450:0:71580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b347c400 uarg=0000000000000000 00010000:00010000:2.0:1782757685.947483:0:71580:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757685.947509:0:71580:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757685.947537:0:71580:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757685.947563:0:71580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.947582:0:71580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.947591:0:71580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.947635:0:71580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.947652:0:71580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 18 pid: 5794 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757685.947667:0:71580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71580:1869355211479936:0@lo:104: 00000100:00100000:2.0:1782757685.947737:0:71580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757685.947795:0:71580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7540 going to sleep for 11 seconds 00010000:00010000:2.0:1782757685.948747:0:71580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777d961e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9617 expref: 18 pid: 5794 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757685.948758:0:71580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71580:1869355211479936:0@lo:104: 00010000:00010000:2.0:1782757685.948771:0:71580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.948781:0:71580:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.948786:0:71580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757685.948791:0:71580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777d96c6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757686.772979:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757687.087379:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480192 00000100:00100000:2.0:1782757687.087387:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480192 00000100:00100000:2.0:1782757687.087447:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1782757687.087456:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211480192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757687.087472:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757687.087486:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d96cd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.087526:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.087542:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.087552:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782757687.087603:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211480192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757687.087610:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1782757687.087660:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211480192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757687.087676:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.087683:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757687.087715:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757687.087720:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.087728:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782757687.280270:0:71630:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd15b16570 20000000:00000080:1.0:1782757687.280290:0:71630:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b71400 uarg=0000000000000000 00010000:00010000:1.0:1782757687.280801:0:71630:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757687.285671:0:71630:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757687.285737:0:71630:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757687.285762:0:71630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757687.285783:0:71630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757687.285791:0:71630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757687.295520:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480320 00000100:00100000:1.0:1782757687.295539:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480320 00000100:00100000:1.0:1782757687.295664:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1782757687.295674:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:71630:x1869355211480320:12345-0@lo:104: 00010000:00010000:1.0:1782757687.295706:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757687.295869:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757687.295875:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:71630:x1869355211480320:12345-0@lo:104: Request processed in 204us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757687.295883:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00010000:2.0:1782757687.295949:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757687.295957:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.295965:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757687.295969:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.295978:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757687.295985:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757687.295991:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757687.296029:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.296035:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757687.296058:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.296065:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d96cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757687.296082:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757687.296084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757687.296085:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757687.296108:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211480448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757687.296164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757687.299575:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480448 00000100:00100000:3.0:1782757687.299589:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480448 00010000:00010000:3.0:1782757687.299640:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 1855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757687.299693:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1782757687.299704:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211480448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757687.299719:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757687.299733:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 1855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299747:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 1855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299764:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777d96d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d96cd expref: 19 pid: 5793 timeout: 1855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299781:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299789:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299806:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299850:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299862:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299869:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299876:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757687.299880:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299888:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299904:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d96db lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757687.299915:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757687.299991:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211480448:12345-0@lo:103:ldlm_bl.0 Request processed in 288us (3826us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757687.299998:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1782757687.300040:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211480448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757687.788081:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757688.239306:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757688.239332:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211480576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757688.239400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757688.239532:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480576 00000100:00100000:3.0:1782757688.239541:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480576 00000100:00080000:1.0:1782757688.239655:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757688.239691:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1782757688.239702:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211480576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757688.239739:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757688.239808:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211480576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757688.239819:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1782757688.239937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211480576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757688.812048:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757689.324147:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757689.324156:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757689.324160:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757689.324235:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757689.324248:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757689.324261:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757689.324289:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211480704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757689.324365:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757689.324424:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782757689.324544:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480704 00000100:00100000:1.0:1782757689.324553:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480704 00000100:00100000:1.0:1782757689.324605:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1782757689.324614:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211480704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757689.324633:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757689.324646:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d96e2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757689.324669:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d96e2 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757689.324680:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d96e2 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757689.324689:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782757689.324741:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211480704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757689.324747:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1782757689.324871:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211480704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757689.324885:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757689.324894:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757689.324912:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757689.324917:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757689.324925:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757689.535926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757689.536084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757689.536122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757689.536155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757689.536190:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196623488 00000100:00100000:1.0:1782757689.536203:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196623488 00000100:00100000:1.0:1782757689.536269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00100000:1.0:1782757689.536279:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196623488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757689.537082:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196623872 00000100:00100000:2.0:1782757689.537087:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196623872 00000100:00100000:2.0:1782757689.537122:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196623744 00000100:00100000:2.0:1782757689.537125:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196623744 00000100:00100000:2.0:1782757689.537152:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 889 00000100:00100000:2.0:1782757689.537160:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757689.537198:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757689.537205:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 889 00000100:00100000:2.0:1782757689.537220:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 890 00000100:00100000:2.0:1782757689.537226:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757689.537253:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196623744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757689.537260:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 890 00000100:00100000:1.0:1782757689.538067:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196623488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1782us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757689.538080:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00080000:1.0:1782757689.538138:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757689.538144:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757689.538147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757689.837263:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757690.290167:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480832 00000100:00100000:1.0:1782757690.290178:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480832 00000100:00100000:1.0:1782757690.290239:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1782757690.290249:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211480832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293132:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211481216:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.293265:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757690.293271:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211481344:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.293344:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211480960:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.293389:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211481472:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.293430:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757690.293437:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211481088:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.293496:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481216 00000100:00100000:2.0:1782757690.293504:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481216 00000100:00100000:2.0:1782757690.293571:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481472 00000100:00100000:2.0:1782757690.293574:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481472 00000100:00100000:2.0:1782757690.293598:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1782757690.293610:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211481216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.293673:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211481216:12345-0@lo:400:kworker.0 Request processed in 65us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757690.293681:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1782757690.293713:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1782757690.293720:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211481472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.293869:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481344 00000100:00100000:3.0:1782757690.293875:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481344 00000100:00100000:3.0:1782757690.293909:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211480960 00000100:00100000:3.0:1782757690.293912:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211480960 00000100:00100000:3.0:1782757690.293929:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481088 00000100:00100000:3.0:1782757690.293932:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481088 00000100:00100000:3.0:1782757690.293948:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1782757690.293955:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211481344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.294317:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211481344:12345-0@lo:400:kworker.0 Request processed in 361us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757690.294326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1782757690.294342:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1782757690.294348:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211480960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.294389:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211480960:12345-0@lo:400:kworker.0 Request processed in 41us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757690.294396:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1782757690.294408:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1782757690.294413:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211481088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.294441:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211481088:12345-0@lo:400:kworker.0 Request processed in 28us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757690.294447:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1782757690.294503:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211481088:0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.294516:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211480960:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.299350:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211481472:12345-0@lo:400:kworker.0 Request processed in 5616us (5923us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757690.299370:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1782757690.299484:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211481344:0@lo:400:kworker.0 00000100:00100000:2.0:1782757690.299501:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211481216:0@lo:400:kworker.0 00000100:00100000:3.0:1782757690.301361:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211481472:0@lo:400:kworker.0 00000100:00100000:1.0:1782757690.302746:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211480832:12345-0@lo:400:kworker.0 Request processed in 12490us (13269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757690.302773:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:1.0:1782757690.302995:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757690.303003:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757690.303006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757690.802325:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211481600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757690.802437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757690.802532:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481600 00000100:00100000:2.0:1782757690.802542:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481600 00000100:00100000:2.0:1782757690.802609:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1782757690.802621:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211481600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757690.802673:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757690.802732:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211481600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757690.802752:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1782757690.802819:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211481600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757690.860426:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757691.892959:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757692.015225:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196624000 00000100:00100000:3.0:1782757692.015240:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196624000 00000100:00100000:3.0:1782757692.015348:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 593 00000100:00100000:3.0:1782757692.015360:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:41958:x1869355196624000:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757692.015386:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757692.015415:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.015498:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.015516:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.015537:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.016032:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782757692.016139:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757692.016228:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.016260:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d96f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646c4 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.016281:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646c4 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.016291:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782757692.016294:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757692.016298:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782757692.016439:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41958:x1869355196624000:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1081us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757692.016448:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 593 00000100:00080000:1.0:1782757692.016986:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757692.026186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757692.026240:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196624128 00000100:00100000:3.0:1782757692.026253:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196624128 00000100:00100000:3.0:1782757692.026324:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:3.0:1782757692.026337:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:41958:x1869355196624128:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757692.026364:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757692.026392:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646cb expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026476:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026495:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026508:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026523:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026530:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.026536:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.030854:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.030880:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.030896:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.031030:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:3.0:1782757692.031050:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757692.031140:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031161:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031169:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031177:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031183:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.031188:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031196:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031211:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782757692.031214:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757692.031220:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031227:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031242:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031249:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031255:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031261:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.031264:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031270:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031279:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917191f75400) 00010000:00010000:3.0:1782757692.031281:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757692.031285:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031290:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d970c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031338:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d96fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646cb expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031367:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646cb expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.031375:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782757692.031378:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757692.031381:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757692.031487:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41958:x1869355196624128:12345-192.168.204.31@tcp:101:rm.0 Request processed in 5146us (5310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757692.031499:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:2.0:1782757692.042278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757692.042609:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196624384 00000100:00100000:3.0:1782757692.042623:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196624384 00000100:00100000:3.0:1782757692.044892:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:3.0:1782757692.044914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41958:x1869355196624384:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757692.044944:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757692.044975:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d971a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646d2 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.049489:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:2.0:1782757692.055235:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d971a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646d2 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757692.055266:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75b00) 00010000:00010000:2.0:1782757692.055270:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782757692.055276:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d971a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646d2 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757692.055292:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:2.0:1782757692.055387:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41958:x1869355196624384:12345-192.168.204.31@tcp:101:rm.0 Request processed in 10479us (13127us total) trans 4294967526 rc 301/301 00000100:00100000:2.0:1782757692.055406:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:2.0:1782757692.061973:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757692.079017:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41958:x1869355196624512:12345-192.168.204.31@tcp:37:rm.0 Request processed in 15532us (17041us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757692.079039:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:2.0:1782757692.087208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757692.087404:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196624768 00000100:00100000:1.0:1782757692.087419:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196624768 00000100:00100000:1.0:1782757692.087497:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:1.0:1782757692.087509:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41958:x1869355196624768:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:1.0:1782757692.088203:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41958:x1869355196624768:12345-192.168.204.31@tcp:35:rm.0 Request processed in 692us (1013us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1782757692.088214:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:3.0:1782757692.095223:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196625024 00000100:00100000:3.0:1782757692.095233:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196625024 00000100:00100000:3.0:1782757692.095633:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 596 00000100:00100000:3.0:1782757692.095648:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41958:x1869355196625024:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782757692.095731:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757692.095775:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646cb expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095797:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782757692.095816:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d96f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646c4 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095887:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782757692.095894:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757692.095920:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095933:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095943:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095956:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095963:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.095969:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.096382:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.096391:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.096398:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.097469:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:3.0:1782757692.097492:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097502:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097509:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097516:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.097521:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097533:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097545:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782757692.097548:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757692.097552:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097558:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9736 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097583:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097590:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097595:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097600:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.097602:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097608:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097615:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757692.097617:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757692.097620:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.097630:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9728 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757692.097641:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b0c8c0f reply state 00000000b0dffd52 transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757692.097652:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782757692.097775:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41958:x1869355196625024:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2127us (2763us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1782757692.097785:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 596 00010000:00010000:3.0:1782757692.111849:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111875:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111883:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111889:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.111894:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111901:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111917:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917191f75800) 00010000:00010000:3.0:1782757692.111919:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757692.111923:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.111933:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d972f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757692.156441:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196625152 00000100:00100000:3.0:1782757692.156459:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196625152 00000100:00100000:3.0:1782757692.156530:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 597 00000100:00100000:3.0:1782757692.156540:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:41962:x1869355196625152:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:3.0:1782757692.156577:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757692.156602:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d973d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646d9 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156682:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156696:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156708:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.156791:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782757692.156796:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757692.156872:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156902:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d973d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646d9 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156922:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646d9 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.156932:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757692.156936:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757692.156939:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782757692.157007:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41962:x1869355196625152:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 468us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757692.157014:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 597 00000100:00100000:1.0:1782757692.169075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757692.169189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757692.170877:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 599 00000100:00100000:3.0:1782757692.170893:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2363:x1869355196625280:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:3.0:1782757692.170940:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782757692.171061:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2363:x1869355196625280:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 171us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757692.171070:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 599 00010000:00010000:3.0:1782757692.178528:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178553:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178561:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178569:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757692.178575:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178584:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178612:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff91718bcfd000) 00010000:00010000:3.0:1782757692.178616:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757692.178621:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.178628:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9752 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757692.237076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757692.239247:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196625664 00000100:00100000:3.0:1782757692.239281:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196625664 00000100:00100000:3.0:1782757692.240402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 600 00000100:00100000:3.0:1782757692.240421:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:41966:x1869355196625664:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782757692.240454:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757692.240483:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240563:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240580:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240594:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757692.240689:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782757692.240694:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757692.240737:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240773:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646e0 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240797:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646e0 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757692.240807:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757692.240810:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757692.240815:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782757692.240962:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:41966:x1869355196625664:12345-192.168.204.31@tcp:101:chown.0 Request processed in 547us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757692.249639:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 600 00000100:00100000:1.0:1782757692.249892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757692.260900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:1.0:1782757692.399589:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000004:00010000:3.0:1782757692.400432:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000986639b8 reply state 000000009dcb2c04 transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9783 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757692.400456:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757692.401056:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:3.0:1782757692.401197:0:5803:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782757692.401222:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:41966:x1869355196626048:12345-192.168.204.31@tcp:36:chown.0 Request processed in 140065us (140331us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1782757692.401235:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 602 00010000:00010000:1.0:1782757692.910802:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757693.356452:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211481728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757693.356522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757693.356965:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211481728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757693.357026:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1782757693.626473:0:71827:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc87f5bdb0 20000000:00000080:3.0:1782757693.626492:0:71827:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b71000 uarg=0000000000000000 00010000:00010000:3.0:1782757693.627788:0:71827:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782757693.629500:0:71827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757693.629509:0:71827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757693.629524:0:71827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9760 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646e0 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.629736:0:71827:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782757693.629771:0:71827:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757693.629788:0:71827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.629800:0:71827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d96e2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.629807:0:71827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.629872:0:71827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d96e2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.630286:0:71827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777d96e9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d96e2 expref: 18 pid: 5794 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757693.630304:0:71827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71827:1869355211481856:0@lo:104: 00000100:00100000:2.0:1782757693.630370:0:71827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757693.630559:0:71827:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782757693.630646:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211481856 00000100:00100000:1.0:1782757693.630655:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211481856 00000100:00100000:1.0:1782757693.630816:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782757693.630980:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:71827:x1869355211481856:12345-0@lo:104: 00010000:00010000:1.0:1782757693.631138:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757693.631579:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757693.631587:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:71827:x1869355211481856:12345-0@lo:104: Request processed in 763us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757693.631595:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:3.0:1782757693.631668:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757693.631676:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757693.631693:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782757693.631696:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757693.631705:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782757693.631712:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757693.631718:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782757693.631761:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757693.631767:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782757693.631794:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757693.631800:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777d96e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d96e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757693.631816:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757693.631818:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757693.631842:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757693.631851:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757693.631863:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211481984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757693.632130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757693.632568:0:71827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71827:1869355211481856:0@lo:104: 00010000:00010000:2.0:1782757693.632591:0:71827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757693.633584:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211481984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757693.633651:0:71827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.633671:0:71827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.633678:0:71827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777d978a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757693.936179:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757694.644370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757694.644417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757694.644453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757694.644481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757694.644507:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196626176 00000100:00100000:1.0:1782757694.644513:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196626176 00000100:00100000:1.0:1782757694.644556:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:1.0:1782757694.644567:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196626176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757694.644635:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196626176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757694.644643:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:1.0:1782757694.644697:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 894 00000100:00100000:1.0:1782757694.644705:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196626432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757694.644807:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196626304 00000100:00100000:3.0:1782757694.644811:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196626304 00000100:00100000:3.0:1782757694.644859:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:3.0:1782757694.644866:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196626304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757694.648903:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196626432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4193us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757694.648914:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 894 00000100:00100000:3.0:1782757694.649626:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196626304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4755us (5260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757694.649637:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1218 10000000:01000000:1.0:1782757694.703748:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757694.703757:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757694.703762:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757694.703807:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757694.703842:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757694.703855:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757694.703881:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211482112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757694.703948:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757694.704003:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782757694.704964:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211482112 00000100:00100000:2.0:1782757694.704974:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211482112 00000100:00100000:2.0:1782757694.705034:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1782757694.705043:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211482112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757694.705058:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757694.705082:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9798 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757694.705107:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757694.705119:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757694.705127:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782757694.705204:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211482112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757694.705648:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1782757695.411918:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211482496:0@lo:400:kworker.0 00000100:00100000:1.0:1782757695.411948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757695.411986:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757695.411992:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211482624:0@lo:400:kworker.0 00000100:00100000:1.0:1782757695.412014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757695.412051:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211482624 00000100:00100000:1.0:1782757695.412054:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211482624 00000100:00100000:1.0:1782757695.412086:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1782757695.412092:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757695.412126:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211482624:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757695.412132:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00080000:1.0:1782757695.412148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757695.412164:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211482624:0@lo:400:kworker.0 00000100:00080000:1.0:1782757695.415486:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757695.415523:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211482496:0@lo:400:kworker.0 00010000:00010000:3.0:1782757695.982230:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757697.010175:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757698.030539:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757698.030633:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196626688 00000100:00100000:2.0:1782757698.030643:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196626688 00000100:00100000:2.0:1782757698.030717:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:2.0:1782757698.030728:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196626688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757698.030743:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757698.030746:0:7497:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9760) 00010000:00010000:2.0:1782757698.030748:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757698.030797:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196626688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 72us (269us total) trans 0 rc 116/116 00000100:00100000:2.0:1782757698.030805:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00080000:1.0:1782757698.030916:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757698.031572:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757698.476364:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757698.476470:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211483008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757698.476543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782757698.478341:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757698.478502:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211483008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757699.053000:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757699.768585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757699.768642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757699.768675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757699.768704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757699.768741:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627072 00000100:00100000:2.0:1782757699.768754:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627072 00000100:00100000:2.0:1782757699.768851:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627200 00000100:00100000:2.0:1782757699.768854:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627200 00000100:00100000:2.0:1782757699.768880:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 897 00000100:00100000:2.0:1782757699.768902:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196627072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757699.768995:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196627072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757699.769007:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 897 00000100:00100000:2.0:1782757699.769024:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 898 00000100:00100000:2.0:1782757699.769029:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196627200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757699.769049:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196627200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757699.769056:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 898 00000100:00100000:2.0:1782757699.769072:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196626944 00000100:00100000:2.0:1782757699.769075:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196626944 00000100:00100000:2.0:1782757699.769102:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00100000:2.0:1782757699.769108:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196626944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757699.769138:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196626944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757699.769144:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00080000:2.0:1782757699.769165:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757699.769170:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757699.769667:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196626816 00000100:00100000:3.0:1782757699.769674:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196626816 00000100:00100000:3.0:1782757699.769717:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000100:00100000:3.0:1782757699.769724:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196626816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757699.769754:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196626816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757699.769761:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000020:00000080:3.0:1782757700.000071:0:72121:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb7748e60 20000000:00000080:3.0:1782757700.000093:0:72121:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca1c00 uarg=0000000000000000 00010000:00010000:3.0:1782757700.001928:0:72121:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757700.001953:0:72121:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757700.001970:0:72121:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757700.002068:0:72121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.002091:0:72121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.002101:0:72121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.002149:0:72121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.002165:0:72121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 18 pid: 5793 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757700.002184:0:72121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72121:1869355211483136:0@lo:104: 00000100:00100000:3.0:1782757700.002334:0:72121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757700.002411:0:72121:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181359540 going to sleep for 11 seconds 00010000:00010000:2.0:1782757700.003431:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757700.003449:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003460:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757700.003466:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003477:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757700.003491:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757700.003498:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782757700.003508:0:72121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72121:1869355211483136:0@lo:104: 00010000:00010000:3.0:1782757700.003549:0:72121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003609:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003617:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757700.003655:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003663:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777d9798 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d979f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757700.003684:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757700.003687:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757700.003688:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757700.003697:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757700.003712:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211483264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757700.003759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757700.004125:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211483264 00000100:00100000:3.0:1782757700.004131:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211483264 00010000:00010000:3.0:1782757700.004159:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757700.004323:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1782757700.004334:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211483264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757700.004350:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757700.004356:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004370:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004385:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777d979f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9798 expref: 19 pid: 5793 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004402:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004411:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004429:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004437:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004444:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004451:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004456:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757700.004461:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004468:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004495:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777d97a6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757700.004505:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757700.004577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211483264:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757700.004585:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1782757700.004616:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211483264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757700.076178:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757700.524270:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211483520:0@lo:400:kworker.0 00000100:00100000:3.0:1782757700.524348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211483392:0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.524380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757700.524421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757700.524910:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757700.524918:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211483904:0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.524946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757700.524971:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211483776:0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.524996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757700.525021:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211483904 00000100:00100000:1.0:1782757700.525025:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211483904 00000100:00100000:1.0:1782757700.525062:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1782757700.525069:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211483904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.525105:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211483904:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757700.525111:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1782757700.525360:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211483520 00000100:00100000:1.0:1782757700.525365:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211483520 00000100:00100000:1.0:1782757700.525395:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211483392 00000100:00100000:1.0:1782757700.525398:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211483392 00000100:00100000:1.0:1782757700.525416:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211483776 00000100:00100000:1.0:1782757700.525418:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211483776 00000100:00100000:1.0:1782757700.525434:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1782757700.525440:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211483520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.525476:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211483520:12345-0@lo:400:kworker.0 Request processed in 36us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757700.525492:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1782757700.525507:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1782757700.525513:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.525541:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211483392:12345-0@lo:400:kworker.0 Request processed in 29us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757700.525547:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1782757700.525570:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1782757700.525576:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211483776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.525609:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211483776:12345-0@lo:400:kworker.0 Request processed in 33us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757700.525616:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00080000:1.0:1782757700.525645:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757700.525649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757700.525855:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211483904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757700.525872:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211483520:0@lo:400:kworker.0 00000100:00100000:3.0:1782757700.528459:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211483392:0@lo:400:kworker.0 00000100:00100000:1.0:1782757700.529305:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211483776:0@lo:400:kworker.0 00010000:00010000:1.0:1782757701.105622:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757701.550526:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484160 00000100:00100000:1.0:1782757701.550547:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484160 00000100:00100000:1.0:1782757701.550615:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1782757701.550626:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211484160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757701.550644:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757701.550661:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d97ad expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757701.550695:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757701.550708:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757701.550718:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782757701.550774:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211484160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757701.550782:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00010000:00010000:2.0:1782757702.131736:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757703.596157:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757703.596178:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757703.596246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757703.596310:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484288 00000100:00100000:1.0:1782757703.596319:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484288 00000100:00100000:1.0:1782757703.596373:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1782757703.596382:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211484288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757703.598279:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757703.598368:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1983us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757703.598377:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1782757703.598752:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211484288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757703.599191:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757704.011203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757704.011523:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627328 00000100:00100000:2.0:1782757704.011536:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627328 00000100:00100000:2.0:1782757704.011622:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 603 00000100:00100000:2.0:1782757704.011634:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42143:x1869355196627328:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782757704.011656:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757704.011684:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d97bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646ee expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.011775:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.011790:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782757704.012015:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757704.012115:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757704.012343:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782757704.012347:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757704.012701:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.012927:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d97bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646ee expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.012953:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646ee expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.012962:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782757704.012965:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757704.012968:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782757704.013102:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42143:x1869355196627328:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1469us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757704.013115:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 603 00000100:00100000:1.0:1782757704.017637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757704.018215:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627456 00000100:00100000:2.0:1782757704.018225:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627456 00000100:00100000:2.0:1782757704.018325:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 604 00000100:00100000:2.0:1782757704.018336:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42143:x1869355196627456:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782757704.018360:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757704.018382:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d97c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646f5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018452:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018468:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018480:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018508:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018515:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018522:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018969:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018984:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.018992:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757704.019090:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1782757704.019094:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757704.019172:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019188:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019195:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019201:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019207:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757704.019212:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019219:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019232:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782757704.019236:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757704.019241:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019251:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d97d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019266:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019272:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019278:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019283:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757704.019285:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019291:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019297:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1c00) 00010000:00010000:2.0:1782757704.019299:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757704.019301:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019306:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d97d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019340:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777d97c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646f5 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019353:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646f5 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.019361:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782757704.019363:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757704.019366:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782757704.021013:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42143:x1869355196627456:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1096us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757704.021036:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 604 00000100:00100000:3.0:1782757704.023717:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627712 00000100:00100000:3.0:1782757704.023727:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627712 00000100:00100000:3.0:1782757704.023794:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 605 00000100:00100000:3.0:1782757704.023818:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42143:x1869355196627712:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757704.023909:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757704.023937:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d97de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646f5 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757704.023957:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:3.0:1782757704.023969:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757704.023997:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757704.024011:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757704.024026:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782757704.085044:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967531 is committed 00010000:00010000:0.0:1782757704.085797:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.085864:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.085888:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75500) 00010000:00010000:0.0:1782757704.085892:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757704.085898:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.085905:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d97e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.172334:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757704.822246:0:72318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd61f55390 20000000:00000080:1.0:1782757704.822275:0:72318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708270b000 uarg=0000000000000000 00010000:00010000:1.0:1782757704.823288:0:72318:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782757704.823335:0:72318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:1.0:1782757704.823340:0:72318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757704.823354:0:72318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d97c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646ee expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.823381:0:72318:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782757704.823397:0:72318:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757704.823412:0:72318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.823427:0:72318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.823437:0:72318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.823493:0:72318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.823511:0:72318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 18 pid: 5794 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757704.823528:0:72318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72318:1869355211484416:0@lo:104: 00000100:00100000:1.0:1782757704.823606:0:72318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757704.823731:0:72318:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782757704.823842:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484416 00000100:00100000:2.0:1782757704.823852:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484416 00000100:00100000:2.0:1782757704.823920:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1782757704.823931:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72318:x1869355211484416:12345-0@lo:104: 00010000:00010000:2.0:1782757704.823946:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757704.824033:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757704.824040:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72318:x1869355211484416:12345-0@lo:104: Request processed in 112us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757704.824048:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782757704.824179:0:72318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72318:1869355211484416:0@lo:104: 00010000:00010000:1.0:1782757704.824202:0:72318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824220:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757704.824229:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824237:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757704.824243:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824252:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757704.824259:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757704.824266:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757704.824302:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824309:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757704.824338:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824345:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d97ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824363:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757704.824364:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757704.824366:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757704.824373:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757704.824384:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211484544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757704.824418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757704.824456:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484544 00000100:00100000:0.0:1782757704.824460:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484544 00010000:00010000:0.0:1782757704.824502:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757704.824531:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1782757704.824539:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211484544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757704.824552:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757704.824557:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824568:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824581:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777d97b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d97ad expref: 19 pid: 5794 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824593:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824603:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824617:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824624:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824632:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824639:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824644:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757704.824649:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824656:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824673:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757704.824682:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757704.824761:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211484544:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757704.824768:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:1.0:1782757704.825092:0:72318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.825101:0:72318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757704.825107:0:72318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777d97ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757704.825641:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211484544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757704.897310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757704.897356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757704.897386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757704.897411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757704.897445:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627840 00000100:00100000:3.0:1782757704.897458:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627840 00000100:00100000:3.0:1782757704.897531:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1032 00000100:00100000:3.0:1782757704.897544:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196627840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757704.897637:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196627840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757704.897646:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1032 00000100:00100000:3.0:1782757704.897686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628096 00000100:00100000:3.0:1782757704.897690:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628096 00000100:00100000:3.0:1782757704.897729:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628224 00000100:00100000:3.0:1782757704.897733:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628224 00000100:00100000:3.0:1782757704.897757:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 322 00000100:00100000:3.0:1782757704.897763:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196628096:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782757704.897789:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9323 00000100:00080000:3.0:1782757704.897800:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081afa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782757704.897876:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:3.0:1782757704.898201:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196628096:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 437us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757704.898209:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 322 00000100:00100000:3.0:1782757704.898224:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 323 00000100:00100000:3.0:1782757704.898231:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196628224:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782757704.898244:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9625 00000100:00080000:3.0:1782757704.898250:0:6597:0:(import.c:65:import_set_state_nolock()) ffff91718547f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782757704.898275:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:3.0:1782757704.898433:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196628224:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 202us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757704.898441:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 323 00000100:00100000:3.0:1782757704.898463:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196627968 00000100:00100000:3.0:1782757704.898481:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196627968 00000100:00100000:3.0:1782757704.898518:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:3.0:1782757704.898525:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196627968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757704.898562:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196627968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757704.898568:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00080000:3.0:1782757704.898731:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757704.898737:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757704.898757:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757704.898765:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757705.196063:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757705.644988:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211484928:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.645067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757705.645081:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211484800:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.645142:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757705.645153:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211485056:0@lo:400:kworker.0 00000100:00100000:3.0:1782757705.645173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757705.645197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757705.645238:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211485312:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.645250:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484928 00000100:00100000:1.0:1782757705.645259:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484928 00000100:00100000:3.0:1782757705.645280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757705.645323:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782757705.645326:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484800 00000100:00100000:1.0:1782757705.645332:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484800 00000100:00100000:3.0:1782757705.645335:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211484672:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.645363:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1782757705.645380:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211484928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757705.645381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757705.645429:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211485184:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.645471:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211484928:12345-0@lo:400:kworker.0 Request processed in 96us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757705.645485:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1782757705.645489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757705.645520:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485184 00000100:00100000:1.0:1782757705.645526:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485184 00000100:00100000:3.0:1782757705.645556:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1782757705.645570:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211484800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757705.645757:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211484800:12345-0@lo:400:kworker.0 Request processed in 190us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757705.645854:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211484800:0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.647027:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1782757705.647048:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211485184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.647237:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211485184:12345-0@lo:400:kworker.0 Request processed in 199us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757705.647246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1782757705.647316:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211484928:0@lo:400:kworker.0 00000100:00100000:2.0:1782757705.648446:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211485184:0@lo:400:kworker.0 00000100:00100000:2.0:1782757705.648576:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485056 00000100:00100000:2.0:1782757705.648582:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485056 00000100:00100000:2.0:1782757705.648662:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485312 00000100:00100000:2.0:1782757705.648666:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485312 00000100:00100000:3.0:1782757705.650761:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1782757705.651546:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211484672 00000100:00100000:3.0:1782757705.651560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211484672 00000100:00100000:3.0:1782757705.652017:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1782757705.652031:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211484672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757705.652194:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211484672:12345-0@lo:400:kworker.0 Request processed in 165us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757705.652202:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1782757705.653537:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1782757705.653564:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211485056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.653665:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211485056:12345-0@lo:400:kworker.0 Request processed in 113us (8470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757705.653672:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1782757705.653714:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1782757705.653722:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211485312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757705.653756:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211485312:12345-0@lo:400:kworker.0 Request processed in 36us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757705.653761:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1782757705.653837:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211485056:0@lo:400:kworker.0 00000100:00080000:2.0:1782757705.655977:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757705.655986:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757705.655989:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757705.657001:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211484672:0@lo:400:kworker.0 00000100:00100000:3.0:1782757705.657032:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211485312:0@lo:400:kworker.0 00000100:00100000:1.0:1782757706.156403:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211485440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757706.156544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757706.156918:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485440 00000100:00100000:0.0:1782757706.156929:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485440 00000100:00100000:0.0:1782757706.156995:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1782757706.157006:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211485440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757706.157233:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757706.157311:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211485440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757706.157319:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1782757706.157689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211485440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757706.221243:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782757706.731975:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757706.731988:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757706.731995:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757706.732073:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757706.732088:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757706.732104:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757706.732162:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211485568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757706.732335:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757706.732457:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782757706.735784:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485568 00000100:00100000:3.0:1782757706.735799:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485568 00000100:00100000:3.0:1782757706.735941:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1782757706.735953:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211485568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757706.735970:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757706.736003:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d97f3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757706.736032:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757706.736044:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757706.736055:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757706.736136:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211485568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757706.736143:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1782757706.738952:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211485568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757706.738997:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757706.739012:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757706.739064:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782757706.739072:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757706.739079:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757707.246272:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757708.276586:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782757708.318318:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782757708.318330:0:7507:0:(genops.c:906:class_export_put()) final put ffff91718809a800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782757708.318385:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff91718809a800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:1.0:1782757708.318461:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91718547f000 for lustre-OST0001 00000001:00100000:0.0:1782757708.358355:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782757708.358370:0:6622:0:(genops.c:906:class_export_put()) final put ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782757708.360064:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:1.0:1782757708.368625:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081afa800 for lustre-OST0000 00000100:00100000:3.0:1782757708.730915:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211485696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757708.731049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757708.731193:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485696 00000100:00100000:3.0:1782757708.731203:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485696 00000100:00100000:3.0:1782757708.731281:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1782757708.731293:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211485696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757708.731342:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757708.731403:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211485696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757708.731411:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00080000:3.0:1782757708.731436:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757708.731476:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211485696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757709.116535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757709.117080:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628352 00000100:00100000:1.0:1782757709.117094:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628352 00000100:00100000:1.0:1782757709.117185:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 606 00000100:00100000:1.0:1782757709.117198:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42220:x1869355196628352:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782757709.117226:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757709.117257:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf646fc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117343:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117360:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117374:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117400:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117408:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117417:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117935:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117945:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.117954:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757709.118041:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757709.118046:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757709.118131:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118148:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118154:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118161:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118167:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757709.118172:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118179:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118194:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757709.118197:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757709.118203:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118209:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118225:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118232:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118239:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118244:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757709.118247:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118253:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118262:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9171a0e3a200) 00010000:00010000:1.0:1782757709.118264:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757709.118267:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118273:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d980f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118307:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646fc expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118323:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646fc expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.118336:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757709.118339:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757709.118342:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782757709.118443:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42220:x1869355196628352:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1247us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757709.118452:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 606 00000100:00080000:3.0:1782757709.119750:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757709.124124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757709.124210:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628608 00000100:00100000:1.0:1782757709.124222:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628608 00000100:00100000:1.0:1782757709.124291:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 607 00000100:00100000:1.0:1782757709.124301:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42220:x1869355196628608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782757709.124328:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757709.124354:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d981d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64703 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125907:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125931:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125945:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125960:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125968:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.125976:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782757709.133348:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:1.0:1782757709.133755:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.133779:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.133795:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138019:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138033:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138043:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138051:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757709.138056:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138065:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138088:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757709.138092:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757709.138099:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138107:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757709.138121:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014d11ab8 reply state 000000004b27130d transno 4294967532 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757709.138134:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782757709.138196:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d981d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64703 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138214:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64703 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.138222:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782757709.138225:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757709.138228:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757709.138323:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42220:x1869355196628608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 14022us (14214us total) trans 4294967532 rc 0/0 00000100:00100000:1.0:1782757709.138333:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 607 00010000:00010000:3.0:1782757709.150510:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150532:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150552:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150560:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757709.150567:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150575:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150607:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9171a0e3ac00) 00010000:00010000:3.0:1782757709.150610:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757709.150616:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.150623:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d982b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757709.152242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757709.152708:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628864 00000100:00100000:2.0:1782757709.152725:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628864 00000100:00100000:2.0:1782757709.152813:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 608 00000100:00100000:2.0:1782757709.153161:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:42220:x1869355196628864:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782757709.153248:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757709.153291:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64703 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.153311:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782757709.153323:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757709.153528:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.153545:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.153559:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757709.153896:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003925948f reply state 000000005f6aa6cc transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757709.153909:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757709.154405:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42220:x1869355196628864:12345-192.168.204.31@tcp:36:touch.0 Request processed in 1579us (2171us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1782757709.154416:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 608 00000100:00100000:2.0:1782757709.158425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757709.158505:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196628992 00000100:00100000:1.0:1782757709.158519:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196628992 00000100:00100000:1.0:1782757709.158633:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 609 00000100:00100000:1.0:1782757709.158646:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42220:x1869355196628992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782757709.158681:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757709.158708:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6470a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.158792:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6470a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.158810:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6470a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.158866:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1400) 00010000:00010000:1.0:1782757709.158870:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782757709.158875:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782757709.158949:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:42220:x1869355196628992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 305us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757709.158957:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 609 00010000:00010000:3.0:1782757709.159041:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159052:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159059:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159066:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757709.159071:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159080:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159094:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782757709.159097:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757709.159101:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.159106:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757709.164331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757709.165877:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196629120 00000100:00100000:1.0:1782757709.165894:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196629120 00000100:00100000:1.0:1782757709.165964:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 324 00000100:00100000:1.0:1782757709.165974:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196629120:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:1.0:1782757709.166018:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1777 last 0 00000020:00000080:1.0:1782757709.166057:0:6599:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d984e 00002000:00100000:1.0:1782757709.166072:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff91708297c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782757709.166086:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782757709.168602:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782757709.168663:0:6599:0:(import.c:65:import_set_state_nolock()) ffff91708297e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782757709.168790:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196629120:12345-192.168.204.31@tcp:8:touch.0 Request processed in 2813us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757709.168807:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 324 00000100:00100000:3.0:1782757709.185614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757709.186585:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196629248 00000100:00100000:2.0:1782757709.186601:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196629248 00000100:00100000:2.0:1782757709.186688:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 325 00000100:00100000:2.0:1782757709.186701:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196629248:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:2.0:1782757709.187632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1782757709.275023:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:0.0:1782757709.275063:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00000100:00100000:2.0:1782757709.275136:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196629248:12345-192.168.204.31@tcp:2:touch.0 Request processed in 88430us (89531us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1782757709.275151:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 325 00000100:00100000:0.0:1782757709.282247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757709.282357:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196629504 00000100:00100000:2.0:1782757709.282387:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196629504 00000100:00100000:2.0:1782757709.282471:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1782757709.282484:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42220:x1869355196629504:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:2.0:1782757709.283487:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:42220:x1869355196629504:12345-192.168.204.31@tcp:35:touch.0 Request processed in 1000us (1250us total) trans 4294967534 rc 0/0 00000100:00100000:2.0:1782757709.283499:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00010000:00010000:3.0:1782757709.292859:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757709.293918:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967532 is committed 00000001:00080000:1.0:1782757709.293941:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967533 is committed 00000100:00100000:2.0:1782757709.377270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757709.377537:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196629632 00000100:00100000:1.0:1782757709.377552:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196629632 00000100:00100000:1.0:1782757709.377645:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:1.0:1782757709.377658:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:42224:x1869355196629632:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757709.377695:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757709.377724:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64711 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377814:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377876:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377892:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377915:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377923:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.377930:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379554:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379575:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379587:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757709.379712:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00000004:00200000:1.0:1782757709.379718:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757709.379749:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379762:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379773:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379780:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379788:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379794:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757709.379799:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.379809:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380508:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757709.380515:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757709.380521:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380529:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d985c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380549:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380555:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380561:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380566:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757709.380569:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380577:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380584:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9171a0e3a200) 00010000:00010000:1.0:1782757709.380586:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757709.380589:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.380594:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.381792:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64711 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.382532:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64711 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.382545:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1400) 00010000:00010000:1.0:1782757709.382549:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757709.382553:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782757709.383536:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42224:x1869355196629632:12345-192.168.204.31@tcp:101:rm.0 Request processed in 5875us (6277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757709.383549:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:0.0:1782757709.399757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757709.399959:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196629760 00000100:00100000:3.0:1782757709.399973:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196629760 00000100:00100000:3.0:1782757709.400059:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 326 00000100:00100000:3.0:1782757709.400072:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196629760:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757709.400098:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757709.400130:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64718 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782757709.400169:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x6a42b94c, atime: 0x6a42b94c, ctime: 0x6a42b94c, blocks: 0x1 00010000:00010000:3.0:1782757709.400195:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1777s v=(0 0) 00010000:00010000:3.0:1782757709.400201:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757709.400213:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.400243:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.400259:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782757709.400342:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196629760:12345-192.168.204.31@tcp:101:rm.0 Request processed in 272us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757709.400350:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 326 00000100:00100000:0.0:1782757709.412396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757709.412871:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630016 00000100:00100000:2.0:1782757709.412885:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630016 00000100:00100000:2.0:1782757709.412972:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 611 00000100:00100000:2.0:1782757709.412985:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42224:x1869355196630016:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782757709.413068:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757709.413107:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d986a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64711 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413136:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6470a expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413152:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782757709.413166:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757709.413196:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413213:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413225:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413243:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413250:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413256:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413766:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413777:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.413784:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757709.414938:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:2.0:1782757709.414955:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1777818131808ns, next at 1778818128214ns, rc = 0 00010000:00010000:2.0:1782757709.415038:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415055:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415067:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415076:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415083:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415089:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415120:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757709.415154:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415161:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415168:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415175:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757709.415179:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415188:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415203:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782757709.415206:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757709.415210:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415217:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9886 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415238:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415244:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415250:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415256:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757709.415259:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415266:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415275:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:2.0:1782757709.415278:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757709.415281:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757709.415287:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757709.415303:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b3065b7 reply state 0000000057434127 transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757709.415314:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757709.415439:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42224:x1869355196630016:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2452us (3075us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1782757709.415450:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 611 00010000:00010000:1.0:1782757709.417010:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757709.417024:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.417035:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757709.417039:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.417049:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.417066:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff917182dd1500) 00010000:00010000:1.0:1782757709.417070:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782757709.417074:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.417080:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d988d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757709.417106:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757709.417109:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757709.417111:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757709.425550:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425574:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425583:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425591:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757709.425597:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425606:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425628:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917182dd1300) 00010000:00010000:3.0:1782757709.425632:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757709.425638:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757709.425650:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d987f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757710.013784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757710.013854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757710.013895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757710.013934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630272 00000100:00100000:2.0:1782757710.013947:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630272 00000100:00100000:2.0:1782757710.014023:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:2.0:1782757710.014036:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196630272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757710.014145:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196630272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757710.014153:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:2.0:1782757710.014184:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630400 00000100:00100000:2.0:1782757710.014188:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630400 00000100:00100000:2.0:1782757710.014219:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 903 00000100:00100000:2.0:1782757710.014226:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196630400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757710.014256:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196630400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757710.014263:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 903 00000100:00100000:3.0:1782757710.014716:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630144 00000100:00100000:3.0:1782757710.014723:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630144 00000100:00100000:3.0:1782757710.014764:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1035 00000100:00100000:3.0:1782757710.014774:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196630144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757710.014816:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196630144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757710.014848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1035 00010000:00010000:1.0:1782757710.316343:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757710.767924:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211485824:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768085:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211486336:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768152:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782757710.768159:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211485952:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768201:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211486464:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768270:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211486080:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757710.768325:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211486208:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757710.768402:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485824 00000100:00100000:0.0:1782757710.768412:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485824 00000100:00100000:0.0:1782757710.768469:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1782757710.768479:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211485824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768542:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211485824:12345-0@lo:400:kworker.0 Request processed in 63us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.768550:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1782757710.768605:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486336 00000100:00100000:0.0:1782757710.768609:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486336 00000100:00100000:0.0:1782757710.768651:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211485952 00000100:00100000:0.0:1782757710.768654:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211485952 00000100:00100000:0.0:1782757710.768669:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486080 00000100:00100000:0.0:1782757710.768671:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486080 00000100:00100000:0.0:1782757710.768688:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1782757710.768694:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211486336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768729:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211486336:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.768735:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1782757710.768749:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1782757710.768755:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211485952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768782:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211485952:12345-0@lo:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.768788:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1782757710.768800:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1782757710.768805:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211486080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768865:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211486080:12345-0@lo:400:kworker.0 Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.768872:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1782757710.768895:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486464 00000100:00100000:0.0:1782757710.768899:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486464 00000100:00100000:0.0:1782757710.768926:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486208 00000100:00100000:0.0:1782757710.768929:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486208 00000100:00100000:0.0:1782757710.768949:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1782757710.768955:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.768989:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211486464:12345-0@lo:400:kworker.0 Request processed in 33us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.768995:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1782757710.769190:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1782757710.769197:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211486208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769225:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211486208:12345-0@lo:400:kworker.0 Request processed in 29us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757710.769232:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1782757710.769296:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211486208:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769308:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211486080:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769342:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211485952:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769366:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211486464:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769377:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211485824:0@lo:400:kworker.0 00000100:00100000:0.0:1782757710.769387:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211486336:0@lo:400:kworker.0 00000100:00080000:2.0:1782757710.770866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757710.770877:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757710.770881:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757711.276492:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757711.276598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757711.279977:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486592 00000100:00100000:2.0:1782757711.279998:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486592 00000100:00100000:2.0:1782757711.280096:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1782757711.280108:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211486592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757711.280162:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757711.280267:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211486592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757711.280274:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1782757711.282677:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211486592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757711.352503:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757712.376482:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757712.485800:0:72568:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6b138730 20000000:00000080:3.0:1782757712.486014:0:72568:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca0c00 uarg=0000000000000000 00010000:00010000:3.0:1782757712.488275:0:72568:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782757712.488341:0:72568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:3.0:1782757712.488346:0:72568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757712.488362:0:72568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf646fc expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.488392:0:72568:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782757712.488414:0:72568:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757712.488433:0:72568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.488449:0:72568:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.488463:0:72568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.488516:0:72568:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.488533:0:72568:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 18 pid: 5794 timeout: 1880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757712.488552:0:72568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72568:1869355211486720:0@lo:104: 00000100:00100000:3.0:1782757712.488652:0:72568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757712.489806:0:72568:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916480 going to sleep for 11 seconds 00000100:00100000:0.0:1782757712.497253:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486720 00000100:00100000:0.0:1782757712.497275:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486720 00000100:00100000:2.0:1782757712.497474:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1782757712.497489:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72568:x1869355211486720:12345-0@lo:104: 00010000:00010000:2.0:1782757712.497515:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757712.497657:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757712.497665:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72568:x1869355211486720:12345-0@lo:104: Request processed in 180us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757712.497673:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:1.0:1782757712.497855:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757712.497865:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757712.497874:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757712.497879:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757712.497889:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757712.497898:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757712.497904:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757712.497954:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757712.497960:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757712.497981:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757712.497988:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777d97f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d97fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757712.498009:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757712.498012:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757712.498014:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757712.498620:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211486848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757712.498719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757712.498879:0:72568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72568:1869355211486720:0@lo:104: 00010000:00010000:0.0:1782757712.498904:0:72568:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757712.499073:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486848 00000100:00100000:3.0:1782757712.499080:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486848 00010000:00010000:3.0:1782757712.499114:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 1880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757712.499155:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782757712.499164:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211486848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757712.499178:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757712.499184:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 1880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499196:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 1880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499215:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d97fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d97f3 expref: 19 pid: 5794 timeout: 1880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499236:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499245:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499261:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499267:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499273:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499279:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499285:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757712.499290:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499298:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499329:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757712.499339:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757712.499379:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211486848:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757712.499387:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782757712.499420:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211486848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757712.499498:0:72568:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757712.499506:0:72568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757712.499513:0:72568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9894 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757713.389402:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757713.836407:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1782239581853ns, next at 1783239579481ns, rc = 0 00000100:00100000:2.0:1782757713.836454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757713.836487:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211486976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757713.836557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757713.836716:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211486976 00000100:00100000:1.0:1782757713.836724:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211486976 00000100:00100000:1.0:1782757713.836787:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1782757713.836798:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211486976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757713.836852:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757713.836899:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211486976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757713.836907:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1782757713.836958:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211486976:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757713.837557:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1782757714.221570:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757714.221579:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757714.221584:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757714.221633:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.221644:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.221654:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757714.221680:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211487104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757714.221751:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757714.221841:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26000 going to sleep for 11 seconds 00000100:00100000:2.0:1782757714.221902:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487104 00000100:00100000:2.0:1782757714.221909:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487104 00000100:00100000:2.0:1782757714.221950:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1782757714.221958:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211487104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757714.221971:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757714.221983:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d989b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757714.222006:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757714.222016:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757714.222025:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782757714.222070:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211487104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757714.222077:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1782757714.222231:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211487104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757714.222246:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.222254:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757714.222277:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782757714.222294:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.222302:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782757714.402504:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000001:00080000:2.0:1782757714.402542:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967535 is committed 00000004:00080000:2.0:1782757714.402547:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000100:00100000:2.0:1782757714.402812:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211487232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782757714.403002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757714.403793:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487232 00000100:00100000:0.0:1782757714.403803:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487232 00000100:00100000:0.0:1782757714.403936:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1782757714.403948:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211487232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782757714.403981:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:0.0:1782757714.404007:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.404028:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.404038:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782757714.404042:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757714.404047:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.404074:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.404089:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 5 pid: 9120 timeout: 1882 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757714.404103:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211487360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757714.408859:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193cd9600 going to sleep for 11 seconds 00010000:00010000:1.0:1782757714.413569:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757714.421432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757714.421621:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211487360:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782757714.421652:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757714.422011:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630528 00000100:00100000:3.0:1782757714.422019:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630528 00010000:00010000:3.0:1782757714.422075:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 1882 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782757714.422081:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757714.422128:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:3.0:1782757714.422140:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196630528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782757714.422156:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757714.422164:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 1882 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757714.422177:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 1882 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757714.422201:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777d9871 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64718 expref: 6 pid: 9120 timeout: 1882 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757714.422219:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757714.422224:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757714.422230:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757714.422241:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757714.422268:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757714.422305:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.422316:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.422328:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757714.422337:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757714.422346:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196630528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 206us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757714.422365:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 334 00010000:00010000:0.0:1782757714.422505:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782757714.423312:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211487232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19363us (20307us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782757714.423321:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:1.0:1782757714.423433:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757714.423439:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.423448:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757714.423451:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.423459:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.423470:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.423474:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f63e842/0xdd99f5c4777d98a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757714.423501:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757714.423503:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757714.423504:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757714.424619:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917081dca680/2, rc 0, transno 4294967335 00000100:00100000:3.0:1782757714.424632:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211487232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757715.128134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757715.128167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757715.128371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757715.128409:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630656 00000100:00100000:3.0:1782757715.128419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630656 00000100:00100000:3.0:1782757715.128464:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:3.0:1782757715.128473:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196630656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757715.128544:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196630656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757715.128551:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:3.0:1782757715.128584:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630912 00000100:00100000:3.0:1782757715.128587:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630912 00000100:00100000:3.0:1782757715.128614:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 906 00000100:00100000:3.0:1782757715.128620:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196630912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757715.128648:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196630912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757715.128654:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 906 00000100:00100000:1.0:1782757715.128903:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196630784 00000100:00100000:1.0:1782757715.128908:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196630784 00000100:00100000:1.0:1782757715.128959:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00100000:1.0:1782757715.128968:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196630784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757715.129015:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196630784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757715.129021:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00080000:3.0:1782757715.129176:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782757715.446454:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757715.889246:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211487488:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.889330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.889378:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211488000:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.889461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.889490:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782757715.889495:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211487616:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.889518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.889543:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211488128:0@lo:400:kworker.0 00000100:00100000:3.0:1782757715.890046:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211487872:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.890186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.890228:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211487744:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.890267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.890306:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487488 00000100:00100000:0.0:1782757715.890313:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487488 00000100:00100000:0.0:1782757715.890357:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1782757715.890365:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.890418:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211487488:12345-0@lo:400:kworker.0 Request processed in 53us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.890425:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1782757715.890466:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488000 00000100:00100000:0.0:1782757715.890470:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488000 00000100:00100000:0.0:1782757715.890503:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487616 00000100:00100000:0.0:1782757715.890506:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487616 00000100:00100000:0.0:1782757715.890522:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487744 00000100:00100000:0.0:1782757715.890525:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487744 00000100:00100000:0.0:1782757715.890538:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1782757715.890543:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211488000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891176:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211488000:12345-0@lo:400:kworker.0 Request processed in 631us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.891185:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1782757715.891206:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1782757715.891214:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891248:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211487616:12345-0@lo:400:kworker.0 Request processed in 36us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.891264:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1782757715.891276:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1782757715.891282:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211487744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891325:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211487744:12345-0@lo:400:kworker.0 Request processed in 42us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.891330:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1782757715.891350:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488128 00000100:00100000:0.0:1782757715.891354:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488128 00000100:00100000:0.0:1782757715.891383:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1782757715.891389:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211488128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891423:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211488128:12345-0@lo:400:kworker.0 Request processed in 35us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.891429:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1782757715.891448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757715.891511:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211487616:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891522:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211488128:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891531:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211487488:0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.891540:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211488000:0@lo:400:kworker.0 00000100:00100000:3.0:1782757715.894026:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211487744:0@lo:400:kworker.0 00000100:00080000:0.0:1782757715.897182:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757715.897194:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757715.897229:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211487872 00000100:00100000:0.0:1782757715.897241:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211487872 00000100:00100000:0.0:1782757715.897338:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1782757715.897348:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211487872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757715.897463:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211487872:12345-0@lo:400:kworker.0 Request processed in 116us (6012us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757715.897469:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1782757715.897537:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211487872:0@lo:400:kworker.0 00000100:00080000:3.0:1782757715.898853:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757716.182987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757716.183199:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631040 00000100:00100000:1.0:1782757716.183208:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631040 00000100:00100000:1.0:1782757716.183276:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 612 00000100:00100000:1.0:1782757716.183287:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42312:x1869355196631040:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757716.183307:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757716.183329:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d98b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6471f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183391:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183404:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183417:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757716.183616:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757716.183620:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757716.183707:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183733:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d98b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6471f expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183767:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6471f expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.183775:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757716.183778:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757716.183781:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782757716.183868:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42312:x1869355196631040:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 582us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757716.183875:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 612 00000100:00100000:0.0:1782757716.209735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757716.218910:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631296 00000100:00100000:0.0:1782757716.218923:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631296 00000100:00100000:0.0:1782757716.218983:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 613 00000100:00100000:0.0:1782757716.218993:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42312:x1869355196631296:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757716.219043:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757716.219071:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d98b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6471f expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757716.219085:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9816) 00010000:00010000:0.0:1782757716.219090:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:0.0:1782757716.219102:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757716.219125:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757716.219137:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757716.219146:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782757716.307107:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000004:00010000:1.0:1782757716.307303:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e41d587e reply state 00000000045bf37e transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757716.307317:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757716.307506:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:1.0:1782757716.307627:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782757716.307648:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42312:x1869355196631296:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 88652us (97919us total) trans 4294967536 rc 0/0 00000100:00100000:1.0:1782757716.307656:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 613 00010000:00010000:1.0:1782757716.307700:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307712:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307720:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307726:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757716.307731:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307747:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307764:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:1.0:1782757716.307767:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757716.307772:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757716.307778:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757716.397283:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757716.397363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757716.403949:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488256 00000100:00100000:2.0:1782757716.403966:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488256 00000100:00100000:0.0:1782757716.404256:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1782757716.404268:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211488256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757716.404309:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757716.410141:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211488256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5864us (12768us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757716.410154:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1782757716.416010:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211488256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757716.463491:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782757717.381778:0:72764:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedc07b5f0 20000000:00000080:2.0:1782757717.381802:0:72764:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081255800 uarg=0000000000000000 00010000:00010000:2.0:1782757717.382600:0:72764:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757717.382618:0:72764:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757717.382634:0:72764:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757717.382655:0:72764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.382672:0:72764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.382681:0:72764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.382723:0:72764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.382737:0:72764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 18 pid: 5794 timeout: 1885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757717.382753:0:72764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72764:1869355211488384:0@lo:104: 00000100:00100000:2.0:1782757717.382859:0:72764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757717.382926:0:72764:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237840 going to sleep for 11 seconds 00000100:00100000:3.0:1782757717.383034:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782757717.383050:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488384 00000100:00100000:3.0:1782757717.383058:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488384 00000100:00100000:3.0:1782757717.383112:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782757717.383123:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b30ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72764:x1869355211488384:12345-0@lo:104: 00010000:00010000:3.0:1782757717.383137:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.383215:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757717.383231:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b30ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:72764:x1869355211488384:12345-0@lo:104: Request processed in 101us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757717.383241:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782757717.383242:0:72764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72764:1869355211488384:0@lo:104: 00010000:00010000:2.0:1782757717.383271:0:72764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.383569:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757717.383585:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.383594:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757717.383598:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.383613:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757717.383620:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757717.383625:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757717.383660:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.383667:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782757717.383725:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211488512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757717.383807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757717.383905:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488512 00000100:00100000:3.0:1782757717.383911:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488512 00010000:00010000:3.0:1782757717.383929:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 1885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757717.383958:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1782757717.383965:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211488512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757717.383975:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757717.383981:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 1885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.383992:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 1885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384006:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777d98a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d989b expref: 19 pid: 5794 timeout: 1885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384022:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384030:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384042:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384050:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384056:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384062:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384067:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757717.384072:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384079:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384090:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757717.384100:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757717.384194:0:72764:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.384206:0:72764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757717.384212:0:72764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777d98c5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.386667:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.386684:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777d989b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757717.386710:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757717.386712:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757717.386716:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757717.408093:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211488512:12345-0@lo:103:ldlm_bl.0 Request processed in 24119us (24276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757717.408109:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1782757717.410737:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211488512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757717.484012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757718.508212:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757718.959003:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211488640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757718.959634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757718.959732:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488640 00000100:00100000:2.0:1782757718.959739:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488640 00000100:00100000:2.0:1782757718.959798:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1782757718.959807:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211488640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757718.959996:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757718.960053:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211488640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757718.960060:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1782757718.960663:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211488640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757718.960929:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1782757719.220781:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757719.220790:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757719.220795:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757719.220861:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757719.220875:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757719.220888:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757719.220914:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211488768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757719.220984:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757719.221037:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7540 going to sleep for 11 seconds 00000100:00100000:2.0:1782757719.221861:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488768 00000100:00100000:2.0:1782757719.221871:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488768 00000100:00100000:2.0:1782757719.221921:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1782757719.221931:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211488768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757719.221948:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757719.221963:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d98cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757719.221988:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757719.222004:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757719.222013:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757719.222065:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211488768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757719.222072:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1782757719.226854:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211488768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757719.226885:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757719.226902:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757719.226926:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757719.226931:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757719.226938:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757719.532004:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782757719.544123:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000100:00100000:0.0:1782757720.245293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757720.245336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757720.245368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757720.245398:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631680 00000100:00100000:0.0:1782757720.245409:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631680 00000100:00080000:1.0:1782757720.245447:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757720.245468:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 909 00000100:00100000:0.0:1782757720.245479:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196631680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757720.245536:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631424 00000100:00100000:3.0:1782757720.245540:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631424 00000100:00100000:0.0:1782757720.245563:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196631680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757720.245568:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1041 00000100:00100000:0.0:1782757720.245570:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 909 00000100:00100000:3.0:1782757720.245574:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196631424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757720.245599:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196631424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757720.245601:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631552 00000100:00100000:0.0:1782757720.245604:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631552 00000100:00100000:3.0:1782757720.245606:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1041 00000100:00100000:0.0:1782757720.245634:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00100000:0.0:1782757720.245641:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196631552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757720.245673:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196631552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757720.245679:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00080000:0.0:1782757720.245700:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757720.556892:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757720.644020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757720.644188:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196631808 00000100:00100000:0.0:1782757720.644202:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196631808 00000100:00100000:0.0:1782757720.644273:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 614 00000100:00100000:0.0:1782757720.644284:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42389:x1869355196631808:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782757720.644305:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757720.644386:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d98da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64726 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644465:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644479:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644494:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644510:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644517:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.644524:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645049:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645059:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645066:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757720.645148:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:0.0:1782757720.645152:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757720.645264:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645276:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645282:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645289:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645300:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757720.645304:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645311:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645324:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782757720.645327:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757720.645332:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645338:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d98e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645351:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645356:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645361:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645366:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757720.645368:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645373:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645383:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff91718bcfdb00) 00010000:00010000:0.0:1782757720.645385:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757720.645388:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645392:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645431:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d98da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64726 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645447:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64726 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.645453:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782757720.645456:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782757720.645458:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193146c00, rc 0) 00000100:00100000:0.0:1782757720.645525:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196631808:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1243us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757720.645533:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 614 00000100:00100000:1.0:1782757720.666115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757720.671421:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632064 00000100:00100000:0.0:1782757720.671439:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632064 00000100:00100000:0.0:1782757720.671512:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 615 00000100:00100000:0.0:1782757720.671524:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632064:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782757720.671546:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757720.671571:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d98f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6472d expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.671915:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.671929:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.671954:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.671991:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672000:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672008:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757720.672141:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00010000:0.0:1782757720.672177:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672185:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672192:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672197:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757720.672202:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672214:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672227:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782757720.672230:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757720.672235:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672242:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d98fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672253:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672258:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672264:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672268:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757720.672271:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672276:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672282:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff91718bcfdd00) 00010000:00010000:0.0:1782757720.672285:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757720.672287:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672297:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9904 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672339:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d98f6 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6472d expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672350:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782757720.672352:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757720.672355:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d98f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6472d expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757720.672365:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147600, rc 0) 00000100:00100000:0.0:1782757720.672440:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632064:12345-192.168.204.31@tcp:101:touch.0 Request processed in 918us (6349us total) trans 0 rc 301/301 00000100:00100000:0.0:1782757720.672448:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 615 00000100:00100000:0.0:1782757720.679769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757720.679934:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632192 00000100:00100000:3.0:1782757720.679959:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632192 00000100:00100000:3.0:1782757720.680024:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 616 00000100:00100000:3.0:1782757720.680035:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632192:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757720.680060:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757720.680083:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d990b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64734 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680171:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680186:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680197:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680211:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680217:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680223:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680406:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680414:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680421:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680427:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757720.680432:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680446:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680459:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782757720.680462:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.680467:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680473:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680485:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680490:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680496:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680500:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757720.680503:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680508:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680514:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917191f75700) 00010000:00010000:3.0:1782757720.680516:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.680519:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680527:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680560:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d990b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64734 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680570:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782757720.680572:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.680575:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d990b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64734 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.680596:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757720.680664:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632192:12345-192.168.204.31@tcp:101:touch.0 Request processed in 631us (907us total) trans 0 rc 301/301 00000100:00100000:3.0:1782757720.680671:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 616 00000100:00100000:0.0:1782757720.682913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757720.683046:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632320 00000100:00100000:3.0:1782757720.683058:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632320 00000100:00100000:3.0:1782757720.683121:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 617 00000100:00100000:3.0:1782757720.683132:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632320:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757720.683152:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757720.683183:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6473b expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683251:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683264:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683277:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683291:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683298:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683305:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683510:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683518:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683525:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683530:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757720.683534:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683541:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683553:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782757720.683556:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.683560:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683567:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683580:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683599:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683604:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683609:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757720.683612:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683618:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683625:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917191f75b00) 00010000:00010000:3.0:1782757720.683628:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.683631:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683636:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d992e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683671:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9920 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6473b expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683685:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782757720.683688:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757720.683691:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6473b expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757720.683698:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782757720.683766:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42389:x1869355196632320:12345-192.168.204.31@tcp:101:touch.0 Request processed in 636us (862us total) trans 0 rc 301/301 00000100:00100000:3.0:1782757720.683774:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 617 00000100:00100000:2.0:1782757721.005061:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211489024:0@lo:400:kworker.0 00000100:00100000:2.0:1782757721.005146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757721.005208:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211489536:0@lo:400:kworker.0 00000100:00100000:2.0:1782757721.005235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757721.005261:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757721.005268:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211489152:0@lo:400:kworker.0 00000100:00100000:2.0:1782757721.005290:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757721.005330:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489024 00000100:00100000:2.0:1782757721.005339:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489024 00000100:00100000:2.0:1782757721.005387:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489152 00000100:00100000:2.0:1782757721.005390:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489152 00000100:00100000:2.0:1782757721.005422:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1782757721.005431:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211489024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757721.005702:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211488896:0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.005749:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211489280:0@lo:400:kworker.0 00000100:00100000:1.0:1782757721.007367:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489536 00000100:00100000:1.0:1782757721.007377:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489536 00000100:00100000:1.0:1782757721.007434:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1782757721.007442:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211489536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757721.008750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757721.008799:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211489408:0@lo:400:kworker.0 00000100:00100000:3.0:1782757721.008850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757721.008914:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211488896 00000100:00100000:3.0:1782757721.008920:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211488896 00000100:00100000:0.0:1782757721.009113:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489408 00000100:00100000:0.0:1782757721.009118:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489408 00000100:00100000:0.0:1782757721.009255:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1782757721.009265:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211489152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.009327:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211489152:12345-0@lo:400:kworker.0 Request processed in 63us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757721.009333:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1782757721.009352:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1782757721.009359:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211489408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.009391:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211489408:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757721.009397:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:0.0:1782757721.009427:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757721.009432:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757721.009467:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211489408:0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.009515:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211489152:0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.009552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757721.009574:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489280 00000100:00100000:3.0:1782757721.009841:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1782757721.009850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757721.009887:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211488896:12345-0@lo:400:kworker.0 Request processed in 39us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757721.009893:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1782757721.009969:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489280 00000100:00100000:0.0:1782757721.010016:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1782757721.010023:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211489280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.010054:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211489280:12345-0@lo:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757721.010060:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1782757721.010212:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211488896:0@lo:400:kworker.0 00000100:00100000:0.0:1782757721.010240:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:0.0:1782757721.010246:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917081dca680, transno 4294967335 00000100:00100000:0.0:1782757721.010258:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211489280:0@lo:400:kworker.0 00000100:00100000:2.0:1782757721.010640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211489024:12345-0@lo:400:kworker.0 Request processed in 5208us (5493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757721.010650:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1782757721.012172:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211489024:0@lo:400:kworker.0 00000100:00080000:3.0:1782757721.013177:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757721.017598:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211489536:0@lo:400:kworker.0 00000100:00100000:1.0:1782757721.017723:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211489536:12345-0@lo:400:kworker.0 Request processed in 10279us (12484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757721.017737:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:2.0:1782757721.529620:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211489664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757721.529699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757721.530675:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489664 00000100:00100000:1.0:1782757721.530683:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489664 00000100:00100000:1.0:1782757721.530735:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1782757721.530754:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211489664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757721.530793:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757721.530870:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211489664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757721.530876:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1782757721.531353:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211489664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757721.590966:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757722.617010:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757723.036244:0:73009:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc45b65eb0 20000000:00000080:3.0:1782757723.036264:0:73009:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca3000 uarg=0000000000000000 00010000:00010000:3.0:1782757723.038202:0:73009:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782757723.038238:0:73009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782757723.038243:0:73009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757723.038255:0:73009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d98ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64726 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.038289:0:73009:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782757723.038305:0:73009:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757723.038318:0:73009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.038331:0:73009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.038339:0:73009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.038376:0:73009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.038392:0:73009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 18 pid: 5794 timeout: 1891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757723.038409:0:73009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73009:1869355211489792:0@lo:104: 00000100:00100000:3.0:1782757723.038487:0:73009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757723.039005:0:73009:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7db40 going to sleep for 11 seconds 00000100:00100000:2.0:1782757723.039903:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489792 00000100:00100000:2.0:1782757723.039913:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489792 00000100:00100000:3.0:1782757723.040333:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782757723.040344:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73009:x1869355211489792:12345-0@lo:104: 00010000:00010000:3.0:1782757723.040363:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.040738:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757723.040746:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73009:x1869355211489792:12345-0@lo:104: Request processed in 404us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757723.040754:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00010000:2.0:1782757723.040878:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757723.040885:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.040894:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757723.040898:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.040906:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757723.040915:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757723.040920:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757723.040954:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.040961:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757723.040985:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.040992:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777d98cc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d98d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041009:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757723.041011:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757723.041013:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757723.041021:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757723.041034:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211489920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757723.041071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757723.041133:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211489920 00000100:00100000:2.0:1782757723.041138:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211489920 00010000:00010000:2.0:1782757723.041159:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 19 pid: 5794 timeout: 1891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757723.041182:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782757723.041188:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211489920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757723.041199:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757723.041205:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 19 pid: 5794 timeout: 1891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041215:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 19 pid: 5794 timeout: 1891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041232:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041241:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041256:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041264:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041270:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041282:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041288:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757723.041291:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041299:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041307:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757723.041316:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757723.041343:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211489920:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757723.041351:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782757723.041385:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211489920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757723.052502:0:73009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777d98d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d98cc expref: 18 pid: 5794 timeout: 1891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757723.052526:0:73009:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73009:1869355211489792:0@lo:104: 00010000:00010000:0.0:1782757723.052553:0:73009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.060143:0:73009:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.060161:0:73009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757723.060168:0:73009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9935 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757723.629661:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757724.081584:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757724.081608:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211490048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757724.081681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757724.083484:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490048 00000100:00100000:2.0:1782757724.083496:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490048 00000100:00100000:2.0:1782757724.083586:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1782757724.083597:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211490048:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757724.083601:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782757724.083634:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757724.083716:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211490048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757724.083723:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1782757724.083772:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211490048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782757724.657054:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782757725.037489:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757725.037498:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757725.037505:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757725.049619:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757725.049638:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757725.049649:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757725.049674:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211490176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757725.049754:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757725.049801:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c09906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782757725.054010:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490176 00000100:00100000:3.0:1782757725.055444:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490176 00000100:00100000:3.0:1782757725.055534:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1782757725.055543:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211490176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757725.055559:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757725.055576:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d993c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757725.055602:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757725.055612:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757725.055621:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782757725.057208:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211490176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1656us (7444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757725.057220:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1782757725.065049:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211490176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757725.065096:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757725.065111:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757725.065136:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757725.065142:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757725.065150:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757725.380599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757725.381331:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632576 00000100:00100000:0.0:1782757725.381342:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632576 00000100:00100000:0.0:1782757725.381403:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:0.0:1782757725.381413:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196632576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757725.381486:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196632576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757725.381495:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00080000:0.0:1782757725.381522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757725.382720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757725.382749:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632448 00000100:00100000:3.0:1782757725.382755:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632448 00000100:00100000:3.0:1782757725.382792:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:3.0:1782757725.382800:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196632448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757725.382951:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196632448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 151us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757725.382960:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:0.0:1782757725.386860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757725.386973:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632704 00000100:00100000:3.0:1782757725.386983:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632704 00000100:00100000:3.0:1782757725.387055:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 912 00000100:00100000:3.0:1782757725.387075:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196632704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757725.387254:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196632704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757725.387262:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 912 00000100:00080000:0.0:1782757725.387443:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757725.678049:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757726.125514:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211490432:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.125620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.125689:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211490944:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.125719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.125750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782757726.125756:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211490304:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.125786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.125810:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211490816:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.126300:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211490560:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.126349:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757726.126356:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211490688:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757726.126420:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490432 00000100:00100000:1.0:1782757726.126429:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490432 00000100:00100000:1.0:1782757726.126549:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490816 00000100:00100000:1.0:1782757726.126553:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490816 00000100:00100000:1.0:1782757726.126589:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490560 00000100:00100000:1.0:1782757726.126592:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490560 00000100:00100000:1.0:1782757726.126613:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1782757726.126622:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211490432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126691:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211490432:12345-0@lo:400:kworker.0 Request processed in 68us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.126699:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1782757726.126725:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1782757726.126732:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126761:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211490816:12345-0@lo:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.126768:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1782757726.126780:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1782757726.126785:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.126813:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211490560:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.126819:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1782757726.129144:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490944 00000100:00100000:1.0:1782757726.129155:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490944 00000100:00100000:1.0:1782757726.129219:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490688 00000100:00100000:1.0:1782757726.129223:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490688 00000100:00100000:1.0:1782757726.129263:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1782757726.129274:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.129367:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211490944:12345-0@lo:400:kworker.0 Request processed in 95us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.129375:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1782757726.129390:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1782757726.129396:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.129427:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211490688:12345-0@lo:400:kworker.0 Request processed in 32us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.129432:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1782757726.129453:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211490304 00000100:00100000:1.0:1782757726.129457:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211490304 00000100:00100000:1.0:1782757726.129787:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1782757726.129796:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211490304:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782757726.129894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757726.129900:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757726.129903:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757726.130186:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211490304:12345-0@lo:400:kworker.0 Request processed in 391us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.130194:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1782757726.130264:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211490304:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.130285:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211490816:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.130299:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211490432:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.130312:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211490944:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.130373:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211490688:0@lo:400:kworker.0 00000100:00100000:1.0:1782757726.130391:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211490560:0@lo:400:kworker.0 00000100:00100000:2.0:1782757726.644764:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211491072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757726.644873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757726.644955:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491072 00000100:00100000:2.0:1782757726.644963:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491072 00000100:00100000:2.0:1782757726.645014:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1782757726.645024:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211491072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757726.645078:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757726.645126:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211491072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757726.645133:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1782757726.645183:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211491072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757726.702301:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757726.912994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757726.913138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196632832 00000100:00100000:1.0:1782757726.913148:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196632832 00000100:00100000:1.0:1782757726.913213:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:1.0:1782757726.913223:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42476:x1869355196632832:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757726.913246:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757726.913268:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d994a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64742 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913351:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913366:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913380:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757726.913585:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757726.913590:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757726.913669:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913698:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d994a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64742 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913734:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64742 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757726.913750:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782757726.913753:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757726.913757:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782757726.913812:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42476:x1869355196632832:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 590us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757726.913818:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:2.0:1782757726.932464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757726.932544:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633088 00000100:00100000:0.0:1782757726.932558:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633088 00000100:00100000:0.0:1782757726.932624:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 619 00000100:00100000:0.0:1782757726.932635:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42476:x1869355196633088:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757726.932704:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757726.932753:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64742 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.932771:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d98ef) 00010000:00010000:0.0:1782757726.932776:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:0.0:1782757726.932787:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757726.932816:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.932860:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.932870:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757726.933671:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4e40219 reply state 00000000969b9379 transno 4294967537 ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757726.933691:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757726.934509:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000100:00100000:0.0:1782757726.934668:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42476:x1869355196633088:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 2030us (2647us total) trans 4294967537 rc 0/0 00000100:00100000:0.0:1782757726.934679:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 619 00010000:00010000:0.0:1782757726.944321:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944339:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944347:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944367:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757726.944372:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944379:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944397:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782757726.944402:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757726.944407:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757726.944413:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9958 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757727.729722:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757728.003463:0:73207:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6bfc9720 20000000:00000080:1.0:1782757728.003481:0:73207:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b71800 uarg=0000000000000000 00010000:00010000:1.0:1782757728.004502:0:73207:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757728.004517:0:73207:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757728.004530:0:73207:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757728.004547:0:73207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757728.004565:0:73207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757728.004575:0:73207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757728.004609:0:73207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757728.004622:0:73207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 18 pid: 5794 timeout: 1896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757728.004637:0:73207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73207:1869355211491200:0@lo:104: 00000100:00100000:1.0:1782757728.004786:0:73207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757728.004908:0:73207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c20e900 going to sleep for 11 seconds 00000100:00100000:2.0:1782757728.004999:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491200 00000100:00100000:2.0:1782757728.005006:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491200 00000100:00100000:2.0:1782757728.005065:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782757728.005074:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73207:x1869355211491200:12345-0@lo:104: 00010000:00010000:2.0:1782757728.005087:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005182:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757728.005189:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73207:x1869355211491200:12345-0@lo:104: Request processed in 116us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757728.005197:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00010000:3.0:1782757728.005237:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757728.005243:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757728.005251:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:1.0:1782757728.005253:0:73207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73207:1869355211491200:0@lo:104: 10000000:00010000:3.0:1782757728.005255:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757728.005267:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782757728.005273:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757728.005273:0:73207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757728.005280:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782757728.005314:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757728.005320:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782757728.005340:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211491328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757728.005349:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757728.005356:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777d993c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9943 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757728.005367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782757728.005371:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757728.005373:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757728.005374:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757728.005396:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491328 00000100:00100000:2.0:1782757728.005400:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491328 00010000:00010000:2.0:1782757728.005416:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 1896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757728.005445:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782757728.005451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211491328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757728.005461:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757728.005466:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 1896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005476:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 1896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005487:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777d9943 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d993c expref: 19 pid: 5794 timeout: 1896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005499:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005507:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005519:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005525:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005532:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005538:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005543:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757728.005552:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005558:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005577:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757728.005585:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757728.005619:0:73207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757728.005619:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211491328:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757728.005626:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:3.0:1782757728.005627:0:73207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757728.005633:0:73207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d995f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757728.006411:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211491328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757728.751452:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757729.196150:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757729.196226:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757729.196508:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491456 00000100:00100000:1.0:1782757729.196516:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491456 00000100:00100000:1.0:1782757729.196591:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1782757729.196601:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211491456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757729.196638:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757729.196689:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757729.196696:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1782757729.196795:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211491456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757729.196982:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1782757729.518595:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757729.518603:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757729.518609:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757729.518660:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757729.518673:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757729.518684:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757729.518709:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211491584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757729.518809:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757729.519002:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782757729.525307:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491584 00000100:00100000:3.0:1782757729.525325:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491584 00000100:00100000:3.0:1782757729.525404:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1782757729.525414:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211491584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757729.525436:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757729.525458:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9966 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757729.525491:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757729.525503:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757729.525513:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782757729.525595:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211491584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (6787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757729.525602:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1782757729.526406:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211491584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757729.526431:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757729.526444:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757729.526471:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757729.526477:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757729.526485:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757729.778194:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757730.494478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757730.494514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757730.494546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757730.494583:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633472 00000100:00100000:0.0:1782757730.494592:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633472 00000100:00100000:0.0:1782757730.494657:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 915 00000100:00100000:0.0:1782757730.494669:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196633472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757730.494741:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196633472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757730.494749:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 915 00000100:00080000:0.0:1782757730.494780:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757730.495433:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633216 00000100:00100000:3.0:1782757730.495441:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633216 00000100:00100000:3.0:1782757730.495485:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:3.0:1782757730.495493:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196633216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757730.495541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196633216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757730.495551:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:1.0:1782757730.495836:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633344 00000100:00100000:1.0:1782757730.495842:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633344 00000100:00100000:1.0:1782757730.495890:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:1.0:1782757730.495897:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196633344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757730.495939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196633344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757730.495946:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00080000:3.0:1782757730.498486:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782757730.798705:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757731.084481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757731.086028:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633600 00000100:00100000:2.0:1782757731.086039:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633600 00000100:00100000:2.0:1782757731.086097:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 620 00000100:00100000:2.0:1782757731.086107:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196633600:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757731.086210:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196633600:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 104us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757731.086218:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 620 00000100:00100000:3.0:1782757731.093080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757731.093116:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633728 00000100:00100000:3.0:1782757731.093125:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633728 00000100:00100000:3.0:1782757731.093174:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 328 00000100:00100000:3.0:1782757731.093184:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42561:x1869355196633728:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757731.093559:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42561:x1869355196633728:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 375us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757731.093567:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 328 00000100:00100000:3.0:1782757731.099561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757731.100766:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633856 00000100:00100000:2.0:1782757731.100777:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633856 00000100:00100000:2.0:1782757731.100851:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 329 00000100:00100000:2.0:1782757731.100860:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196633856:12345-192.168.204.31@tcp:8:lfs.0 00010000:00080000:2.0:1782757731.100905:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1799 last 0 00000020:00000080:2.0:1782757731.100936:0:9120:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d9974 00002000:00100000:2.0:1782757731.100950:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917183830800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782757731.100983:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782757731.101221:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782757731.101253:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917183836800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782757731.101504:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196633856:12345-192.168.204.31@tcp:8:lfs.0 Request processed in 643us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757731.101513:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 329 00000100:00100000:3.0:1782757731.111391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.111646:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196633984 00000100:00100000:0.0:1782757731.111657:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196633984 00000100:00100000:0.0:1782757731.111727:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 330 00000100:00100000:0.0:1782757731.111739:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196633984:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757731.112145:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196633984:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 408us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.112154:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 330 00000100:00080000:3.0:1782757731.112508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757731.114541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.114619:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634112 00000100:00100000:0.0:1782757731.114628:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634112 00000100:00100000:0.0:1782757731.114687:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 621 00000100:00100000:0.0:1782757731.114697:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634112:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757731.115149:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634112:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 452us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.115160:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 621 00000100:00100000:3.0:1782757731.124851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757731.125067:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634240 00000100:00100000:1.0:1782757731.125077:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634240 00000100:00100000:1.0:1782757731.125133:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 622 00000100:00100000:1.0:1782757731.125143:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634240:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757731.125235:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634240:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 92us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.125243:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 622 00000100:00100000:3.0:1782757731.127058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.127140:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634368 00000100:00100000:0.0:1782757731.127148:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634368 00000100:00100000:0.0:1782757731.127207:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 331 00000100:00100000:0.0:1782757731.127217:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42561:x1869355196634368:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757731.127577:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42561:x1869355196634368:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 360us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.127585:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 331 00000100:00100000:3.0:1782757731.129771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.129922:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634496 00000100:00100000:0.0:1782757731.129933:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634496 00000100:00100000:0.0:1782757731.130005:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:0.0:1782757731.130016:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634496:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757731.130372:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634496:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 357us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.130380:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:2.0:1782757731.132593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757731.132679:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634624 00000100:00100000:3.0:1782757731.132688:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634624 00000100:00100000:3.0:1782757731.132747:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 623 00000100:00100000:3.0:1782757731.132757:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634624:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757731.133475:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42561:x1869355196634624:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 716us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757731.133485:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 623 00000100:00100000:3.0:1782757731.191905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757731.192112:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196634752 00000100:00100000:2.0:1782757731.192123:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196634752 00000100:00100000:2.0:1782757731.192186:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 624 00000100:00100000:2.0:1782757731.192196:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42565:x1869355196634752:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782757731.192217:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757731.192240:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d997b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64749 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192302:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192315:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192329:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192341:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192348:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192354:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192754:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192762:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192768:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757731.192883:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1782757731.192888:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757731.192972:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192986:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192992:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.192998:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193003:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757731.193008:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193016:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193028:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782757731.193031:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757731.193035:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193041:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193052:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193058:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193064:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193069:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757731.193072:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193078:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193085:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917182dd1f00) 00010000:00010000:2.0:1782757731.193088:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757731.193090:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193096:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193125:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d997b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64749 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193140:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64749 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757731.193147:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782757731.193150:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757731.193152:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782757731.193221:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42565:x1869355196634752:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1026us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757731.193230:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 624 00000100:00100000:1.0:1782757731.201871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.203131:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635008 00000100:00100000:0.0:1782757731.203144:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635008 00000100:00100000:0.0:1782757731.203269:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 625 00000100:00100000:0.0:1782757731.203282:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42565:x1869355196635008:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782757731.203304:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757731.203324:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9997 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64750 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203677:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203696:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203707:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203722:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203729:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.203736:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782757731.205521:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:0.0:1782757731.206285:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d99ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206303:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d99ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206315:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d99ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206358:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206364:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206370:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206376:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757731.206381:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206388:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206461:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:0.0:1782757731.206464:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757731.206468:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206474:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d999e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757731.206488:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdb53222 reply state 0000000003812e9a transno 4294967538 ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757731.206498:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757731.206533:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9997 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64750 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206547:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d99ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64750 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.206554:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782757731.206556:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757731.206559:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147200, rc 0) 00000100:00100000:0.0:1782757731.206900:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:42565:x1869355196635008:12345-192.168.204.31@tcp:101:dd.0 Request processed in 3610us (5028us total) trans 4294967538 rc 0/0 00000100:00100000:0.0:1782757731.206918:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 625 00010000:00010000:1.0:1782757731.210324:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210342:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210349:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210356:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757731.210361:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210369:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210387:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff91718bcfd900) 00010000:00010000:1.0:1782757731.210391:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757731.210395:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757731.210401:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757731.215926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.216140:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635136 00000100:00100000:0.0:1782757731.216150:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635136 00000100:00100000:0.0:1782757731.216208:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 333 00000100:00100000:0.0:1782757731.216219:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42565:x1869355196635136:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782757731.216238:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757731.216259:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64757 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782757731.216284:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782757731.216305:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1799s v=(0 0) 00010000:00010000:0.0:1782757731.216309:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757731.216318:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.216336:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757731.216348:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147e00, rc 0) 00000100:00100000:0.0:1782757731.216407:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42565:x1869355196635136:12345-192.168.204.31@tcp:101:dd.0 Request processed in 190us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.216414:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 333 00000100:00100000:0.0:1782757731.246788:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211491968:0@lo:400:kworker.0 00000100:00100000:0.0:1782757731.246872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757731.246929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782757731.246935:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211491840:0@lo:400:kworker.0 00000100:00100000:0.0:1782757731.246968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757731.246982:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211492352:0@lo:400:kworker.0 00000100:00100000:0.0:1782757731.247003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757731.247030:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492352 00000100:00100000:0.0:1782757731.247036:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492352 00000100:00100000:0.0:1782757731.247098:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1782757731.247107:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211492352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757731.247159:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211492352:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.247166:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1782757731.247216:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211492352:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247298:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211491712:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757731.247366:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211492224:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757731.247403:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757731.247408:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211492096:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757731.247449:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492096 00000100:00100000:1.0:1782757731.247452:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492096 00000100:00100000:1.0:1782757731.247477:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1782757731.247482:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211492096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247512:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211492096:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.247518:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1782757731.247544:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211492096:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247564:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491968 00000100:00100000:1.0:1782757731.247567:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491968 00000100:00100000:1.0:1782757731.247585:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491840 00000100:00100000:1.0:1782757731.247588:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491840 00000100:00100000:1.0:1782757731.247598:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492224 00000100:00100000:1.0:1782757731.247600:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492224 00000100:00100000:1.0:1782757731.247612:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1782757731.247617:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247647:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211491968:12345-0@lo:400:kworker.0 Request processed in 30us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.247653:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1782757731.247663:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1782757731.247668:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247689:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211491840:12345-0@lo:400:kworker.0 Request processed in 21us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.247694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1782757731.247702:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1782757731.247707:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247729:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211492224:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.247735:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1782757731.247753:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211492224:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247769:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211491840:0@lo:400:kworker.0 00000100:00100000:1.0:1782757731.247778:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211491968:0@lo:400:kworker.0 00000100:00080000:3.0:1782757731.248014:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782757731.248020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757731.248022:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757731.248100:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211491712 00000100:00100000:0.0:1782757731.248105:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211491712 00000100:00100000:0.0:1782757731.248146:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1782757731.248153:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757731.248189:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211491712:12345-0@lo:400:kworker.0 Request processed in 38us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.248195:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1782757731.248322:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211491712:0@lo:400:kworker.0 00000100:00100000:3.0:1782757731.263490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.263623:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635264 00000100:00100000:0.0:1782757731.263633:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635264 00002000:00100000:0.0:1782757731.263696:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff917190264a80 x1869355196635264/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:402/0 lens 488/0 e 0 to 0 dl 1782757742 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782757731.263707:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917190264a80 with x1869355196635264 ext(0->1048575) 00002000:00010000:0.0:1782757731.263713:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917190264a80 00000100:00100000:0.0:1782757731.263749:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:0.0:1782757731.263768:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196635264:12345-192.168.204.31@tcp:4:dd.0 00000001:00100000:0.0:1782757731.380063:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:0.0:1782757731.432004:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000100:00100000:2.0:1782757731.432241:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196635264:12345-192.168.204.31@tcp:4:dd.0 Request processed in 168476us (168754us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1782757731.432255:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00002000:00100000:2.0:1782757731.432384:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff917190264a80 x1869355196635264/t4294967334(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:402/0 lens 488/448 e 0 to 0 dl 1782757742 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782757731.432396:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917190264a80 with x1869355196635264 ext(0->1048575) 00002000:00010000:2.0:1782757731.432403:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917190264a80 00000100:00100000:2.0:1782757731.439001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757731.439135:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635392 00000100:00100000:1.0:1782757731.439145:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635392 00000100:00100000:1.0:1782757731.439205:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:1.0:1782757731.439216:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:42565:x1869355196635392:12345-192.168.204.31@tcp:44:dd.0 00000001:00080000:1.0:1782757731.495897:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967538 is committed 00000100:00100000:0.0:1782757731.496056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42565:x1869355196635392:12345-192.168.204.31@tcp:44:dd.0 Request processed in 56835us (57058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757731.496069:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:3.0:1782757731.500353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757731.500695:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635520 00000100:00100000:0.0:1782757731.500704:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635520 00000100:00100000:1.0:1782757731.500849:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:1.0:1782757731.500861:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196635520:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:1.0:1782757731.500988:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196635520:12345-192.168.204.31@tcp:16:dd.0 Request processed in 123us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757731.500995:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:2.0:1782757731.507091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757731.507379:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635776 00000100:00100000:1.0:1782757731.507390:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635776 00000100:00100000:1.0:1782757731.507449:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:1.0:1782757731.507459:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42565:x1869355196635776:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:1.0:1782757731.508164:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:42565:x1869355196635776:12345-192.168.204.31@tcp:35:dd.0 Request processed in 704us (1081us total) trans 4294967539 rc 0/0 00000100:00100000:1.0:1782757731.508174:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:3.0:1782757731.756204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757731.756230:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211492480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757731.756308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757731.756528:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492480 00000100:00100000:2.0:1782757731.756537:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492480 00000100:00100000:2.0:1782757731.756589:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1782757731.756598:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211492480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757731.756631:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782757731.756685:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211492480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757731.756692:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1782757731.756993:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211492480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757731.820310:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757732.848073:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757733.048687:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967539 is committed 00010000:00010000:0.0:1782757733.874206:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782757734.296501:0:73451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1802699675507ns, next at 1783239579481ns, rc = 0 00000004:00080000:0.0:1782757734.296630:0:73451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1802699806486ns, next at 1734614510270ns, rc = 0 00000004:00080000:1.0:1782757734.303120:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000004:00080000:1.0:1782757734.303151:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00000100:00100000:1.0:1782757734.321925:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757734.321947:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211492608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757734.322011:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757734.322040:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492608 00000100:00100000:3.0:1782757734.322047:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492608 00000100:00080000:1.0:1782757734.322076:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757734.322115:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1782757734.322125:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211492608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757734.322159:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757734.322221:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211492608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757734.322229:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1782757734.322456:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211492608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782757734.894185:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757735.604448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.604492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757735.604500:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636032 00000100:00100000:3.0:1782757735.604523:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636032 00000100:00100000:2.0:1782757735.604532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.604568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757735.604584:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000100:00100000:3.0:1782757735.604593:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196636032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757735.604599:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196635904 00000100:00100000:2.0:1782757735.604605:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196635904 00000100:00100000:2.0:1782757735.604643:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:2.0:1782757735.604651:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196635904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757735.604671:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196636032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757735.604677:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000100:00100000:2.0:1782757735.604687:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196635904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00080000:3.0:1782757735.604695:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757735.604700:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:2.0:1782757735.604740:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636288 00000100:00100000:2.0:1782757735.604744:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636288 00000100:00100000:2.0:1782757735.604777:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636160 00000100:00100000:2.0:1782757735.604781:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636160 00000100:00080000:3.0:1782757735.604799:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757735.604803:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757735.604815:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:2.0:1782757735.604842:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196636288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757735.604887:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196636288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.604894:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:2.0:1782757735.604907:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 919 00000100:00100000:2.0:1782757735.604914:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196636160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757735.604939:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196636160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.604944:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 919 00000100:00100000:2.0:1782757735.819805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757735.820081:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636416 00000100:00100000:0.0:1782757735.820092:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636416 00000100:00100000:0.0:1782757735.820158:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 627 00000100:00100000:0.0:1782757735.820171:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636416:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757735.820564:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636416:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 394us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757735.820573:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 627 00000100:00100000:1.0:1782757735.825887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.825987:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636544 00000100:00100000:2.0:1782757735.825996:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636544 00000100:00100000:2.0:1782757735.826052:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 335 00000100:00100000:2.0:1782757735.826062:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42758:x1869355196636544:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757735.826416:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42758:x1869355196636544:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 354us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.826424:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 335 00000100:00100000:2.0:1782757735.832663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757735.832754:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636672 00000100:00100000:0.0:1782757735.832765:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636672 00000100:00100000:0.0:1782757735.832874:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 336 00000100:00100000:0.0:1782757735.832886:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42758:x1869355196636672:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757735.833608:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42758:x1869355196636672:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 721us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757735.833620:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 336 00000100:00100000:0.0:1782757735.842329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757735.842443:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636800 00000100:00100000:1.0:1782757735.842453:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636800 00000100:00100000:1.0:1782757735.842516:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 628 00000100:00100000:1.0:1782757735.842525:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636800:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757735.842917:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636800:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 392us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757735.842925:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 628 00000100:00100000:3.0:1782757735.849759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757735.849959:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196636928 00000100:00100000:1.0:1782757735.849971:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196636928 00000100:00100000:1.0:1782757735.850032:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:1.0:1782757735.850043:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636928:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757735.850165:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196636928:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757735.850177:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:1.0:1782757735.856963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.857028:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637056 00000100:00100000:2.0:1782757735.857038:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637056 00000100:00100000:2.0:1782757735.857095:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 337 00000100:00100000:2.0:1782757735.857106:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42758:x1869355196637056:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757735.857478:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42758:x1869355196637056:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 373us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.857485:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 337 00000100:00100000:3.0:1782757735.859672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.860668:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637184 00000100:00100000:2.0:1782757735.860679:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637184 00000100:00100000:2.0:1782757735.860745:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00100000:2.0:1782757735.860756:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42758:x1869355196637184:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757735.861169:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42758:x1869355196637184:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 413us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.861178:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00100000:3.0:1782757735.867693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757735.885404:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637312 00000100:00100000:2.0:1782757735.885418:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637312 00000100:00100000:2.0:1782757735.885488:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 630 00000100:00100000:2.0:1782757735.885498:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196637312:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757735.885947:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42758:x1869355196637312:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 450us (18265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757735.885955:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 630 00010000:00010000:3.0:1782757735.916773:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757736.008654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757736.008777:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637568 00000100:00100000:0.0:1782757736.008787:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637568 00000100:00100000:0.0:1782757736.008896:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 631 00000100:00100000:0.0:1782757736.008909:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:42762:x1869355196637568:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782757736.008969:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757736.008997:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d99ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64750 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009019:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782757736.009051:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757736.009076:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009090:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009101:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009116:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009123:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009131:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009506:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009517:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.009525:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782757736.011315:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 64 off9408 00000004:00080000:3.0:1782757736.011330:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1804414507136ns, next at 1805414503938ns, rc = 0 00010000:00010000:3.0:1782757736.011644:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011660:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011671:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011680:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011688:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011695:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011719:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782757736.011749:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011755:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011766:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011772:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757736.011777:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011784:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011797:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782757736.011800:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757736.011804:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011811:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d99cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011855:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011872:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011878:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011884:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757736.011887:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011898:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011907:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782757736.011910:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757736.011913:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757736.011919:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d99c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757736.011931:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe593e4e reply state 00000000a6404b24 transno 4294967540 ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757736.011941:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757736.012246:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757736.012258:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.012264:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757736.012267:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.012274:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.012283:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782757736.012286:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782757736.012289:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.012294:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d99d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.012319:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757736.012321:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757736.012323:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757736.012648:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:42762:x1869355196637568:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3542us (3803us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1782757736.012661:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 631 00010000:00010000:0.0:1782757736.018210:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018228:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018236:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018242:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757736.018247:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018255:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018271:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff91718bcfdf00) 00010000:00010000:0.0:1782757736.018275:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757736.018279:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757736.018286:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d99c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757736.364053:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211492736:0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.364080:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211492992:0@lo:400:kworker.0 00000100:00100000:2.0:1782757736.364147:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493120:0@lo:400:kworker.0 00000100:00100000:3.0:1782757736.364156:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211492864:0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.365947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757736.366374:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492992 00000100:00100000:0.0:1782757736.366384:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492992 00000100:00100000:0.0:1782757736.366442:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1782757736.366453:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.366524:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211492992:12345-0@lo:400:kworker.0 Request processed in 74us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757736.366532:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1782757736.366588:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211492992:0@lo:400:kworker.0 00000100:00100000:1.0:1782757736.366592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757736.366628:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211493248:0@lo:400:kworker.0 00000100:00100000:1.0:1782757736.366661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757736.366698:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492736 00000100:00100000:1.0:1782757736.366702:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492736 00000100:00100000:1.0:1782757736.366730:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1782757736.366736:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211492736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757736.366770:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211492736:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757736.366777:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1782757736.366813:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211492736:0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.367085:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493248 00000100:00100000:0.0:1782757736.367089:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493248 00000100:00100000:0.0:1782757736.367121:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1782757736.367127:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.367158:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211493248:12345-0@lo:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757736.367164:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1782757736.367356:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211493248:0@lo:400:kworker.0 00000100:00100000:3.0:1782757736.367610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757736.367610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757736.367636:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211493376:0@lo:400:kworker.0 00000100:00080000:3.0:1782757736.367666:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757736.367675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757736.368961:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211492864 00000100:00100000:0.0:1782757736.368972:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211492864 00000100:00100000:0.0:1782757736.369016:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1782757736.369025:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211492864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757736.369086:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211492864:12345-0@lo:400:kworker.0 Request processed in 62us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757736.369094:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1782757736.369175:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493120 00000100:00100000:1.0:1782757736.369180:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493120 00000100:00100000:1.0:1782757736.369226:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493376 00000100:00100000:1.0:1782757736.369229:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493376 00000100:00100000:1.0:1782757736.369250:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1782757736.369256:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211493120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757736.369296:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211493120:12345-0@lo:400:kworker.0 Request processed in 39us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757736.369302:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1782757736.369319:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1782757736.369325:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211493376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757736.369352:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211493376:12345-0@lo:400:kworker.0 Request processed in 28us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757736.369359:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00080000:0.0:1782757736.369419:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757736.369423:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757736.369654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211493376:0@lo:400:kworker.0 00000100:00100000:3.0:1782757736.369682:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211492864:0@lo:400:kworker.0 00000100:00100000:3.0:1782757736.369727:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493120:0@lo:400:kworker.0 00000100:00100000:2.0:1782757736.878256:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757736.878279:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211493504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757736.878349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757736.878402:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493504 00000100:00100000:1.0:1782757736.878411:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493504 00000100:00100000:1.0:1782757736.878471:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1782757736.878482:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211493504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757736.878520:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782757736.878574:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211493504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757736.878581:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1782757736.878630:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211493504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757736.954239:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782757737.795760:0:73596:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1806198934463ns, next at 1783239579481ns, rc = 0 00000004:00080000:0.0:1782757737.796012:0:73596:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1806199188421ns, next at 1805414503938ns, rc = 0 00000004:00080000:1.0:1782757737.831446:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000004:00080000:1.0:1782757737.831473:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000100:00100000:3.0:1782757737.831744:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782757737.831812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757737.831961:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493632 00000100:00100000:0.0:1782757737.831969:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493632 00000100:00100000:0.0:1782757737.832021:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1782757737.832031:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211493632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757737.832058:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00010000:00010000:0.0:1782757737.832083:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.832105:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.832114:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1782757737.832117:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757737.832122:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.832263:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.832279:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 5 pid: 9120 timeout: 1906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757737.832291:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211493760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757737.832360:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0f846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782757737.835513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757737.836024:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211493760:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782757737.836054:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757737.836430:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637696 00000100:00100000:2.0:1782757737.836437:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637696 00010000:00010000:2.0:1782757737.836482:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 6 pid: 9120 timeout: 1906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757737.836519:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00100000:2.0:1782757737.836529:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196637696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757737.836544:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757737.836550:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 6 pid: 9120 timeout: 1906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757737.836562:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 6 pid: 9120 timeout: 1906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757737.836587:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f63e842/0xdd99f5c4777d99ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64757 expref: 6 pid: 9120 timeout: 1906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757737.836604:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757737.836608:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757737.836614:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757737.836623:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757737.836646:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757737.836696:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196637696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 168us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757737.836706:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00080000:0.0:1782757737.837686:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782757737.837705:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.837734:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.837746:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.837754:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757737.837779:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782757737.838366:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00080000:1.0:1782757737.838371:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967540 is committed 00010000:00010000:3.0:1782757737.838374:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782757737.838378:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00010000:00010000:3.0:1782757737.838383:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757737.838387:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757737.838397:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757737.838413:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757737.838420:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003936aa33/0xdd99f5c4777d99dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757737.838441:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757737.838443:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757737.838445:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757737.838891:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211493632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6858us (7075us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782757737.838900:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000004:00080000:3.0:1782757737.838924:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170835fa680/2, rc 0, transno 4294967335 00000100:00100000:3.0:1782757737.838937:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493632:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782757737.964237:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757738.988810:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757739.437059:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757739.439850:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757739.439964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757739.441031:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211493888 00000100:00100000:0.0:1782757739.441045:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211493888 00000100:00100000:0.0:1782757739.443887:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1782757739.443911:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211493888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757739.443969:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757739.444215:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211493888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 312us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757739.444223:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00080000:3.0:1782757739.444562:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757739.445781:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211493888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757740.015323:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757740.725126:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757740.725250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757740.725297:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757740.725791:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638080 00000100:00100000:0.0:1782757740.725802:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638080 00000100:00100000:0.0:1782757740.725913:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 922 00000100:00100000:0.0:1782757740.725924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196638080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757740.726005:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196638080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757740.726014:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 922 00000100:00100000:1.0:1782757740.726612:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637952 00000100:00100000:1.0:1782757740.726619:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637952 00000100:00100000:1.0:1782757740.726667:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00100000:1.0:1782757740.726675:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196637952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757740.726725:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196637952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757740.726732:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00080000:3.0:1782757740.726939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782757740.726944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757740.727200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757740.727388:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638208 00000100:00100000:1.0:1782757740.727393:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638208 00000100:00100000:1.0:1782757740.727449:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 923 00000100:00100000:1.0:1782757740.727458:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196638208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757740.727499:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196638208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757740.727506:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 923 00000100:00080000:3.0:1782757740.727535:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757740.730207:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196637824 00000100:00100000:2.0:1782757740.730363:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196637824 00000100:00100000:2.0:1782757740.733663:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1051 00000100:00100000:2.0:1782757740.733692:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196637824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757740.733793:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196637824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 117us (8676us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757740.733802:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1051 00000001:00080000:0.0:1782757741.017691:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00010000:00010000:1.0:1782757741.043398:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757741.484393:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211494272:0@lo:400:kworker.0 00000100:00100000:2.0:1782757741.484467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757741.484539:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757741.484545:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494400:0@lo:400:kworker.0 00000100:00100000:2.0:1782757741.484572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757741.484656:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494400 00000100:00100000:0.0:1782757741.484664:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494400 00000100:00100000:0.0:1782757741.484726:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1782757741.484736:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757741.484809:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494400:12345-0@lo:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757741.484817:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1782757741.484887:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494400:0@lo:400:kworker.0 00000100:00080000:2.0:1782757741.484957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757741.485352:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494272 00000100:00100000:3.0:1782757741.485358:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494272 00000100:00100000:3.0:1782757741.485498:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1782757741.485507:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211494272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757741.485552:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211494272:12345-0@lo:400:kworker.0 Request processed in 47us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757741.485559:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1782757741.485594:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211494272:0@lo:400:kworker.0 00000100:00080000:0.0:1782757741.485656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757741.486078:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211494016:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757741.486154:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211494528:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757741.486197:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782757741.486203:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211494144:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757741.486242:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211494656:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757741.486291:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494656 00000100:00100000:1.0:1782757741.486296:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494656 00000100:00100000:1.0:1782757741.486332:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1782757741.486339:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486376:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211494656:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757741.486383:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1782757741.486403:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494016 00000100:00100000:1.0:1782757741.486406:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494016 00000100:00100000:1.0:1782757741.486426:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1782757741.486432:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211494016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486473:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211494016:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757741.486478:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1782757741.486504:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494528 00000100:00100000:1.0:1782757741.486507:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494528 00000100:00100000:1.0:1782757741.486528:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494144 00000100:00100000:1.0:1782757741.486530:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494144 00000100:00100000:1.0:1782757741.486545:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1782757741.486550:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211494528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486575:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211494528:12345-0@lo:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757741.486581:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1782757741.486592:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1782757741.486597:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211494144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486620:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211494144:12345-0@lo:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757741.486625:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1782757741.486656:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211494144:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486665:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:1.0:1782757741.486669:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170835fa680, transno 4294967335 00000100:00100000:1.0:1782757741.486681:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211494656:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486690:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211494016:0@lo:400:kworker.0 00000100:00100000:1.0:1782757741.486699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211494528:0@lo:400:kworker.0 00000100:00080000:1.0:1782757741.486746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757741.486761:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757742.001878:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757742.001958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757742.002140:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494784 00000100:00100000:1.0:1782757742.002149:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494784 00000100:00100000:1.0:1782757742.002200:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1782757742.002208:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757742.002247:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757742.006103:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3885us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757742.006118:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1782757742.007254:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757742.060519:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757743.084054:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757744.108125:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757744.557370:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757744.559428:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757744.559534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757744.561511:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211494912 00000100:00100000:0.0:1782757744.561526:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211494912 00000100:00100000:0.0:1782757744.561631:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1782757744.561641:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757744.561681:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757744.561802:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211494912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757744.561810:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:1.0:1782757744.561950:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757744.563786:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211494912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757745.132667:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757745.852630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757745.852714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757745.852760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757745.852804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757745.852890:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638464 00000100:00100000:1.0:1782757745.852907:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638464 00000100:00100000:0.0:1782757745.852908:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638592 00000100:00100000:0.0:1782757745.852919:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638592 00000100:00100000:2.0:1782757745.853011:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638336 00000100:00100000:1.0:1782757745.853015:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00100000:2.0:1782757745.853030:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638336 00000100:00100000:1.0:1782757745.853031:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196638464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757745.853096:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:2.0:1782757745.853109:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196638336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757745.853139:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196638464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757745.853149:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00100000:2.0:1782757745.853185:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196638336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757745.853198:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:3.0:1782757745.853259:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638720 00000100:00100000:3.0:1782757745.853263:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638720 00000100:00100000:0.0:1782757745.853569:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00100000:0.0:1782757745.853577:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196638592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757745.853610:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196638592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757745.853617:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00080000:1.0:1782757745.858408:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757745.858420:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757745.858424:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757745.862725:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 927 00000100:00100000:3.0:1782757745.862748:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196638720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757745.862925:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196638720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 183us (10117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757745.862934:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 927 00010000:00010000:2.0:1782757746.156232:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757746.608562:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211495424:0@lo:400:kworker.0 00000100:00100000:2.0:1782757746.608684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757746.608761:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757746.608768:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211495296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757746.608798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757746.609088:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495296 00000100:00100000:1.0:1782757746.609098:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495296 00000100:00100000:1.0:1782757746.609180:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1782757746.609192:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211495296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757746.609261:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211495296:12345-0@lo:400:kworker.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757746.609273:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00080000:1.0:1782757746.609303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757746.609458:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211495296:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610062:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211495168:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757746.610170:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211495680:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757746.610218:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782757746.610225:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211495040:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757746.610280:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211495552:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757746.610332:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495424 00000100:00100000:0.0:1782757746.610338:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495424 00000100:00100000:0.0:1782757746.610388:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495680 00000100:00100000:0.0:1782757746.610391:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495680 00000100:00100000:0.0:1782757746.610416:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1782757746.610423:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610470:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211495424:12345-0@lo:400:kworker.0 Request processed in 48us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757746.610477:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1782757746.610505:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1782757746.610511:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211495680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610545:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211495680:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757746.610551:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1782757746.610571:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495040 00000100:00100000:0.0:1782757746.610575:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495040 00000100:00100000:0.0:1782757746.610775:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1782757746.610784:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.610819:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211495040:12345-0@lo:400:kworker.0 Request processed in 37us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757746.610920:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1782757746.610952:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495168 00000100:00100000:0.0:1782757746.610957:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495168 00000100:00100000:0.0:1782757746.610979:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495552 00000100:00100000:0.0:1782757746.610981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495552 00000100:00100000:0.0:1782757746.610999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1782757746.611005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211495168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.611039:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211495168:12345-0@lo:400:kworker.0 Request processed in 34us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757746.611045:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1782757746.611058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1782757746.611063:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211495552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.611090:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211495552:12345-0@lo:400:kworker.0 Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757746.611095:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:0.0:1782757746.611116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757746.611120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757746.611124:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757746.611150:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211495040:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.613173:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211495552:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.613202:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211495168:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.613217:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211495680:0@lo:400:kworker.0 00000100:00100000:0.0:1782757746.613296:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211495424:0@lo:400:kworker.0 00000100:00100000:0.0:1782757747.117581:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757747.117611:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211495808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757747.117715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757747.117882:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495808 00000100:00100000:2.0:1782757747.117893:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495808 00000100:00100000:2.0:1782757747.117965:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1782757747.118654:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211495808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757747.118709:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757747.118794:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211495808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 819us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757747.118803:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1782757747.119455:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211495808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757747.180183:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757748.204517:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757749.230519:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757749.676233:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757749.676569:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211495936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757749.676685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757749.677779:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211495936 00000100:00100000:2.0:1782757749.677792:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211495936 00000100:00100000:2.0:1782757749.680165:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1782757749.680202:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211495936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757749.680260:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757749.680402:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211495936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757749.680411:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1782757749.680515:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211495936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757749.680536:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757750.252745:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757750.966982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757750.967037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757750.967070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757750.967128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757750.967140:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638848 00000100:00100000:2.0:1782757750.967155:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638848 00000100:00100000:0.0:1782757750.967171:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639232 00000100:00100000:0.0:1782757750.967182:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639232 00000100:00100000:2.0:1782757750.967242:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1055 00000100:00100000:2.0:1782757750.967252:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196638848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757750.967259:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639104 00000100:00100000:0.0:1782757750.967265:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639104 00000100:00100000:0.0:1782757750.967301:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 930 00000100:00100000:0.0:1782757750.967314:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196639232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757750.967326:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196638848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757750.967333:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1055 00000100:00100000:0.0:1782757750.967404:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196639232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757750.967408:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 931 00000100:00100000:2.0:1782757750.967424:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196639104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757750.967427:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 930 00000100:00100000:2.0:1782757750.967451:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196639104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757750.967462:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 931 00000100:00080000:2.0:1782757750.967507:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757750.967511:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757750.967917:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196638976 00000100:00100000:1.0:1782757750.967925:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196638976 00000100:00100000:1.0:1782757750.967995:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1262 00000100:00100000:1.0:1782757750.968004:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196638976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757750.968047:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196638976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757750.968054:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1262 00000100:00080000:2.0:1782757750.968589:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757751.276360:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757751.724264:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211496448:0@lo:400:kworker.0 00000100:00100000:2.0:1782757751.724375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757751.724454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757751.724461:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211496320:0@lo:400:kworker.0 00000100:00100000:2.0:1782757751.724489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757751.724620:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496320 00000100:00100000:1.0:1782757751.724630:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496320 00000100:00100000:1.0:1782757751.724709:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1782757751.724722:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.724790:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211496320:12345-0@lo:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.724798:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:2.0:1782757751.725388:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757751.725437:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211496320:0@lo:400:kworker.0 00000100:00100000:3.0:1782757751.726098:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211496064:0@lo:400:kworker.0 00000100:00100000:3.0:1782757751.726179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757751.726227:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211496576:0@lo:400:kworker.0 00000100:00100000:3.0:1782757751.726258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757751.726266:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496064 00000100:00100000:1.0:1782757751.726272:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496064 00000100:00100000:3.0:1782757751.726295:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782757751.726305:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211496192:0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726322:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1782757751.726336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757751.726336:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211496064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757751.726374:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211496704:0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726396:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211496064:12345-0@lo:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.726409:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:1.0:1782757751.726465:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496576 00000100:00100000:1.0:1782757751.726469:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496576 00000100:00100000:1.0:1782757751.726503:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496192 00000100:00100000:1.0:1782757751.726507:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496192 00000100:00100000:1.0:1782757751.726525:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1782757751.726531:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211496576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726580:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211496576:12345-0@lo:400:kworker.0 Request processed in 49us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.726587:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1782757751.726603:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1782757751.726607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757751.726614:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211496192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757751.726647:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211496064:0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726653:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211496192:12345-0@lo:400:kworker.0 Request processed in 40us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.726662:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1782757751.726667:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211496576:0@lo:400:kworker.0 00000100:00080000:1.0:1782757751.726689:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757751.726694:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211496192:0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726718:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496448 00000100:00100000:1.0:1782757751.726724:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496448 00000100:00100000:1.0:1782757751.726758:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496704 00000100:00100000:1.0:1782757751.726761:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496704 00000100:00100000:1.0:1782757751.726781:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1782757751.726788:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211496448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726818:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211496448:12345-0@lo:400:kworker.0 Request processed in 32us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.726843:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1782757751.726852:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1782757751.726856:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211496704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757751.726885:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211496704:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757751.726891:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00080000:3.0:1782757751.727174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757751.727178:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757751.727195:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211496704:0@lo:400:kworker.0 00000100:00100000:2.0:1782757751.727629:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211496448:0@lo:400:kworker.0 00000100:00100000:3.0:1782757752.236524:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782757752.236563:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211496832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757752.236660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757752.236808:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496832 00000100:00100000:0.0:1782757752.236840:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496832 00000100:00100000:0.0:1782757752.236910:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1782757752.236921:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211496832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757752.236966:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757752.237035:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211496832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757752.237043:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1782757752.237278:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211496832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757752.300179:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757753.324578:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757753.455669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757753.456263:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639360 00000100:00100000:1.0:1782757753.456277:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639360 00000100:00100000:1.0:1782757753.456360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 632 00000100:00100000:1.0:1782757753.456370:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639360:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757753.456475:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639360:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 106us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757753.456487:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 632 00000100:00080000:3.0:1782757753.456501:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757753.463625:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757753.467781:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639488 00000100:00100000:1.0:1782757753.467801:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639488 00000100:00100000:1.0:1782757753.467971:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 340 00000100:00100000:1.0:1782757753.467985:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196639488:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:3.0:1782757753.468471:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757753.469980:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196639488:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 1988us (6360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757753.469993:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 340 00000100:00100000:0.0:1782757753.472641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757753.472871:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639616 00000100:00100000:3.0:1782757753.472884:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639616 00000100:00100000:3.0:1782757753.472982:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00100000:3.0:1782757753.472995:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196639616:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757753.473752:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196639616:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 757us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757753.473762:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00080000:1.0:1782757753.474555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757753.481539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757753.481735:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639744 00000100:00100000:1.0:1782757753.481747:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639744 00000100:00100000:1.0:1782757753.481875:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:1.0:1782757753.481889:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639744:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757753.482906:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639744:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1016us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757753.482918:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:0.0:1782757753.491457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757753.492859:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196639872 00000100:00100000:2.0:1782757753.492871:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196639872 00000100:00100000:2.0:1782757753.493005:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 634 00000100:00100000:2.0:1782757753.493019:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639872:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757753.493502:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196639872:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 485us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757753.493510:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 634 00000100:00100000:0.0:1782757753.496446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757753.496778:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640000 00000100:00100000:2.0:1782757753.496787:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640000 00000100:00100000:2.0:1782757753.497020:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:2.0:1782757753.497031:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196640000:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757753.497742:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196640000:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 710us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757753.497750:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:0.0:1782757753.502223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757753.502452:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640128 00000100:00100000:2.0:1782757753.502462:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640128 00000100:00100000:2.0:1782757753.502554:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:2.0:1782757753.502565:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196640128:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757753.502919:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:42981:x1869355196640128:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 356us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757753.502927:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:0.0:1782757753.505736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757753.506235:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640256 00000100:00100000:2.0:1782757753.506244:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640256 00000100:00100000:2.0:1782757753.506403:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 635 00000100:00100000:2.0:1782757753.506413:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196640256:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757753.506803:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:42981:x1869355196640256:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 392us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757753.506812:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 635 00010000:00010000:1.0:1782757754.349399:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757754.801215:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757754.801239:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211496960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757754.801308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757754.801458:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211496960 00000100:00100000:1.0:1782757754.801466:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211496960 00000100:00100000:1.0:1782757754.801544:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1782757754.801553:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211496960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757754.801590:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757754.801635:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211496960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757754.801642:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00080000:0.0:1782757754.801756:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757754.801797:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211496960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757755.374355:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757756.085951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757756.085995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757756.086014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757756.086039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757756.086107:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640640 00000100:00100000:1.0:1782757756.086117:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640640 00000100:00100000:1.0:1782757756.086177:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640768 00000100:00100000:1.0:1782757756.086180:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640768 00000100:00100000:1.0:1782757756.086205:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 934 00000100:00100000:1.0:1782757756.086214:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196640640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757756.086239:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640384 00000100:00100000:2.0:1782757756.086243:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640384 00000100:00100000:2.0:1782757756.086270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:2.0:1782757756.086277:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196640384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757756.086292:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196640640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.086300:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 934 00000100:00100000:2.0:1782757756.086312:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196640384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757756.086318:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:1.0:1782757756.086319:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 935 00000100:00100000:1.0:1782757756.086336:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196640768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757756.086362:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196640768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.086368:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 935 00000100:00100000:1.0:1782757756.086387:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640512 00000100:00100000:1.0:1782757756.086390:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640512 00000100:00100000:1.0:1782757756.086424:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1266 00000100:00100000:1.0:1782757756.086431:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196640512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757756.086461:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196640512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.086478:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1266 00000100:00080000:0.0:1782757756.086999:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757756.087004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757756.087006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757756.400962:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757756.847628:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211497216:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.847696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.847743:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211497728:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.847770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.847807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782757756.847813:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211497088:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.847937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.847959:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211497600:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.847980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.848005:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211497344:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.848045:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757756.848050:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211497472:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757756.848098:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497216 00000100:00100000:1.0:1782757756.848105:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497216 00000100:00100000:1.0:1782757756.848141:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497600 00000100:00100000:1.0:1782757756.848145:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497600 00000100:00100000:1.0:1782757756.848170:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497344 00000100:00100000:1.0:1782757756.848172:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497344 00000100:00100000:1.0:1782757756.848187:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1782757756.848194:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211497216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848245:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211497216:12345-0@lo:400:kworker.0 Request processed in 50us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.848251:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1782757756.848271:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1782757756.848276:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211497600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848302:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211497600:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.848308:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1782757756.848319:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1782757756.848325:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211497344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848353:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211497344:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.848359:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1782757756.848378:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497728 00000100:00100000:1.0:1782757756.848381:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497728 00000100:00100000:1.0:1782757756.848403:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497472 00000100:00100000:1.0:1782757756.848406:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497472 00000100:00100000:1.0:1782757756.848422:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1782757756.848428:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848469:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211497728:12345-0@lo:400:kworker.0 Request processed in 41us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.848475:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1782757756.848487:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1782757756.848492:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211497472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848517:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211497472:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757756.848526:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:1.0:1782757756.848541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757756.848545:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757756.848547:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757756.848581:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211497472:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848591:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211497344:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848628:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211497600:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848637:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211497216:0@lo:400:kworker.0 00000100:00100000:1.0:1782757756.848645:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211497728:0@lo:400:kworker.0 00000100:00100000:2.0:1782757756.850010:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497088 00000100:00100000:2.0:1782757756.850020:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497088 00000100:00100000:2.0:1782757756.850066:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1782757756.850074:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211497088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757756.850135:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211497088:12345-0@lo:400:kworker.0 Request processed in 61us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757756.850142:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1782757756.850193:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211497088:0@lo:400:kworker.0 00000020:00000080:3.0:1782757757.212913:0:73864:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcddad7950 20000000:00000080:3.0:1782757757.212933:0:73864:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba95000 uarg=0000000000000000 00010000:00010000:3.0:1782757757.213469:0:73864:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782757757.213503:0:73864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782757757.213507:0:73864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757757.213517:0:73864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64749 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.213538:0:73864:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782757757.213554:0:73864:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757757.213567:0:73864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.213579:0:73864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.213587:0:73864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.213622:0:73864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.213633:0:73864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 18 pid: 5794 timeout: 1925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757757.213644:0:73864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73864:1869355211497856:0@lo:104: 00000100:00100000:3.0:1782757757.213694:0:73864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757757.213742:0:73864:0:(client.c:2701:ptlrpc_set_wait()) set ffff917187767d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782757757.213750:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497856 00000100:00100000:2.0:1782757757.213757:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497856 00000100:00100000:3.0:1782757757.213869:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1782757757.213879:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73864:x1869355211497856:12345-0@lo:104: 00000100:00100000:1.0:1782757757.213879:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1782757757.213890:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1782757757.213896:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757757.214011:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757757.214018:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:73864:x1869355211497856:12345-0@lo:104: Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757757.214027:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1782757757.214075:0:73864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73864:1869355211497856:0@lo:104: 00010000:00010000:0.0:1782757757.214095:0:73864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214113:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757757.214121:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214130:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757757.214134:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214143:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757757.214161:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757757.214167:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757757.214327:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214334:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757757.214356:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214363:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9966 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d996d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214376:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757757.214379:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757757.214380:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757757.214393:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211497984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757757.214423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757757.214642:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211497984 00000100:00100000:1.0:1782757757.214647:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211497984 00010000:00010000:1.0:1782757757.214667:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 1925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757757.214698:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1782757757.214706:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211497984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757757.214718:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757757.214724:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 1925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214734:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 1925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214746:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d996d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9966 expref: 19 pid: 5794 timeout: 1925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214758:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214765:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214777:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214784:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214791:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214797:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214803:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757757.214807:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214814:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214867:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757757.214876:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757757.214903:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211497984:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757757.214910:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:0.0:1782757757.216306:0:73864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757757.216320:0:73864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757757.216327:0:73864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d99e4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757757.217262:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211497984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757757.356282:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757757.356306:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211498112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757757.356379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757757.356668:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498112 00000100:00100000:0.0:1782757757.356676:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498112 00000100:00100000:0.0:1782757757.356725:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1782757757.356735:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211498112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757757.356776:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757757.356845:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211498112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757757.356852:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1782757757.356959:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211498112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757757.424782:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757758.448624:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782757758.571914:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757758.571922:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757758.571927:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757758.571984:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757758.571997:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757758.572009:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757758.572041:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211498240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757758.572114:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757758.572180:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b32370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782757758.572312:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498240 00000100:00100000:1.0:1782757758.572320:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498240 00000100:00100000:1.0:1782757758.572382:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1782757758.572393:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211498240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757758.572407:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757758.572430:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d99eb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757758.572452:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757758.572462:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757758.572471:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757758.572519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211498240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757758.572526:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1782757758.572621:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211498240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757758.572637:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757758.572646:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757758.572666:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757758.572671:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757758.572678:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757759.479296:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757759.917061:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757759.917132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757759.917232:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498368 00000100:00100000:0.0:1782757759.917240:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498368 00000100:00100000:0.0:1782757759.917300:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1782757759.917323:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211498368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757759.917358:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757759.917419:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211498368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757759.917427:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00080000:2.0:1782757759.917538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757759.917577:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211498368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757760.500848:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757761.204849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757761.204885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757761.210085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757761.210127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757761.210160:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641024 00000100:00100000:1.0:1782757761.210169:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641024 00000100:00100000:1.0:1782757761.210230:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000100:00100000:1.0:1782757761.210241:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757761.210315:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (5473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.210322:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000100:00100000:1.0:1782757761.210349:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641280 00000100:00100000:1.0:1782757761.210353:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641280 00000100:00100000:1.0:1782757761.210388:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641152 00000100:00100000:1.0:1782757761.210391:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641152 00000100:00100000:1.0:1782757761.210415:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 938 00000100:00100000:1.0:1782757761.210422:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757761.210450:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.210457:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 938 00000100:00100000:1.0:1782757761.210470:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 939 00000100:00100000:1.0:1782757761.210479:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757761.210502:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196641152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.210508:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 939 00000100:00080000:1.0:1782757761.210526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757761.210530:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757761.210533:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757761.211444:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196640896 00000100:00100000:2.0:1782757761.211451:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196640896 00000100:00100000:2.0:1782757761.211489:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1060 00000100:00100000:2.0:1782757761.211497:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196640896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757761.211540:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196640896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757761.211548:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1060 00010000:00010000:3.0:1782757761.518810:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757761.520670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757761.522111:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641408 00000100:00100000:3.0:1782757761.522122:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641408 00000100:00100000:3.0:1782757761.522175:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 636 00000100:00100000:3.0:1782757761.522185:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43068:x1869355196641408:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782757761.522204:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757761.522226:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d99f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6475e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522293:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522308:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522320:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757761.522526:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:3.0:1782757761.522531:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757761.522614:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522640:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d99f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6475e expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522666:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6475e expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.522674:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757761.523217:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757761.523223:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782757761.523282:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43068:x1869355196641408:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1097us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757761.523290:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 636 00000100:00100000:1.0:1782757761.537036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757761.537121:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641664 00000100:00100000:3.0:1782757761.537131:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641664 00000100:00100000:3.0:1782757761.537188:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 637 00000100:00100000:3.0:1782757761.537198:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43068:x1869355196641664:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757761.537253:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757761.537282:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6475e expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.537298:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9990) 00010000:00010000:3.0:1782757761.537302:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757761.537313:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757761.537338:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.537351:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.537371:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782757761.597563:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967541 is committed 00000004:00010000:3.0:1782757761.597726:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b77baa49 reply state 00000000aceb2d7b transno 4294967541 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757761.597740:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757761.598311:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:3.0:1782757761.598425:0:5803:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782757761.598444:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43068:x1869355196641664:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 61242us (61550us total) trans 4294967541 rc 0/0 00000100:00100000:3.0:1782757761.598454:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 637 00010000:00010000:3.0:1782757761.606040:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606058:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606066:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606071:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757761.606077:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606085:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606105:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782757761.606109:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782757761.606113:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757761.606125:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9a07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757761.964298:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757761.964322:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211498496:0@lo:400:kworker.0 00000100:00100000:0.0:1782757761.964403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757761.964465:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498496 00000100:00100000:0.0:1782757761.964473:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498496 00000100:00100000:0.0:1782757761.964512:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1782757761.964521:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211498496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757761.964570:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211498496:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757761.964577:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1782757761.964626:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211498496:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.964781:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211498880:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.964813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757761.964858:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757761.964864:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211499008:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.964890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757761.964918:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498880 00000100:00100000:1.0:1782757761.964922:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498880 00000100:00100000:1.0:1782757761.964957:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1782757761.964964:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211498880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.965000:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211498880:12345-0@lo:400:kworker.0 Request processed in 37us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.965006:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1782757761.965027:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499008 00000100:00100000:1.0:1782757761.965031:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499008 00000100:00100000:1.0:1782757761.965058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1782757761.965064:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.965094:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211499008:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.965100:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00080000:1.0:1782757761.965116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757761.965121:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757761.965146:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211499008:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.965156:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211498880:0@lo:400:kworker.0 00000100:00100000:3.0:1782757761.965290:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211498624:0@lo:400:kworker.0 00000100:00100000:3.0:1782757761.965320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757761.965360:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211499136:0@lo:400:kworker.0 00000100:00100000:3.0:1782757761.965383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757761.965399:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757761.965404:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211498752:0@lo:400:kworker.0 00000100:00100000:3.0:1782757761.965424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757761.965723:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498624 00000100:00100000:1.0:1782757761.965728:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498624 00000100:00100000:1.0:1782757761.965759:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211498752 00000100:00100000:1.0:1782757761.965763:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211498752 00000100:00100000:1.0:1782757761.965802:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1782757761.965809:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211498624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.965871:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211498624:12345-0@lo:400:kworker.0 Request processed in 61us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.965878:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1782757761.965892:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1782757761.965898:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211498752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.965925:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211498752:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.965931:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1782757761.965949:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499136 00000100:00100000:1.0:1782757761.965952:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499136 00000100:00100000:1.0:1782757761.965975:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1782757761.965981:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211499136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782757761.966105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757761.966109:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757761.966200:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211499136:12345-0@lo:400:kworker.0 Request processed in 218us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757761.966207:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1782757761.966311:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211498752:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.966321:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211498624:0@lo:400:kworker.0 00000100:00100000:1.0:1782757761.966329:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211499136:0@lo:400:kworker.0 00000100:00100000:0.0:1782757762.488496:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211499264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757762.488564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757762.488784:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499264 00000100:00100000:2.0:1782757762.488793:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499264 00000100:00100000:2.0:1782757762.488857:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1782757762.488868:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211499264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757762.488909:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757762.488978:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211499264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757762.488985:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1782757762.489149:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211499264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757762.547543:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757763.069968:0:74062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5448a230 20000000:00000080:3.0:1782757763.069995:0:74062:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba94400 uarg=0000000000000000 00010000:00010000:3.0:1782757763.070614:0:74062:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757763.070633:0:74062:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757763.075954:0:74062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757763.076002:0:74062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.076028:0:74062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.076039:0:74062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.076098:0:74062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.076122:0:74062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 18 pid: 5794 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757763.076142:0:74062:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74062:1869355211499392:0@lo:104: 00000100:00100000:3.0:1782757763.076245:0:74062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757763.076339:0:74062:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c45480 going to sleep for 11 seconds 00000100:00100000:0.0:1782757763.077658:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499392 00000100:00100000:0.0:1782757763.077672:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499392 00000100:00100000:0.0:1782757763.077738:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1782757763.077748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74062:x1869355211499392:12345-0@lo:104: 00010000:00010000:0.0:1782757763.077767:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757763.077894:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757763.077901:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74062:x1869355211499392:12345-0@lo:104: Request processed in 155us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757763.077908:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:1.0:1782757763.078031:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757763.078038:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078047:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757763.078050:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078060:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757763.078068:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757763.078074:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757763.078115:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078121:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757763.078141:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078148:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d99eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d99f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078167:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757763.078169:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757763.078171:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757763.078183:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211499520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757763.078221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757763.078270:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499520 00000100:00100000:1.0:1782757763.078274:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499520 00010000:00010000:1.0:1782757763.078294:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 19 pid: 5794 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757763.078317:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782757763.078324:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211499520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757763.078348:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757763.078354:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 19 pid: 5794 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078364:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 19 pid: 5794 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078382:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078391:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078407:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078414:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078421:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078427:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078432:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757763.078437:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078445:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078459:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.078468:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757763.078494:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211499520:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757763.078500:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782757763.078539:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211499520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757763.078763:0:74062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d99f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d99eb expref: 18 pid: 5794 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757763.078782:0:74062:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74062:1869355211499392:0@lo:104: 00010000:00010000:3.0:1782757763.078812:0:74062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.078841:0:74062:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.078859:0:74062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757763.078867:0:74062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9a0e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757763.604970:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782757764.291983:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757764.291989:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757764.291993:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757764.292034:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292046:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292058:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757764.292082:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211499648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757764.292144:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757764.292192:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782757764.292211:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499648 00000100:00100000:0.0:1782757764.292217:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499648 00000100:00100000:0.0:1782757764.292256:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1782757764.292277:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211499648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757764.292290:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757764.292301:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9a15 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292333:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292343:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292353:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147e00, rc 0) 00000100:00100000:0.0:1782757764.292386:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211499648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757764.292396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1782757764.292456:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211499648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757764.292470:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292479:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757764.292496:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757764.292501:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757764.292509:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757764.655536:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757765.036471:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757765.036492:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211499776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757765.036571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757765.036702:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499776 00000100:00100000:0.0:1782757765.036710:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499776 00000100:00100000:0.0:1782757765.036777:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1782757765.036788:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211499776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757765.036819:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757765.036887:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211499776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757765.036893:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1782757765.036944:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211499776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757765.037193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757765.692120:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757766.329194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757766.329246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757766.329289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757766.329316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757766.329340:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641920 00000100:00100000:3.0:1782757766.329350:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641920 00000100:00100000:0.0:1782757766.329486:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642048 00000100:00100000:0.0:1782757766.329490:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642048 00000100:00100000:0.0:1782757766.329564:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642176 00000100:00100000:0.0:1782757766.329567:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642176 00000100:00100000:0.0:1782757766.329592:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 942 00000100:00100000:0.0:1782757766.329603:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196642048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757766.329671:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196642048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757766.329679:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 942 00000100:00100000:0.0:1782757766.329704:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00100000:0.0:1782757766.329710:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196642176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757766.329731:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196642176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757766.329737:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00100000:3.0:1782757766.329807:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:3.0:1782757766.329814:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196641920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757766.329864:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196641920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 50us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757766.329870:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:2.0:1782757766.330038:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196641792 00000100:00100000:2.0:1782757766.330043:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196641792 00000100:00100000:2.0:1782757766.330077:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00100000:2.0:1782757766.330084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196641792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757766.330118:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196641792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757766.330124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00080000:2.0:1782757766.330149:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757766.330153:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757766.330155:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757766.705605:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757767.086139:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211499904:0@lo:400:kworker.0 00000100:00100000:3.0:1782757767.086221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757767.089813:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211499904 00000100:00100000:2.0:1782757767.089854:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211499904 00000100:00100000:2.0:1782757767.089908:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1782757767.090282:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.093403:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211500032:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.093473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757767.093536:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500032 00000100:00100000:1.0:1782757767.093544:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500032 00000100:00100000:1.0:1782757767.093602:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1782757767.093610:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211500032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.096399:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211500032:12345-0@lo:400:kworker.0 Request processed in 2781us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.096412:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1782757767.096478:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211500032:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.096548:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211500160:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.097021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757767.097060:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500160 00000100:00100000:1.0:1782757767.097065:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500160 00000100:00100000:1.0:1782757767.097108:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1782757767.097115:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.097154:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211500160:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.097160:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00080000:1.0:1782757767.097175:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757767.097194:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211500160:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.097743:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211500288:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.097780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757767.097813:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500288 00000100:00100000:1.0:1782757767.097817:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500288 00000100:00100000:1.0:1782757767.097871:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1782757767.097879:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.097914:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211500288:12345-0@lo:400:kworker.0 Request processed in 36us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.099321:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00080000:1.0:1782757767.099549:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757767.101344:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211500288:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.101430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757767.101441:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211500416:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.102807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757767.102885:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500416 00000100:00100000:1.0:1782757767.102893:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500416 00000100:00100000:1.0:1782757767.103124:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1782757767.103135:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211500416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.103735:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211500416:12345-0@lo:400:kworker.0 Request processed in 65us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.103748:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:1.0:1782757767.103781:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757767.103816:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211500416:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.103887:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211500544:0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.103922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757767.103953:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500544 00000100:00100000:1.0:1782757767.103957:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500544 00000100:00100000:1.0:1782757767.103990:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1782757767.103996:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211500544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757767.104031:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211500544:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.104037:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00080000:1.0:1782757767.104051:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757767.104070:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211500544:0@lo:400:kworker.0 00000100:00100000:3.0:1782757767.174535:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211499904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757767.174536:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211499904:12345-0@lo:400:kworker.0 Request processed in 84610us (88306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757767.174557:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1782757767.582049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757767.582176:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642304 00000100:00100000:1.0:1782757767.582185:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642304 00000100:00100000:1.0:1782757767.582260:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 638 00000100:00100000:1.0:1782757767.582271:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43145:x1869355196642304:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782757767.582290:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757767.582314:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64765 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582385:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582399:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582415:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582429:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582436:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582442:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582952:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582963:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.582971:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757767.583057:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757767.583061:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757767.583144:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583157:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583163:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583174:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583180:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757767.583184:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583190:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583203:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782757767.583206:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757767.583210:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583217:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583228:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583235:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583254:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583260:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757767.583263:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583271:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583278:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782757767.583280:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757767.583283:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583289:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583323:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64765 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583338:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64765 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757767.583345:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782757767.583347:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757767.583349:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782757767.583420:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43145:x1869355196642304:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1151us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757767.583430:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 638 00000100:00100000:1.0:1782757767.597862:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211500672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757767.597942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757767.603225:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500672 00000100:00100000:2.0:1782757767.603250:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500672 00000100:00100000:3.0:1782757767.603404:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1782757767.603416:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211500672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757767.603460:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757767.603558:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211500672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (5614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757767.603567:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1782757767.603688:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211500672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757767.724560:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757768.776527:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782757769.489289:0:74305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7b1e1d90 20000000:00000080:0.0:1782757769.489306:0:74305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3473400 uarg=0000000000000000 00010000:00010000:0.0:1782757769.491177:0:74305:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782757769.491233:0:74305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:0.0:1782757769.491237:0:74305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782757769.491249:0:74305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64765 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757769.491273:0:74305:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782757769.491291:0:74305:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757769.491304:0:74305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757769.491318:0:74305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757769.491330:0:74305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757769.491367:0:74305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757769.491382:0:74305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 18 pid: 5794 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757769.491395:0:74305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74305:1869355211500800:0@lo:104: 00000100:00100000:0.0:1782757769.492804:0:74305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757769.492965:0:74305:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171872ea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782757769.508085:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500800 00000100:00100000:3.0:1782757769.508100:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500800 00000100:00100000:3.0:1782757769.508159:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1782757769.508168:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74305:x1869355211500800:12345-0@lo:104: 00010000:00010000:3.0:1782757769.508186:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757769.511250:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757769.511266:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74305:x1869355211500800:12345-0@lo:104: Request processed in 3095us (18463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757769.511278:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1782757769.511388:0:74305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74305:1869355211500800:0@lo:104: 00010000:00010000:0.0:1782757769.511415:0:74305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511725:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757769.511734:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511743:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757769.511747:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511757:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757769.511764:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757769.511769:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757769.511817:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511858:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757769.511901:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511908:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147200/0xdd99f5c4777d9a15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.511924:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757769.511925:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757769.511927:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757769.511981:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211500928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757769.512027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757769.512381:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211500928 00000100:00100000:1.0:1782757769.512388:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211500928 00010000:00010000:1.0:1782757769.512429:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757769.512468:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1782757769.512476:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211500928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757769.512490:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757769.512495:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512505:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512519:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193147e00/0xdd99f5c4777d9a1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9a15 expref: 19 pid: 5794 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512532:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512541:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512555:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512562:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512569:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512575:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512586:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757769.512590:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512596:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512617:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.512628:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757769.512665:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211500928:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757769.512672:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1782757769.512743:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211500928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757769.512768:0:74305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757769.512776:0:74305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757769.512783:0:74305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193146c00/0xdd99f5c4777d9a3f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757769.772105:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757770.156671:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757770.156703:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211501056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757770.156807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757770.157173:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501056 00000100:00100000:0.0:1782757770.157182:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501056 00000100:00100000:0.0:1782757770.157274:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1782757770.157287:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211501056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757770.157334:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757770.157393:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211501056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757770.157401:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00080000:1.0:1782757770.159374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757770.159450:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211501056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757770.797184:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782757771.243944:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757771.243956:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757771.243961:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757771.244033:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757771.244049:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757771.244060:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757771.244094:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211501184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757771.244203:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757771.244291:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171833440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782757771.244402:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501184 00000100:00100000:2.0:1782757771.244413:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501184 00000100:00100000:2.0:1782757771.244474:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1782757771.244497:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211501184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757771.244515:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757771.244531:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9a46 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757771.244559:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757771.244583:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757771.244595:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782757771.244657:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211501184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757771.244664:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1782757771.244750:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211501184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757771.244768:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757771.244777:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757771.244801:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757771.244806:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757771.244815:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757771.452304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757771.452350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757771.452382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757771.452412:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757771.456059:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642432 00000100:00100000:3.0:1782757771.456080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642432 00000100:00100000:3.0:1782757771.456151:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1066 00000100:00100000:3.0:1782757771.457305:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196642432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757771.457405:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642560 00000100:00100000:1.0:1782757771.457415:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642560 00000100:00100000:1.0:1782757771.457608:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1278 00000100:00100000:1.0:1782757771.457620:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757771.457677:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757771.457684:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1278 00000100:00100000:1.0:1782757771.457725:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642816 00000100:00100000:1.0:1782757771.457729:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642816 00000100:00100000:1.0:1782757771.457760:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642688 00000100:00100000:1.0:1782757771.457764:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642688 00000100:00100000:1.0:1782757771.457791:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:1.0:1782757771.457798:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757771.457845:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (5495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757771.457852:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:1.0:1782757771.457868:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00100000:1.0:1782757771.457875:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757771.457900:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196642688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (5487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757771.457907:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00080000:1.0:1782757771.457944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757771.457949:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757771.457952:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757771.458023:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196642432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1861us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757771.458034:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1066 00010000:00010000:0.0:1782757771.820129:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757772.206673:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211501440:0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.206759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757772.206852:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211501952:0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.206880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757772.206910:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757772.206916:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211501568:0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.206938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757772.207081:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211501312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757772.207163:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211501824:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757772.207204:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757772.207209:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211501696:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757772.207263:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501952 00000100:00100000:2.0:1782757772.207270:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501952 00000100:00100000:2.0:1782757772.207322:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501696 00000100:00100000:2.0:1782757772.207324:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501696 00000100:00100000:2.0:1782757772.207356:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1782757772.207365:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211501952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207419:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211501952:12345-0@lo:400:kworker.0 Request processed in 54us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757772.207426:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1782757772.207441:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1782757772.207447:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211501696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207482:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211501696:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757772.207487:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:2.0:1782757772.207505:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757772.207509:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757772.207541:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211501696:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.207569:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211501952:0@lo:400:kworker.0 00000100:00100000:3.0:1782757772.207670:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501440 00000100:00100000:0.0:1782757772.207745:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501312 00000100:00100000:0.0:1782757772.207750:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501312 00000100:00100000:0.0:1782757772.207787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1782757772.207794:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211501312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757772.207844:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501440 00000100:00100000:0.0:1782757772.207848:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211501312:12345-0@lo:400:kworker.0 Request processed in 54us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757772.207853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1782757772.207871:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501568 00000100:00100000:3.0:1782757772.207874:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501568 00000100:00100000:3.0:1782757772.207895:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211501824 00000100:00100000:3.0:1782757772.207898:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211501824 00000100:00100000:0.0:1782757772.207907:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1782757772.207914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211501440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757772.207915:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1782757772.207920:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211501568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.207947:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211501440:12345-0@lo:400:kworker.0 Request processed in 34us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757772.207948:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211501568:12345-0@lo:400:kworker.0 Request processed in 29us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757772.207954:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1782757772.208050:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211501312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.208074:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211501568:0@lo:400:kworker.0 00000100:00100000:2.0:1782757772.208084:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211501440:0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.209367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1782757772.209395:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1782757772.209409:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211501824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.209483:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211501824:12345-0@lo:400:kworker.0 Request processed in 81us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757772.209490:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00080000:3.0:1782757772.213116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757772.213955:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211501824:0@lo:400:kworker.0 00000100:00100000:0.0:1782757772.715524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757772.715599:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196642944 00000100:00100000:1.0:1782757772.715613:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196642944 00000100:00100000:1.0:1782757772.715684:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 639 00000100:00100000:1.0:1782757772.715695:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43238:x1869355196642944:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757772.715723:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757772.715748:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6476c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.715814:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.715861:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.715874:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757772.716077:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757772.716082:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757772.716173:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.716201:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9a54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6476c expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.716223:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6476c expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.716232:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757772.716234:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757772.716238:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782757772.716299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43238:x1869355196642944:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 605us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757772.716306:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 639 00000100:00100000:2.0:1782757772.720928:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211502080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757772.721006:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757772.721518:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502080 00000100:00100000:3.0:1782757772.721527:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502080 00000100:00100000:3.0:1782757772.721592:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1782757772.721601:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211502080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757772.721639:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757772.721700:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211502080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757772.721708:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1782757772.721922:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211502080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757772.728686:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757772.731123:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643200 00000100:00100000:3.0:1782757772.731137:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643200 00000100:00100000:3.0:1782757772.731221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 640 00000100:00100000:3.0:1782757772.731232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43238:x1869355196643200:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757772.731302:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757772.731331:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9a5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6476c expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757772.731348:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9a38) 00010000:00010000:3.0:1782757772.731352:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:3.0:1782757772.731366:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757772.731398:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757772.731410:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757772.731419:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782757772.791170:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967542 is committed 00000004:00010000:3.0:1782757772.791215:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed70eb31 reply state 000000004c0b328d transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757772.791230:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757772.791409:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:3.0:1782757772.791815:0:5802:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782757772.791866:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43238:x1869355196643200:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 60630us (63184us total) trans 4294967542 rc 0/0 00000100:00100000:3.0:1782757772.791877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 640 00010000:00010000:2.0:1782757772.794870:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794887:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794895:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794901:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757772.794906:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794918:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794934:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782757772.794937:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757772.794942:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757772.794948:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9a62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757772.844194:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757773.869299:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757774.060922:0:74503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4c68b970 20000000:00000080:1.0:1782757774.060940:0:74503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5a400 uarg=0000000000000000 00010000:00010000:1.0:1782757774.062251:0:74503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757774.062271:0:74503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757774.062286:0:74503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757774.062304:0:74503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.062321:0:74503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.062330:0:74503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.062369:0:74503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.062383:0:74503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 18 pid: 5794 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757774.062399:0:74503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74503:1869355211502208:0@lo:104: 00000100:00100000:1.0:1782757774.062632:0:74503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757774.062737:0:74503:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782757774.063278:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502208 00000100:00100000:2.0:1782757774.063285:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502208 00000100:00100000:2.0:1782757774.063334:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1782757774.063344:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74503:x1869355211502208:12345-0@lo:104: 00010000:00010000:2.0:1782757774.063356:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757774.063790:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757774.063798:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74503:x1869355211502208:12345-0@lo:104: Request processed in 455us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757774.063806:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782757774.065775:0:74503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74503:1869355211502208:0@lo:104: 00010000:00010000:0.0:1782757774.065804:0:74503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066417:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757774.066426:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066578:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757774.066582:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066593:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757774.066601:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757774.066607:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757774.066689:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066695:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757774.066729:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066736:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147400/0xdd99f5c4777d9a46 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.066752:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757774.066754:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757774.066755:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757774.068355:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211502336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757774.068568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757774.068681:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502336 00000100:00100000:1.0:1782757774.068690:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502336 00010000:00010000:1.0:1782757774.068726:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757774.068764:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1782757774.068773:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211502336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757774.068787:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757774.068791:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068803:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068820:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9a4d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9a46 expref: 19 pid: 5794 timeout: 1942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068857:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068864:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068881:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068888:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068895:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068900:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068906:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757774.068910:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068917:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068929:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757774.068942:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757774.068978:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211502336:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757774.068985:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:0.0:1782757774.069229:0:74503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757774.069237:0:74503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757774.069243:0:74503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9a69 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757774.070306:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211502336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757774.892083:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757775.275918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757775.275941:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211502464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757775.276006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757775.278760:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502464 00000100:00100000:3.0:1782757775.278773:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502464 00000100:00100000:3.0:1782757775.278852:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1782757775.278862:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211502464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757775.278897:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757775.278965:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211502464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757775.278971:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1782757775.279018:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211502464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757775.279670:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1782757775.673336:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757775.673345:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757775.673349:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757775.674003:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757775.674021:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757775.674035:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757775.674061:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211502592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757775.674140:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757775.674209:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171986f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782757775.674267:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502592 00000100:00100000:2.0:1782757775.674275:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502592 00000100:00100000:2.0:1782757775.681313:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1782757775.681332:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211502592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757775.681350:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757775.681369:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9a70 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757775.681396:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757775.681408:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757775.681417:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782757775.681506:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211502592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (7366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757775.681513:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1782757775.682801:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211502592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757775.682849:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757775.682860:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757775.682882:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757775.682888:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757775.682895:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757775.915987:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757776.568120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757776.568334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757776.568361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757776.568393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757776.568429:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643456 00000100:00100000:3.0:1782757776.568439:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643456 00000100:00100000:3.0:1782757776.568764:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1282 00000100:00100000:3.0:1782757776.568936:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196643456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757776.569020:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196643456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757776.569028:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1282 00000100:00100000:3.0:1782757776.569053:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643584 00000100:00100000:3.0:1782757776.569057:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643584 00000100:00100000:3.0:1782757776.569095:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643712 00000100:00100000:3.0:1782757776.569099:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643712 00000100:00100000:3.0:1782757776.569123:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00100000:3.0:1782757776.569130:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196643584:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782757776.569148:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d984e 00000100:00080000:3.0:1782757776.569156:0:6597:0:(import.c:65:import_set_state_nolock()) ffff91708297e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782757776.569196:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967335 00000100:00100000:3.0:1782757776.572053:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196643584:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 2912us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757776.572079:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00100000:3.0:1782757776.572118:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 345 00000100:00100000:3.0:1782757776.572131:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196643712:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782757776.572159:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9974 00000100:00080000:3.0:1782757776.572170:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917183836800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782757776.572211:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967335 00000100:00080000:2.0:1782757776.574050:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757776.574058:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757776.574061:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757776.574728:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643328 00000100:00100000:1.0:1782757776.574739:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643328 00000100:00100000:0.0:1782757776.574877:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1069 00000100:00100000:0.0:1782757776.574888:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196643328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757776.576087:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196643328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1195us (7971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757776.576099:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1069 00010000:00010000:0.0:1782757776.577050:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757776.577057:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757776.577317:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196643712:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 5186us (8929us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757776.577328:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 345 00000001:00100000:0.0:1782757776.889454:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782757776.889475:0:7507:0:(genops.c:906:class_export_put()) final put ffff917183830800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782757776.889627:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917183830800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:3.0:1782757776.889672:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917183836800 for lustre-OST0001 00000001:00100000:0.0:1782757776.910029:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782757776.910039:0:6622:0:(genops.c:906:class_export_put()) final put ffff91708297c000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782757776.912266:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff91708297c000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:3.0:1782757776.912324:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91708297e800 for lustre-OST0000 00010000:00010000:3.0:1782757776.941134:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757777.324112:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211502976:0@lo:400:kworker.0 00000100:00100000:3.0:1782757777.324182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757777.324240:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757777.324246:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211503104:0@lo:400:kworker.0 00000100:00100000:3.0:1782757777.324273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757777.324468:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502976 00000100:00100000:3.0:1782757777.324476:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502976 00000100:00100000:3.0:1782757777.324527:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1782757777.324536:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211502976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757777.324584:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211502976:12345-0@lo:400:kworker.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757777.324591:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1782757777.324626:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211502976:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.324760:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211502848:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.324789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757777.324816:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211503360:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.324860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757777.324878:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782757777.324884:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211502720:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.324907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757777.324929:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211503232:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.324948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757777.324971:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502720 00000100:00100000:1.0:1782757777.324974:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502720 00000100:00100000:1.0:1782757777.324998:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1782757777.325003:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.325033:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211502720:12345-0@lo:400:kworker.0 Request processed in 29us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.325040:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1782757777.325078:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211502848 00000100:00100000:1.0:1782757777.325081:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211502848 00000100:00100000:1.0:1782757777.325096:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503232 00000100:00100000:1.0:1782757777.325098:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503232 00000100:00100000:1.0:1782757777.325114:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1782757777.325119:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.325144:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211502848:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.325149:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1782757777.325159:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1782757777.325164:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.325187:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211503232:12345-0@lo:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.325193:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1782757777.325221:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211502720:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.325231:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211503232:0@lo:400:kworker.0 00000100:00100000:1.0:1782757777.325239:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211502848:0@lo:400:kworker.0 00000100:00100000:2.0:1782757777.325972:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503104 00000100:00100000:2.0:1782757777.325978:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503104 00000100:00100000:2.0:1782757777.326017:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503360 00000100:00100000:2.0:1782757777.326020:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503360 00000100:00100000:2.0:1782757777.326040:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1782757777.326047:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757777.326100:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211503104:12345-0@lo:400:kworker.0 Request processed in 54us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757777.326107:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1782757777.326119:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:2.0:1782757777.326124:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211503360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757777.326150:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211503360:12345-0@lo:400:kworker.0 Request processed in 26us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757777.326156:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:2.0:1782757777.326171:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757777.326174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757777.326176:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757777.326217:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211503104:0@lo:400:kworker.0 00000100:00100000:2.0:1782757777.326242:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211503360:0@lo:400:kworker.0 00000100:00100000:2.0:1782757777.468951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757777.469530:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196643840 00000100:00100000:1.0:1782757777.469541:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196643840 00000100:00100000:1.0:1782757777.469603:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00100000:1.0:1782757777.469616:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43316:x1869355196643840:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782757777.469639:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757777.469666:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64773 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469742:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469757:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469770:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469781:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469792:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.469798:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471503:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471532:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471541:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757777.471614:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757777.471618:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757777.471684:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471702:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471709:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471716:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471722:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757777.471727:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471734:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471747:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782757777.471749:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757777.471753:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471759:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471770:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471776:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471781:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471786:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757777.471789:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471795:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471802:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782757777.471804:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757777.471808:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471814:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9a8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471871:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64773 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471887:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64773 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.471894:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757777.471897:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757777.471899:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782757777.471957:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43316:x1869355196643840:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2345us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.471965:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00100000:0.0:1782757777.492460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757777.492539:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644096 00000100:00100000:2.0:1782757777.492548:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644096 00000100:00100000:2.0:1782757777.492609:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 642 00000100:00100000:2.0:1782757777.492625:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43316:x1869355196644096:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757777.492647:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757777.492666:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9a9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6477a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493014:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493029:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493040:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493065:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493072:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.493080:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782757777.493777:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:2.0:1782757777.494056:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9aaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494067:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494075:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494110:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494118:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494124:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494130:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757777.494134:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494142:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494158:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:2.0:1782757777.494161:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757777.494166:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494172:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9aa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757777.494185:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b982091 reply state 000000009811623e transno 4294967543 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757777.494193:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782757777.494220:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9a9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6477a expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494233:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6477a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.494240:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782757777.494243:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782757777.494245:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694600, rc 0) 00000100:00100000:2.0:1782757777.494313:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43316:x1869355196644096:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1689us (1862us total) trans 4294967543 rc 0/0 00000100:00100000:2.0:1782757777.494320:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 642 00010000:00010000:3.0:1782757777.496484:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496498:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496506:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496511:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757777.496515:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496522:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496536:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917182dd1300) 00010000:00010000:3.0:1782757777.496539:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757777.496542:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757777.496549:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9aa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757777.499988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757777.500261:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644352 00000100:00100000:2.0:1782757777.500270:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644352 00000100:00100000:2.0:1782757777.500360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 643 00000100:00100000:2.0:1782757777.500380:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43316:x1869355196644352:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:2.0:1782757777.500434:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757777.500461:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9aaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6477a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.500479:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782757777.500488:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757777.500529:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.500542:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.500552:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757777.500695:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9c18140 reply state 000000004a2a6030 transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757777.500704:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757777.500791:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43316:x1869355196644352:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 412us (810us total) trans 4294967544 rc 0/0 00000100:00100000:2.0:1782757777.500798:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 643 00010000:00010000:2.0:1782757777.507972:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.507988:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.507997:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.508008:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757777.508013:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.508021:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.508037:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782757777.508040:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757777.508057:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.508063:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9abd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757777.511207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757777.511405:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644480 00000100:00100000:1.0:1782757777.511415:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644480 00000100:00100000:1.0:1782757777.511473:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 644 00000100:00100000:1.0:1782757777.511483:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43316:x1869355196644480:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782757777.511506:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757777.511526:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64781 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.511581:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64781 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.511595:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64781 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.511625:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782757777.511628:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782757777.511631:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782757777.511685:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43316:x1869355196644480:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 203us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.511693:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 644 00000100:00100000:0.0:1782757777.523859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757777.524330:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644608 00000100:00100000:2.0:1782757777.524342:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644608 00000100:00100000:2.0:1782757777.524391:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 346 00000100:00100000:2.0:1782757777.524398:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196644608:12345-192.168.204.31@tcp:8:touch.60003 00010000:00080000:2.0:1782757777.524429:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1845 last 0 00000020:00000080:2.0:1782757777.524471:0:6598:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d9acb 00002000:00100000:2.0:1782757777.524484:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917191a80000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782757777.524505:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782757777.524883:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782757777.524909:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917191a81800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782757777.534150:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196644608:12345-192.168.204.31@tcp:8:touch.60003 Request processed in 9739us (10326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757777.534309:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 346 00000100:00100000:1.0:1782757777.544096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757777.544185:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644736 00000100:00100000:0.0:1782757777.544195:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644736 00000100:00080000:2.0:1782757777.544276:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757777.544282:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 347 00000100:00100000:0.0:1782757777.544295:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196644736:12345-192.168.204.31@tcp:2:touch.60003 00000001:00080000:3.0:1782757777.665108:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000001:00100000:3.0:1782757777.665128:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:1.0:1782757777.665278:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196644736:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 120980us (121186us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1782757777.665290:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 347 00000100:00100000:3.0:1782757777.667431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757777.669549:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196644992 00000100:00100000:1.0:1782757777.669560:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196644992 00000100:00100000:1.0:1782757777.669668:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:1.0:1782757777.669679:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43316:x1869355196644992:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:1.0:1782757777.670027:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:43316:x1869355196644992:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 349us (2602us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1782757777.670035:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:3.0:1782757777.753147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757777.753664:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645120 00000100:00100000:0.0:1782757777.753675:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645120 00000100:00100000:0.0:1782757777.753742:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 645 00000100:00100000:0.0:1782757777.753753:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:43320:x1869355196645120:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:0.0:1782757777.753777:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757777.753797:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9ad2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64788 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753898:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753913:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753926:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753941:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753948:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.753955:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754058:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754066:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754072:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757777.754107:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00000004:00200000:0.0:1782757777.754111:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757777.754129:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754141:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754149:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754160:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754167:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754173:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757777.754177:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754184:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754195:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:0.0:1782757777.754198:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757777.754202:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754221:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754227:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754233:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754238:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757777.754241:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754247:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754253:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff91718bcfd300) 00010000:00010000:0.0:1782757777.754255:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757777.754258:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754264:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754297:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147400/0xdd99f5c4777d9ad2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64788 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754309:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64788 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.754316:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:0.0:1782757777.754319:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757777.754321:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147200, rc 0) 00000100:00100000:0.0:1782757777.754386:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:43320:x1869355196645120:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 635us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757777.754393:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 645 00000100:00100000:3.0:1782757777.772070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757777.774142:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645248 00000100:00100000:2.0:1782757777.774155:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645248 00000100:00100000:2.0:1782757777.774220:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 348 00000100:00100000:2.0:1782757777.774230:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196645248:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:2.0:1782757777.774246:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757777.774265:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6478f expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782757777.774289:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x6a42b990, atime: 0x6a42b990, ctime: 0x6a42b990, blocks: 0x1 00010000:00010000:2.0:1782757777.774310:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1846s v=(0 0) 00010000:00010000:2.0:1782757777.774314:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757777.774323:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.774341:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.774354:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782757777.774420:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196645248:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 192us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757777.774427:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 348 00000100:00100000:3.0:1782757777.789596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757777.790033:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645504 00000100:00100000:2.0:1782757777.790053:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645504 00000100:00100000:2.0:1782757777.790109:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:2.0:1782757777.790118:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:43320:x1869355196645504:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782757777.790170:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757777.790195:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147200/0xdd99f5c4777d9ae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64788 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790217:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64781 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790227:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782757777.790237:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757777.790258:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790270:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790280:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790292:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790299:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790305:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790418:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790426:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.790433:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757777.792300:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:2.0:1782757777.792313:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1846195489530ns, next at 1847195487377ns, rc = 0 00010000:00010000:2.0:1782757777.792535:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.792547:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.792557:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793746:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793755:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793761:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793836:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757777.793862:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793869:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793876:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793881:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757777.793886:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793894:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793906:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782757777.793909:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757777.793913:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793919:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9b03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793937:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793944:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793950:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793954:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757777.793957:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793963:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793970:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:2.0:1782757777.793972:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757777.793975:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.793981:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9af5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757777.793989:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067ecdac4 reply state 00000000625e34f7 transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757777.793998:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757777.794093:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:43320:x1869355196645504:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 3973us (4502us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1782757777.794102:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 646 00010000:00010000:2.0:1782757777.803491:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803507:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803515:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803522:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757777.803526:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803534:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803551:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917182dd1500) 00010000:00010000:2.0:1782757777.803554:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757777.803568:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.803576:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9afc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809225:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757777.809240:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809257:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757777.809261:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809272:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809292:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:0.0:1782757777.809295:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782757777.809299:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809308:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9b0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757777.809332:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757777.809334:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757777.809336:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757777.836473:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211503488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757777.836547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757777.836720:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503488 00000100:00100000:3.0:1782757777.836728:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503488 00000100:00100000:3.0:1782757777.836776:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1782757777.836785:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211503488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757777.836818:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757777.836878:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211503488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757777.836885:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1782757777.837090:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211503488:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1782757777.928884:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967545 is committed 00000001:00080000:3.0:1782757777.928902:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967546 is committed 00000004:00080000:3.0:1782757777.928906:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000100:00100000:3.0:1782757777.929176:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211503616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757777.929239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757777.929746:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503616 00000100:00100000:1.0:1782757777.929753:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503616 00000100:00100000:1.0:1782757777.929800:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1782757777.929809:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211503616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782757777.929850:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00010000:00010000:1.0:1782757777.929872:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.929893:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.929902:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757777.929906:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757777.929911:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.929935:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.929949:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 5 pid: 6597 timeout: 1946 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757777.929962:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211503744:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782757777.930023:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171872eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782757777.934725:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211503744:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782757777.934754:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757777.935650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757777.935892:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645632 00000100:00100000:1.0:1782757777.935900:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645632 00010000:00010000:1.0:1782757777.935932:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 1946 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757777.935964:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:1.0:1782757777.935973:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196645632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757777.935987:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757777.935992:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 1946 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.936004:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 1946 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.936026:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777d9aee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6478f expref: 6 pid: 6597 timeout: 1946 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.936053:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757777.936058:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757777.936064:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.936075:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.936106:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757777.936153:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196645632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 180us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757777.936161:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 343 00010000:00010000:2.0:1782757777.936223:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.936233:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.936242:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.936250:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757777.936273:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782757777.936789:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211503616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6980us (7547us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1782757777.936796:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000004:00080000:2.0:1782757777.936866:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170835fad80/2, rc 0, transno 4294967337 00000100:00100000:2.0:1782757777.936873:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211503616:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782757777.937516:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757777.937523:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.937534:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757777.937538:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.937548:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.937562:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.937569:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012b1a8c8/0xdd99f5c4777d9b11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757777.937587:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757777.937589:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757777.937591:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757777.969546:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757778.988279:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757779.472516:0:74751:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe77dcff50 20000000:00000080:3.0:1782757779.472536:0:74751:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb937400 uarg=0000000000000000 00010000:00010000:3.0:1782757779.473116:0:74751:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782757779.473154:0:74751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:3.0:1782757779.473158:0:74751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757779.473170:0:74751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9a93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64773 expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757779.473194:0:74751:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782757779.473210:0:74751:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757779.473225:0:74751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757779.473244:0:74751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757779.473253:0:74751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757779.473300:0:74751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757779.473314:0:74751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 18 pid: 5794 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757779.473328:0:74751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74751:1869355211503872:0@lo:104: 00000100:00100000:3.0:1782757779.473400:0:74751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757779.473475:0:74751:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b766a540 going to sleep for 11 seconds 00000100:00100000:0.0:1782757779.473558:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782757779.473571:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211503872 00000100:00100000:0.0:1782757779.473580:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211503872 00000100:00100000:0.0:1782757779.473636:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782757779.473649:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74751:x1869355211503872:12345-0@lo:104: 00010000:00010000:0.0:1782757779.473665:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757779.473742:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757779.473749:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74751:x1869355211503872:12345-0@lo:104: Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757779.473759:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1782757779.473771:0:74751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74751:1869355211503872:0@lo:104: 00010000:00010000:3.0:1782757779.473797:0:74751:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.473883:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757779.474108:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.474122:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757779.474126:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.474138:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757779.474147:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757779.474154:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757779.474218:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.474226:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757779.474275:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.474284:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193147600/0xdd99f5c4777d9a70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9a77 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757779.474320:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211504000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757779.474322:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757779.474328:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757779.474333:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757779.474371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757779.474781:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504000 00000100:00100000:1.0:1782757779.474787:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504000 00010000:00010000:1.0:1782757779.474812:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757779.474902:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1782757779.474915:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211504000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757779.474941:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757779.474947:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.474960:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.474978:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777d9a77 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9a70 expref: 19 pid: 5794 timeout: 1947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.474997:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475017:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475033:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475041:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475048:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475056:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475062:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757779.475067:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475074:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475095:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757779.475104:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757779.475161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211504000:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757779.475169:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:2.0:1782757779.475196:0:74751:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.475211:0:74751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757779.475219:0:74751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9b18 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757779.475549:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211504000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757780.020442:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757780.398519:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757780.398544:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211504128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757780.398612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757780.398673:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504128 00000100:00100000:2.0:1782757780.398679:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504128 00000100:00100000:2.0:1782757780.398726:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1782757780.398734:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211504128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757780.398770:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757780.398816:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211504128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757780.398847:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00080000:2.0:1782757780.398871:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757780.398906:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211504128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782757781.036142:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782757781.357955:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757781.357964:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757781.357980:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757781.358031:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757781.358043:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757781.358055:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757781.358079:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211504256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757781.358148:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757781.358206:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170824489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782757781.359407:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504256 00000100:00100000:1.0:1782757781.359418:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504256 00000100:00100000:1.0:1782757781.359478:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1782757781.359489:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211504256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757781.359506:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757781.359525:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9b1f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757781.359549:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757781.359559:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757781.359570:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757781.359637:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211504256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757781.359645:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1782757781.362451:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211504256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757781.362484:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757781.362498:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757781.362522:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757781.362527:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757781.362540:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757781.684782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757781.684852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757781.684888:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645888 00000100:00100000:2.0:1782757781.684899:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645888 00000100:00100000:0.0:1782757781.684934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757781.684982:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1286 00000100:00100000:0.0:1782757781.684982:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646016 00000100:00100000:0.0:1782757781.684988:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646016 00000100:00100000:2.0:1782757781.684997:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196645888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757781.685034:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 952 00000100:00100000:0.0:1782757781.685045:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196646016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757781.685112:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196646016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757781.685122:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196645760 00000100:00100000:0.0:1782757781.685126:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 952 00000100:00100000:1.0:1782757781.685129:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196645760 00000100:00100000:1.0:1782757781.685168:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:1.0:1782757781.685177:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196645760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757781.685208:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196645760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757781.685215:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:2.0:1782757781.685293:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196645888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 300us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757781.685301:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1286 00000100:00080000:2.0:1782757781.685322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757781.685328:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757782.060969:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757782.445209:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211504640:0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.445291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757782.445344:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757782.445351:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211504768:0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.445376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757782.445406:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504640 00000100:00100000:2.0:1782757782.445413:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504640 00000100:00100000:2.0:1782757782.445463:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1782757782.445471:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211504640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.445522:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211504640:12345-0@lo:400:kworker.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757782.445530:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1782757782.445557:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504768 00000100:00100000:2.0:1782757782.445560:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504768 00000100:00100000:2.0:1782757782.445585:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1782757782.445591:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211504768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.445623:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211504768:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757782.445629:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00080000:2.0:1782757782.445644:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757782.445648:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757782.445692:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211504768:0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.445703:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211504640:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.446391:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211504512:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.446432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757782.446476:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211505024:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.446500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757782.446521:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782757782.446528:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211504384:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.446555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757782.446576:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211504896:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.446597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757782.446647:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505024 00000100:00100000:0.0:1782757782.446651:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505024 00000100:00100000:0.0:1782757782.446755:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1782757782.446764:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211505024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.447096:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211505024:12345-0@lo:400:kworker.0 Request processed in 332us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757782.447103:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1782757782.447129:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504384 00000100:00100000:0.0:1782757782.447132:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504384 00000100:00100000:0.0:1782757782.447159:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1782757782.447165:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211504384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.447196:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211504384:12345-0@lo:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757782.447202:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1782757782.447230:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504512 00000100:00100000:0.0:1782757782.447234:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504512 00000100:00100000:0.0:1782757782.447256:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211504896 00000100:00100000:3.0:1782757782.448392:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211504384:0@lo:400:kworker.0 00000100:00100000:3.0:1782757782.448410:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211505024:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.448606:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211504896 00000100:00100000:0.0:1782757782.448801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1782757782.448814:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211504512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.448901:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211504512:12345-0@lo:400:kworker.0 Request processed in 89us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757782.464104:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1782757782.464134:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211504896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757782.464233:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211504896:12345-0@lo:400:kworker.0 Request processed in 116us (17633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757782.464241:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00080000:2.0:1782757782.466959:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757782.466970:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757782.467637:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1782757782.467759:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211504896:0@lo:400:kworker.0 00000100:00100000:0.0:1782757782.467775:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211504512:0@lo:400:kworker.0 00000100:00100000:3.0:1782757782.806343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757782.807098:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646144 00000100:00100000:1.0:1782757782.807109:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646144 00000100:00100000:1.0:1782757782.807175:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 647 00000100:00100000:1.0:1782757782.807191:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43410:x1869355196646144:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757782.807211:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757782.807233:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9b2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64796 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807299:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807312:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807325:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757782.807515:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757782.807519:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757782.807592:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807617:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9b2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64796 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807636:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64796 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.807644:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:1.0:1782757782.807647:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757782.807651:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782757782.807716:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43410:x1869355196646144:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 530us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757782.807723:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 647 00000100:00100000:0.0:1782757782.815555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757782.820819:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646400 00000100:00100000:2.0:1782757782.820862:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646400 00000100:00100000:2.0:1782757782.820950:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 648 00000100:00100000:2.0:1782757782.820962:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43410:x1869355196646400:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782757782.821020:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757782.821055:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9b34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64796 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757782.821077:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9a93) 00010000:00010000:2.0:1782757782.821083:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:2.0:1782757782.821095:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757782.821127:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757782.821139:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757782.821149:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757782.821605:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b838a989 reply state 000000003c8ef6e0 transno 4294967547 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757782.821616:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782757782.821685:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000100:00100000:2.0:1782757782.821792:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43410:x1869355196646400:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 831us (6246us total) trans 4294967547 rc 0/0 00000100:00100000:2.0:1782757782.821799:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 648 00010000:00010000:1.0:1782757782.831214:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831230:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831238:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831244:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757782.831249:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831259:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831275:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782757782.831278:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757782.831283:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757782.831289:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777d9b3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757782.957122:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211505152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757782.957192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757782.957273:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505152 00000100:00100000:2.0:1782757782.957281:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505152 00000100:00100000:2.0:1782757782.957321:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1782757782.957330:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211505152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757782.957368:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757782.957413:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211505152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757782.957434:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1782757782.957686:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211505152:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1782757782.997792:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967547 is committed 00000001:00080000:3.0:1782757782.998063:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00010000:00010000:1.0:1782757783.084283:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757783.497294:0:74950:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda31e1ef0 20000000:00000080:1.0:1782757783.497311:0:74950:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e6000 uarg=0000000000000000 00010000:00010000:1.0:1782757783.497768:0:74950:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757783.497779:0:74950:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757783.497790:0:74950:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757783.497805:0:74950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.497817:0:74950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.497858:0:74950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.497897:0:74950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.497909:0:74950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 18 pid: 5793 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757783.497921:0:74950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74950:1869355211505280:0@lo:104: 00000100:00100000:1.0:1782757783.497983:0:74950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757783.498078:0:74950:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718bdcb300 going to sleep for 11 seconds 00000100:00100000:2.0:1782757783.498151:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505280 00000100:00100000:2.0:1782757783.498158:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505280 00000100:00100000:2.0:1782757783.498206:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1782757783.498216:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74950:x1869355211505280:12345-0@lo:104: 00010000:00010000:2.0:1782757783.498229:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757783.498292:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757783.498299:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:74950:x1869355211505280:12345-0@lo:104: Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757783.498306:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:0.0:1782757783.498356:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757783.498362:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498371:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757783.498375:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498383:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757783.498390:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757783.498395:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782757783.498397:0:74950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74950:1869355211505280:0@lo:104: 00010000:00010000:3.0:1782757783.498414:0:74950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498460:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498472:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757783.498494:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498501:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917193146c00/0xdd99f5c4777d9b1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757783.498516:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757783.498518:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757783.498519:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757783.498579:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211505408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757783.498612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757783.498701:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505408 00000100:00100000:1.0:1782757783.498706:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505408 00010000:00010000:1.0:1782757783.498725:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757783.498755:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1782757783.498763:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211505408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757783.498778:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757783.498783:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498793:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498805:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9b1f expref: 19 pid: 5793 timeout: 1951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498816:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498844:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498858:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498871:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498877:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498882:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498887:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757783.498892:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498899:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498918:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757783.498939:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757783.498976:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211505408:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757783.498986:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:3.0:1782757783.499004:0:74950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757783.499012:0:74950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757783.499018:0:74950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777d9b42 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757783.499363:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211505408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757784.122293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757785.004102:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757785.004111:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757785.004116:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757785.004163:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757785.004176:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757785.004198:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757785.004233:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211505536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757785.004302:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757785.004361:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782757785.004392:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505536 00000100:00100000:1.0:1782757785.004400:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505536 00000100:00100000:1.0:1782757785.004454:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1782757785.004464:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211505536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757785.004478:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757785.004492:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9b49 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757785.004515:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757785.004526:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757785.004535:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757785.004574:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211505536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757785.004580:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1782757785.005038:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211505536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757785.005053:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757785.005062:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757785.005082:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757785.005088:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757785.005095:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757785.136108:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757785.516052:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211505664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757785.516125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757785.516237:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505664 00000100:00100000:2.0:1782757785.516245:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505664 00000100:00100000:2.0:1782757785.516306:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1782757785.516317:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211505664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757785.516351:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757785.516401:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211505664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757785.516408:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1782757785.516446:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:2.0:1782757785.516451:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170835fad80, transno 4294967337 00000100:00100000:2.0:1782757785.516467:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211505664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757785.517017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782757786.157749:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757786.787224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757786.787564:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646528 00000100:00100000:2.0:1782757786.787575:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646528 00000100:00100000:2.0:1782757786.787659:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00100000:2.0:1782757786.787673:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196646528:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757786.787794:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196646528:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 126us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757786.787802:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00080000:1.0:1782757786.789482:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757786.792946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757786.793055:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646656 00000100:00100000:2.0:1782757786.793065:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646656 00000100:00100000:2.0:1782757786.793165:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 350 00000100:00100000:2.0:1782757786.793177:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196646656:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757786.793560:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196646656:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 384us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757786.793567:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 350 00000100:00080000:1.0:1782757786.794296:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757786.801943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.802197:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646784 00000100:00100000:0.0:1782757786.802207:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646784 00000100:00100000:0.0:1782757786.802258:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 351 00000100:00100000:0.0:1782757786.802268:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196646784:12345-192.168.204.31@tcp:8:lfs.60003 00010000:00080000:0.0:1782757786.802302:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1855 last 0 00000020:00000080:0.0:1782757786.802334:0:6598:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d9b57 00002000:00100000:0.0:1782757786.802347:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff91719035f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782757786.802370:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782757786.802601:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782757786.802636:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171b785f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782757786.802911:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196646784:12345-192.168.204.31@tcp:8:lfs.60003 Request processed in 642us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.802920:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 351 00000100:00100000:0.0:1782757786.808407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.808581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757786.808982:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647040 00000100:00100000:2.0:1782757786.808994:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647040 00000100:00100000:2.0:1782757786.809062:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1075 00000100:00100000:2.0:1782757786.809074:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196647040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757786.809147:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196647040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757786.809155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1075 00000100:00100000:3.0:1782757786.811238:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647168 00000100:00100000:3.0:1782757786.811250:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647168 00000100:00100000:3.0:1782757786.811313:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1290 00000100:00100000:3.0:1782757786.811324:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196647168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757786.811399:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196647168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757786.811407:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1290 00000100:00100000:0.0:1782757786.811570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.811896:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196646912 00000100:00100000:0.0:1782757786.811901:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196646912 00000100:00100000:0.0:1782757786.812149:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 352 00000100:00100000:0.0:1782757786.812157:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43495:x1869355196646912:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757786.812583:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43495:x1869355196646912:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 425us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.812591:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 352 00000100:00080000:2.0:1782757786.813199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757786.815272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.815798:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647296 00000100:00100000:0.0:1782757786.815807:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647296 00000100:00100000:0.0:1782757786.815994:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 650 00000100:00100000:0.0:1782757786.816006:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647296:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757786.816455:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647296:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 451us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.816464:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 650 00000100:00100000:3.0:1782757786.822697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757786.822912:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647424 00000100:00100000:2.0:1782757786.822922:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647424 00000100:00100000:2.0:1782757786.822985:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00100000:2.0:1782757786.823007:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647424:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757786.823117:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647424:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 112us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757786.823125:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00100000:1.0:1782757786.825348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.825506:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647552 00000100:00100000:0.0:1782757786.825516:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647552 00000100:00100000:0.0:1782757786.825575:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 353 00000100:00100000:0.0:1782757786.825585:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647552:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757786.826502:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647552:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 914us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.826513:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 353 00000100:00100000:1.0:1782757786.837050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757786.840235:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647680 00000100:00100000:3.0:1782757786.840250:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647680 00000100:00100000:0.0:1782757786.842197:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 354 00000100:00100000:0.0:1782757786.842215:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43495:x1869355196647680:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757786.846411:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43495:x1869355196647680:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 4191us (9361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.846429:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 354 00000100:00100000:2.0:1782757786.849503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.849670:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647808 00000100:00100000:0.0:1782757786.849681:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647808 00000100:00100000:0.0:1782757786.849752:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:0.0:1782757786.849763:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647808:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757786.851332:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43495:x1869355196647808:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1564us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.851344:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:1.0:1782757786.927745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.928245:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196647936 00000100:00100000:0.0:1782757786.928255:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196647936 00000100:00100000:0.0:1782757786.928321:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:0.0:1782757786.928333:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43499:x1869355196647936:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782757786.928353:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757786.928378:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6479d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928447:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928464:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928478:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928491:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928498:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.928504:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929033:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929043:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929051:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757786.929136:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:0.0:1782757786.929140:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757786.929220:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929234:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929240:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929247:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929253:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193146c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757786.929257:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929265:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929279:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782757786.929282:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757786.929286:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929292:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929305:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929311:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929316:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929321:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757786.929324:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929330:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929337:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff91718bcfdc00) 00010000:00010000:0.0:1782757786.929339:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757786.929341:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929351:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147600/0xdd99f5c4777d9b6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929392:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147a00/0xdd99f5c4777d9b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6479d expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929408:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6479d expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.929415:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:0.0:1782757786.929417:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782757786.929420:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147e00, rc 0) 00000100:00100000:0.0:1782757786.929503:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43499:x1869355196647936:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1172us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.929512:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:1.0:1782757786.937133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757786.937287:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648192 00000100:00100000:3.0:1782757786.937296:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648192 00000100:00100000:3.0:1782757786.937410:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 654 00000100:00100000:3.0:1782757786.937421:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43499:x1869355196648192:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782757786.937443:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757786.937464:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9b7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647a4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937795:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937811:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937856:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937882:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937890:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.937897:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782757786.938903:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:3.0:1782757786.939303:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9b8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939318:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939328:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939371:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939379:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939386:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939392:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757786.939395:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939400:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939409:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:3.0:1782757786.939411:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757786.939413:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939419:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9b81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757786.939432:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035b39fc5 reply state 0000000009f737bc transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757786.939441:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757786.939477:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9b7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647a4 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939495:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647a4 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757786.939502:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782757786.939505:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757786.939507:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782757786.939669:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43499:x1869355196648192:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 2249us (2544us total) trans 4294967548 rc 0/0 00000100:00100000:3.0:1782757786.939678:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 654 00010000:00010000:2.0:1782757786.942699:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942717:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942724:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942730:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757786.942736:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942743:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942760:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917191f75900) 00010000:00010000:2.0:1782757786.942763:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757786.942767:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757786.942773:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9b88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757786.946220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757786.946344:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648320 00000100:00100000:0.0:1782757786.946355:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648320 00000100:00100000:0.0:1782757786.946413:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 355 00000100:00100000:0.0:1782757786.946438:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43499:x1869355196648320:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782757786.946457:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757786.946477:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647ab expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782757786.946505:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782757786.946525:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1855s v=(0 0) 00010000:00010000:0.0:1782757786.946530:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757786.946545:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.946562:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757786.946574:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147a00, rc 0) 00000100:00100000:0.0:1782757786.946682:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43499:x1869355196648320:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 246us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757786.946690:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 355 00000100:00100000:3.0:1782757786.976169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757786.976630:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648448 00000100:00100000:2.0:1782757786.976641:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648448 00002000:00100000:2.0:1782757786.976697:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9171b76f0380 x1869355196648448/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:457/0 lens 488/0 e 0 to 0 dl 1782757797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782757786.976708:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b76f0380 with x1869355196648448 ext(0->1048575) 00002000:00010000:2.0:1782757786.976713:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b76f0380 00000100:00100000:2.0:1782757786.976749:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:2.0:1782757786.976759:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196648448:12345-192.168.204.31@tcp:4:dd.60003 00000001:00100000:1.0:1782757787.051039:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:3.0:1782757787.070276:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196648448:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 93507us (94106us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782757787.070292:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00002000:00100000:3.0:1782757787.070305:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9171b76f0380 x1869355196648448/t4294967336(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:457/0 lens 488/448 e 0 to 0 dl 1782757797 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1782757787.070316:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b76f0380 with x1869355196648448 ext(0->1048575) 00002000:00010000:3.0:1782757787.070324:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b76f0380 00000100:00100000:1.0:1782757787.080801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757787.080978:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648576 00000100:00100000:3.0:1782757787.080989:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648576 00000100:00100000:3.0:1782757787.081045:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 655 00000100:00100000:3.0:1782757787.081055:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43499:x1869355196648576:12345-192.168.204.31@tcp:44:dd.60003 00010000:00010000:1.0:1782757787.180098:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782757787.198155:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967548 is committed 00000100:00100000:1.0:1782757787.206739:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43499:x1869355196648576:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 125673us (125936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757787.206756:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 655 00000100:00100000:2.0:1782757787.214013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757787.214306:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648704 00000100:00100000:3.0:1782757787.214319:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648704 00000100:00100000:2.0:1782757787.215395:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 356 00000100:00100000:2.0:1782757787.215413:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196648704:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:3.0:1782757787.265009:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196648704:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 49591us (50994us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757787.265026:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 356 00000001:00080000:1.0:1782757787.265139:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000100:00100000:1.0:1782757787.273746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757787.274001:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196648960 00000100:00100000:0.0:1782757787.274013:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196648960 00000100:00100000:0.0:1782757787.274078:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:0.0:1782757787.274092:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43499:x1869355196648960:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:0.0:1782757787.275303:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43499:x1869355196648960:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 1208us (1578us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1782757787.275314:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:3.0:1782757787.564306:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211505920:0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.564376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757787.564504:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211505792:0@lo:400:kworker.0 00000100:00100000:1.0:1782757787.564542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757787.564596:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505792 00000100:00100000:1.0:1782757787.564604:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505792 00000100:00100000:1.0:1782757787.564650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1782757787.564660:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757787.564719:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211505792:12345-0@lo:400:kworker.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757787.564725:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1782757787.564779:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211505792:0@lo:400:kworker.0 00000100:00100000:1.0:1782757787.565191:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211506048:0@lo:400:kworker.0 00000100:00100000:1.0:1782757787.565218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757787.565264:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211505920 00000100:00100000:1.0:1782757787.565268:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211505920 00000100:00100000:1.0:1782757787.565298:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506048 00000100:00100000:1.0:1782757787.565301:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506048 00000100:00100000:1.0:1782757787.565329:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:1.0:1782757787.565335:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757787.565422:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1782757787.565431:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757787.565484:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211506048:12345-0@lo:400:kworker.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757787.565490:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00080000:2.0:1782757787.565539:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757787.569801:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211506048:0@lo:400:kworker.0 00000100:00100000:0.0:1782757787.574336:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211506304:0@lo:400:kworker.0 00000100:00100000:0.0:1782757787.574411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757787.574542:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211506176:0@lo:400:kworker.0 00000100:00100000:0.0:1782757787.574617:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506304 00000100:00100000:0.0:1782757787.574624:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506304 00000100:00100000:0.0:1782757787.574696:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1782757787.574704:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211506304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.587524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757787.587603:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506176 00000100:00100000:3.0:1782757787.587612:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506176 00000100:00100000:3.0:1782757787.587678:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1782757787.587689:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211506176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.587756:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211506176:12345-0@lo:400:kworker.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757787.587764:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1782757787.587804:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211506176:0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.587842:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757787.587864:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211506432:0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.587895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782757787.588105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757787.588110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757787.588131:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506432 00000100:00100000:3.0:1782757787.588134:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506432 00000100:00100000:3.0:1782757787.590394:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1782757787.590418:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211506432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757787.590597:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211506432:12345-0@lo:400:kworker.0 Request processed in 189us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757787.590609:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00080000:2.0:1782757787.591212:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757787.591275:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211506432:0@lo:400:kworker.0 00000100:00100000:2.0:1782757787.594355:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211506304:0@lo:400:kworker.0 00000100:00100000:0.0:1782757787.594433:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211506304:12345-0@lo:400:kworker.0 Request processed in 19727us (20019us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757787.594531:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1782757787.595152:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211505920:0@lo:400:kworker.0 00000100:00100000:1.0:1782757787.598635:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211505920:12345-0@lo:400:kworker.0 Request processed in 33289us (34247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757787.598651:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1782757788.077114:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757788.077327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757788.078449:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506560 00000100:00100000:2.0:1782757788.078469:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506560 00000100:00100000:2.0:1782757788.081393:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1782757788.081425:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211506560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757788.081458:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782757788.081538:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757788.081544:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1782757788.084099:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211506560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757788.212290:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757788.572345:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967549 is committed 00010000:00010000:0.0:1782757789.228078:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757789.935889:0:75197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1858339061501ns, next at 1847195487377ns, rc = 0 00000004:00080000:1.0:1782757789.936102:0:75197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1858339278794ns, next at 1805414503938ns, rc = 0 00000004:00080000:2.0:1782757789.941659:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00000004:00080000:2.0:1782757789.941696:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00010000:00010000:1.0:1782757790.252395:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757790.637678:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211506688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757790.637754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757790.637903:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506688 00000100:00100000:2.0:1782757790.637913:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506688 00000100:00100000:2.0:1782757790.637984:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1782757790.637995:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211506688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757790.638031:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757790.638075:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211506688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757790.638082:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00080000:3.0:1782757790.638141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757790.638175:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211506688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757791.277711:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757791.479133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757791.479232:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649088 00000100:00100000:3.0:1782757791.479241:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649088 00000100:00100000:3.0:1782757791.479317:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 656 00000100:00100000:3.0:1782757791.479328:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649088:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757791.479430:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649088:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757791.479437:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 656 00000100:00080000:1.0:1782757791.479559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757791.483702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757791.484134:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649216 00000100:00100000:3.0:1782757791.484144:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649216 00000100:00100000:3.0:1782757791.484207:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 357 00000100:00100000:3.0:1782757791.484216:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43692:x1869355196649216:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757791.484590:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43692:x1869355196649216:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 374us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757791.484599:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 357 00000100:00080000:0.0:1782757791.484962:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757791.491205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757791.491375:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649344 00000100:00100000:3.0:1782757791.491386:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649344 00000100:00100000:3.0:1782757791.491452:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 358 00000100:00100000:3.0:1782757791.491463:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43692:x1869355196649344:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:2.0:1782757791.491957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757791.492015:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43692:x1869355196649344:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 552us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757791.492025:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 358 00000100:00100000:2.0:1782757791.496221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757791.496309:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649472 00000100:00100000:1.0:1782757791.496319:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649472 00000100:00100000:1.0:1782757791.496377:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 657 00000100:00100000:1.0:1782757791.496389:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649472:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757791.497028:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649472:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 638us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757791.497037:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 657 00000100:00100000:1.0:1782757791.499790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757791.499871:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649600 00000100:00100000:0.0:1782757791.499882:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649600 00000100:00100000:0.0:1782757791.499945:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 658 00000100:00100000:0.0:1782757791.500530:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649600:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757791.500641:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649600:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 686us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757791.500648:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 658 00000100:00100000:1.0:1782757791.505000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757791.505070:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649728 00000100:00100000:3.0:1782757791.505079:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649728 00000100:00100000:3.0:1782757791.505246:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 359 00000100:00100000:3.0:1782757791.505257:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43692:x1869355196649728:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757791.505609:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43692:x1869355196649728:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 352us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757791.505618:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 359 00000100:00100000:3.0:1782757791.510198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757791.510542:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649856 00000100:00100000:0.0:1782757791.510552:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649856 00000100:00100000:0.0:1782757791.510605:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 360 00000100:00100000:0.0:1782757791.510615:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43692:x1869355196649856:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757791.511044:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43692:x1869355196649856:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 428us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757791.511052:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 360 00000100:00100000:1.0:1782757791.514142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757791.523046:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196649984 00000100:00100000:0.0:1782757791.523063:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196649984 00000100:00100000:2.0:1782757791.523300:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 659 00000100:00100000:2.0:1782757791.523310:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649984:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757791.523750:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43692:x1869355196649984:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 440us (9616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757791.523758:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 659 00000100:00100000:1.0:1782757791.637940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757791.638322:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650240 00000100:00100000:3.0:1782757791.638334:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650240 00000100:00100000:3.0:1782757791.638402:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 660 00000100:00100000:3.0:1782757791.638422:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43696:x1869355196650240:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782757791.639000:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757791.639029:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647a4 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639050:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782757791.639062:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757791.639292:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639308:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639318:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639337:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639344:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.639351:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.642423:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.642444:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757791.642456:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757791.644110:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9472 00000004:00080000:2.0:1782757791.644123:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1860047299384ns, next at 1861047296671ns, rc = 0 00010000:00010000:2.0:1782757791.644223:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644241:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644252:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644260:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644266:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644272:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644297:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757791.644327:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644333:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644339:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644344:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757791.644348:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644355:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644371:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff917191f75500) 00010000:00010000:2.0:1782757791.644374:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757791.644378:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644384:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9bb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644401:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644407:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644412:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644416:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757791.644419:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644424:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644431:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:2.0:1782757791.644433:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757791.644435:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757791.644441:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ba4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757791.644454:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000656ad2c4 reply state 00000000646a3d31 transno 4294967550 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757791.644462:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757791.644534:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757791.644541:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757791.644547:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757791.644551:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757791.644556:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43696:x1869355196650240:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 6142us (6625us total) trans 4294967550 rc 0/0 00010000:00010000:0.0:1782757791.644559:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757791.644565:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 660 00010000:00010000:0.0:1782757791.644567:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff917191f75500) 00010000:00010000:0.0:1782757791.644569:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782757791.644572:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757791.644577:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9bb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757791.644591:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757791.644592:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757791.644594:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757791.648428:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648445:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648453:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648460:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757791.648465:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648473:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648489:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff917191f75d00) 00010000:00010000:1.0:1782757791.648492:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757791.648498:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757791.648512:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757791.941622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757791.941721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757791.941761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757791.941810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757791.941889:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650752 00000100:00100000:1.0:1782757791.941899:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650752 00000100:00100000:1.0:1782757791.941940:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650624 00000100:00100000:1.0:1782757791.941942:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650624 00000100:00100000:1.0:1782757791.941961:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00100000:1.0:1782757791.941970:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196650752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757791.942034:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196650752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757791.942041:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00100000:1.0:1782757791.942058:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 958 00000100:00100000:1.0:1782757791.942064:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196650624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757791.944658:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650496 00000100:00100000:0.0:1782757791.944675:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650496 00000100:00100000:0.0:1782757791.944758:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1294 00000100:00100000:2.0:1782757791.944872:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650368 00000100:00100000:2.0:1782757791.944877:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650368 00000100:00100000:2.0:1782757791.944910:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00100000:2.0:1782757791.944920:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196650368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757791.944936:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196650496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757791.944985:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196650368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757791.944992:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00100000:0.0:1782757791.945078:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196650496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 310us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757791.945151:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1294 00000100:00100000:1.0:1782757791.945431:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196650624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757791.945448:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 958 00010000:00010000:1.0:1782757792.300467:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757792.685340:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211506816:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.685481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757792.685503:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211506944:0@lo:400:kworker.0 00000100:00100000:3.0:1782757792.685537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757792.685573:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506944 00000100:00100000:3.0:1782757792.685579:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506944 00000100:00100000:2.0:1782757792.685620:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211507328:0@lo:400:kworker.0 00000100:00100000:3.0:1782757792.685629:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1782757792.685639:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.685648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757792.685674:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757792.685681:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507200:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.685709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757792.685739:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211507072:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.685777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757792.685805:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211506816 00000100:00100000:2.0:1782757792.685809:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211506816 00000100:00100000:2.0:1782757792.685858:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1782757792.685865:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.685973:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211506816:12345-0@lo:400:kworker.0 Request processed in 108us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757792.685981:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1782757792.686012:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507328 00000100:00100000:2.0:1782757792.686016:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507328 00000100:00100000:2.0:1782757792.686047:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507072 00000100:00100000:2.0:1782757792.686050:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507072 00000100:00100000:2.0:1782757792.686067:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1782757792.686073:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686104:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211507328:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757792.686110:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1782757792.686121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1782757792.686127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686164:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211507072:12345-0@lo:400:kworker.0 Request processed in 36us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757792.686169:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1782757792.686192:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507200 00000100:00100000:2.0:1782757792.686195:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507200 00000100:00100000:2.0:1782757792.686225:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1782757792.686233:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686269:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211507200:12345-0@lo:400:kworker.0 Request processed in 37us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757792.686275:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00080000:2.0:1782757792.686304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757792.686309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757792.686345:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211507072:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686378:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211507456:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757792.686433:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507456 00000100:00100000:2.0:1782757792.686436:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507456 00000100:00100000:2.0:1782757792.686469:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1782757792.686476:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686511:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211507456:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757792.686517:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00080000:2.0:1782757792.686533:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757792.686551:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211507456:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686580:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507200:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686592:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211506816:0@lo:400:kworker.0 00000100:00100000:2.0:1782757792.686605:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211507328:0@lo:400:kworker.0 00000100:00100000:3.0:1782757792.686621:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211506944:12345-0@lo:400:kworker.0 Request processed in 981us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757792.686631:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1782757792.686643:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211506944:0@lo:400:kworker.0 00000004:00080000:3.0:1782757793.197072:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1861600246530ns, next at 1862600244190ns, rc = 0 00000100:00100000:1.0:1782757793.197136:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757793.197158:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211507584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757793.197225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757793.197355:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507584 00000100:00100000:3.0:1782757793.197364:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507584 00000100:00100000:3.0:1782757793.197429:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1782757793.197440:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211507584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757793.197477:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782757793.197539:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211507584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757793.197731:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211507584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757793.198009:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00010000:00010000:3.0:1782757793.324427:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757793.772705:0:75342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1862175878814ns, next at 1847195487377ns, rc = 0 00000004:00080000:1.0:1782757793.772913:0:75342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1862176089808ns, next at 1862600244190ns, rc = 0 00000004:00080000:3.0:1782757793.815055:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00000004:00080000:3.0:1782757793.815080:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000001:00080000:3.0:1782757793.815096:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967550 is committed 00000004:00080000:3.0:1782757793.815100:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00000004:00080000:3.0:1782757793.815105:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000100:00100000:0.0:1782757793.815251:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757793.815268:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782757793.815333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757793.815401:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507712 00000100:00100000:0.0:1782757793.815408:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507712 00000100:00100000:0.0:1782757793.815455:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1782757793.815464:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211507712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757793.815494:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:20 count 1 00010000:00010000:0.0:1782757793.815519:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.815551:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.815561:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1782757793.815564:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757793.815569:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.815608:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.815622:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 5 pid: 6598 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757793.815634:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211507840:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757793.815687:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191820240 going to sleep for 11 seconds 00000100:00100000:0.0:1782757793.820008:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211507840:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782757793.820036:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757793.832401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757793.833202:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196650880 00000100:00100000:3.0:1782757793.833219:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196650880 00010000:00010000:3.0:1782757793.833310:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 6 pid: 6598 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782757793.833314:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757793.833367:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 346 00000100:00100000:3.0:1782757793.833380:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196650880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782757793.833399:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757793.833406:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 6 pid: 6598 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757793.833423:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 6 pid: 6598 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757793.833455:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c45bd0d/0xdd99f5c4777d9b9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ab expref: 6 pid: 6598 timeout: 1962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757793.833479:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782757793.833483:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782757793.833490:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757793.833502:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757793.833545:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757793.833591:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757793.833610:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757793.833627:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196650880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 248us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757793.833651:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 346 00010000:00010000:2.0:1782757793.833661:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757793.833673:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757793.833698:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782757793.834362:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211507712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18895us (19025us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1782757793.834373:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00010000:0.0:1782757793.835672:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757793.835685:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.835697:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917193147600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757793.835704:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.835715:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.835745:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.835752:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4b5acd/0xdd99f5c4777d9bc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757793.835783:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757793.835784:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757793.835786:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757793.836038:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917081ad4e00/2, rc 0, transno 4294967337 00000100:00100000:1.0:1782757793.836060:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507712:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782757794.357061:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757795.374692:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757795.756091:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757795.756167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757795.756325:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211507968 00000100:00100000:3.0:1782757795.756333:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211507968 00000100:00100000:3.0:1782757795.756398:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1782757795.756408:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211507968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757795.756447:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782757795.756517:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757795.758250:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211507968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1835us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757795.758263:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1782757795.758375:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211507968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782757796.400243:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782757796.868157:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:1.0:1782757797.060702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757797.060746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757797.060771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757797.060807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757797.060857:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651136 00000100:00100000:1.0:1782757797.060866:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651136 00000100:00100000:1.0:1782757797.060930:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1298 00000100:00100000:1.0:1782757797.060940:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196651136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757797.061023:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196651136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.061032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1298 00000100:00100000:1.0:1782757797.061062:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651392 00000100:00100000:1.0:1782757797.061065:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651392 00000100:00100000:1.0:1782757797.061089:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651264 00000100:00100000:1.0:1782757797.061092:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651264 00000100:00100000:1.0:1782757797.061114:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 961 00000100:00100000:1.0:1782757797.061120:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196651392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757797.061145:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196651392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.061152:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 961 00000100:00100000:1.0:1782757797.061163:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 962 00000100:00100000:1.0:1782757797.061169:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196651264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757797.061192:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196651264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.061198:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 962 00000100:00080000:1.0:1782757797.061217:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757797.061220:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757797.061223:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757797.063495:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651008 00000100:00100000:3.0:1782757797.063507:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651008 00000100:00100000:3.0:1782757797.063619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1079 00000100:00100000:3.0:1782757797.063629:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196651008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757797.063712:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196651008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757797.063720:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1079 00010000:00010000:0.0:1782757797.420780:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757797.806104:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211508352:0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.806113:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211508096:0@lo:400:kworker.0 00000100:00100000:3.0:1782757797.806185:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211508224:0@lo:400:kworker.0 00000100:00100000:0.0:1782757797.816542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757797.816642:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757797.816665:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211508480:0@lo:400:kworker.0 00000100:00100000:0.0:1782757797.816701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757797.816747:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508480 00000100:00100000:2.0:1782757797.816755:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508352 00000100:00100000:0.0:1782757797.816755:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508480 00000100:00100000:2.0:1782757797.816759:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508352 00000100:00100000:2.0:1782757797.816810:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1782757797.816810:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1782757797.816818:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211508352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757797.816837:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211508480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757797.816887:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211508480:12345-0@lo:400:kworker.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757797.816893:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1782757797.816954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757797.827214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757797.827267:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211508608:0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.827306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782757797.827349:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757797.827355:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757797.827372:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508096 00000100:00100000:1.0:1782757797.827380:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508096 00000100:00100000:1.0:1782757797.827427:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1782757797.827434:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211508096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.827482:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211508096:12345-0@lo:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.827489:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1782757797.827520:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508224 00000100:00100000:1.0:1782757797.827524:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508224 00000100:00100000:1.0:1782757797.827541:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1782757797.827546:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211508224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.827574:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211508224:12345-0@lo:400:kworker.0 Request processed in 28us (10620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.827579:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1782757797.827588:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508608 00000100:00100000:1.0:1782757797.827590:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508608 00000100:00100000:1.0:1782757797.827610:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1782757797.827615:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.827638:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211508608:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.827643:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00080000:1.0:1782757797.827671:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757797.827693:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211508096:0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.827704:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211508608:0@lo:400:kworker.0 00000100:00100000:3.0:1782757797.828783:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211508224:0@lo:400:kworker.0 00000100:00100000:3.0:1782757797.828793:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211508736:0@lo:400:kworker.0 00000100:00100000:3.0:1782757797.828845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757797.829719:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211508480:0@lo:400:kworker.0 00000100:00100000:0.0:1782757797.829740:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211508352:0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.830901:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508736 00000100:00100000:1.0:1782757797.830926:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508736 00000100:00100000:1.0:1782757797.831242:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1782757797.831252:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757797.831344:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211508736:12345-0@lo:400:kworker.0 Request processed in 93us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757797.831351:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1782757797.831543:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:3.0:1782757797.831550:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917081ad4e00, transno 4294967337 00000100:00100000:3.0:1782757797.831571:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211508736:0@lo:400:kworker.0 00000100:00100000:2.0:1782757797.836333:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211508352:12345-0@lo:400:kworker.0 Request processed in 19505us (19787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757797.836351:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00080000:0.0:1782757797.841326:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757798.316370:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211508864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757798.316457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757798.316518:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508864 00000100:00100000:3.0:1782757798.316525:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508864 00000100:00100000:3.0:1782757798.316574:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1782757798.316584:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211508864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757798.316633:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757798.316703:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211508864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757798.316710:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1782757798.316862:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211508864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757798.444006:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757799.468877:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757800.493214:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757800.876807:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211508992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757800.876894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757800.879168:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211508992 00000100:00100000:3.0:1782757800.879183:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211508992 00000100:00100000:3.0:1782757800.879280:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1782757800.879292:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211508992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757800.879342:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757800.879434:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211508992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757800.879442:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1782757800.879842:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211508992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757800.880052:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757801.516804:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757802.169530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757802.169635:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651520 00000100:00100000:3.0:1782757802.169646:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651520 00000100:00100000:3.0:1782757802.169709:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:3.0:1782757802.169718:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196651520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757802.169801:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196651520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757802.169809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:3.0:1782757802.172877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757802.173249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757802.173312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757802.173417:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651904 00000100:00100000:0.0:1782757802.173428:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651904 00000100:00100000:0.0:1782757802.173493:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651776 00000100:00100000:0.0:1782757802.173496:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651776 00000100:00100000:0.0:1782757802.173526:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:0.0:1782757802.173537:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196651904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757802.173619:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196651904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757802.173626:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:0.0:1782757802.173642:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:0.0:1782757802.173661:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196651776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757802.173688:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196651776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757802.173694:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:1.0:1782757802.173934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196651648 00000100:00100000:1.0:1782757802.173940:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196651648 00000100:00100000:1.0:1782757802.173980:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1302 00000100:00100000:1.0:1782757802.173988:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196651648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757802.174021:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196651648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757802.174028:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1302 00000100:00080000:3.0:1782757802.174784:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782757802.174790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757802.174793:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782757802.541317:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757802.924240:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211509120:0@lo:400:kworker.0 00000100:00100000:1.0:1782757802.924314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757802.924488:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509120 00000100:00100000:3.0:1782757802.924497:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509120 00000100:00100000:3.0:1782757802.924566:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1782757802.924575:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211509120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.925182:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211509248:0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.925217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757802.925268:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509248 00000100:00100000:0.0:1782757802.925272:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509248 00000100:00100000:0.0:1782757802.925303:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1782757802.925309:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211509248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.925343:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211509248:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757802.925349:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1782757802.925386:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211509248:0@lo:400:kworker.0 00000100:00100000:3.0:1782757802.931276:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211509120:12345-0@lo:400:kworker.0 Request processed in 6691us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757802.931292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1782757802.934041:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211509760:0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.934115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757802.934157:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757802.934164:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211509632:0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.934187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757802.934214:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509632 00000100:00100000:2.0:1782757802.934222:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509632 00000100:00100000:2.0:1782757802.934276:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1782757802.934285:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.934335:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211509632:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757802.934342:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00080000:2.0:1782757802.934367:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757802.934379:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509760 00000100:00100000:2.0:1782757802.934383:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509760 00000100:00100000:2.0:1782757802.934416:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1782757802.934422:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211509760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.934454:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211509760:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757802.934460:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:2.0:1782757802.934478:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757802.934506:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211509632:0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.934516:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211509760:0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.935155:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211509376:0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.935195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757802.935235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757802.935241:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211509504:0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.935263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757802.935291:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509504 00000100:00100000:0.0:1782757802.935295:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509504 00000100:00100000:0.0:1782757802.935331:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1782757802.935336:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211509504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757802.935371:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211509504:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757802.935377:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00080000:0.0:1782757802.935395:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757802.935413:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211509504:0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.936953:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509376 00000100:00100000:2.0:1782757802.936965:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509376 00000100:00100000:2.0:1782757802.937066:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1782757802.937076:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757802.937149:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211509376:12345-0@lo:400:kworker.0 Request processed in 75us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757802.937155:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:0.0:1782757802.937392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757802.937431:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211509376:0@lo:400:kworker.0 00000100:00100000:1.0:1782757802.938839:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211509120:0@lo:400:kworker.0 00000100:00100000:3.0:1782757803.437286:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782757803.437312:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211509888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757803.437392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757803.437422:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211509888 00000100:00100000:0.0:1782757803.437433:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211509888 00000100:00100000:0.0:1782757803.437493:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1782757803.437504:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211509888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757803.437551:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757803.437622:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211509888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757803.437629:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1782757803.440460:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211509888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757803.566777:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757804.588625:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757805.612217:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757805.996627:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757805.996655:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211510016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757805.996729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757805.996811:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510016 00000100:00100000:3.0:1782757805.996819:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510016 00000100:00100000:3.0:1782757805.996913:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1782757805.996925:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211510016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757805.996964:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757805.997015:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211510016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757805.997023:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1782757805.997151:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211510016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757805.997228:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782757806.636113:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757807.284628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757807.284689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757807.284724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757807.284765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757807.284864:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652160 00000100:00100000:3.0:1782757807.284886:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652160 00000100:00100000:3.0:1782757807.284972:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1306 00000100:00100000:3.0:1782757807.284987:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196652160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757807.285041:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652288 00000100:00100000:0.0:1782757807.285056:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652288 00000100:00100000:3.0:1782757807.285109:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196652160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 124us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757807.285120:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1306 00000100:00100000:0.0:1782757807.285146:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652416 00000100:00100000:0.0:1782757807.285151:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652416 00000100:00100000:3.0:1782757807.285170:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:2.0:1782757807.285768:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652032 00000100:00100000:2.0:1782757807.285787:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652032 00000100:00100000:2.0:1782757807.285859:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1083 00000100:00100000:2.0:1782757807.285869:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196652032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757807.285928:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196652032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 61us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757807.285935:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1083 00000100:00080000:2.0:1782757807.286011:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757807.286017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757807.286021:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757807.288458:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196652288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757807.292706:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196652288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 346us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757807.293869:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:3.0:1782757807.293954:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:1.0:1782757807.294505:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196652416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757807.294647:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196652416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 761us (9878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757807.294662:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 970 00010000:00010000:3.0:1782757807.660199:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757808.044176:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211510528:0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.044184:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211510144:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.044273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757808.044309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757808.044346:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757808.044355:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211510400:0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.044370:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211510656:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.044379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757808.044419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757808.044465:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782757808.044473:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211510272:0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.044500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757808.044529:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510400 00000100:00100000:1.0:1782757808.044534:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211510784:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.044542:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510400 00000100:00100000:1.0:1782757808.044577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757808.044615:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510656 00000100:00100000:2.0:1782757808.044619:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510656 00000100:00100000:1.0:1782757808.044629:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510272 00000100:00100000:1.0:1782757808.044638:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510272 00000100:00100000:2.0:1782757808.044649:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1782757808.044659:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211510400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.044685:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:1.0:1782757808.044699:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.044721:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211510400:12345-0@lo:400:kworker.0 Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757808.044730:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1782757808.044773:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1782757808.044778:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211510656:12345-0@lo:400:kworker.0 Request processed in 82us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757808.044786:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211510272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.044798:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1782757808.044813:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510144 00000100:00100000:3.0:1782757808.044858:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510144 00000100:00100000:1.0:1782757808.044890:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510528 00000100:00100000:2.0:1782757808.044891:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211510272:12345-0@lo:400:kworker.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757808.044901:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510528 00000100:00100000:2.0:1782757808.044908:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1782757808.044915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1782757808.044933:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211510144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782757808.044957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757808.044964:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757808.044968:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510784 00000100:00100000:1.0:1782757808.044974:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510784 00000100:00100000:3.0:1782757808.044990:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211510144:12345-0@lo:400:kworker.0 Request processed in 64us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757808.044993:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1782757808.045006:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1782757808.045011:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211510528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.045029:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1782757808.045044:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.045069:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211510528:12345-0@lo:400:kworker.0 Request processed in 63us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757808.045085:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:2.0:1782757808.045106:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757808.045112:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211510400:0@lo:400:kworker.0 00000100:00100000:1.0:1782757808.045604:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211510784:12345-0@lo:400:kworker.0 Request processed in 565us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757808.045618:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1782757808.046172:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211510528:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.046184:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211510272:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.046202:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211510784:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.046213:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211510144:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.046226:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211510656:0@lo:400:kworker.0 00000100:00100000:2.0:1782757808.556171:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757808.556200:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211510912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757808.556279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757808.556335:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211510912 00000100:00100000:3.0:1782757808.556344:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211510912 00000100:00100000:3.0:1782757808.556406:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1782757808.556416:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211510912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757808.556465:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757808.556539:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211510912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757808.556547:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1782757808.556611:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211510912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757808.684084:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757809.576504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757809.576610:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652544 00000100:00100000:1.0:1782757809.576621:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652544 00000100:00100000:1.0:1782757809.576700:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 661 00000100:00100000:1.0:1782757809.576711:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196652544:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757809.576874:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196652544:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757809.576882:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 661 00000100:00080000:2.0:1782757809.577588:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757809.585928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.586023:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652672 00000100:00100000:3.0:1782757809.586035:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652672 00000100:00100000:3.0:1782757809.586117:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 362 00000100:00100000:3.0:1782757809.586128:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196652672:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757809.586542:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196652672:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 415us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.586551:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 362 00000100:00080000:2.0:1782757809.586637:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757809.602521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757809.602621:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652800 00000100:00100000:2.0:1782757809.602632:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652800 00000100:00100000:2.0:1782757809.602715:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 363 00000100:00100000:2.0:1782757809.602726:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196652800:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757809.603614:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196652800:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 886us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757809.603624:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 363 00000100:00080000:0.0:1782757809.604676:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757809.612228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757809.612325:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196652928 00000100:00100000:2.0:1782757809.612335:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196652928 00000100:00100000:2.0:1782757809.612395:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 662 00000100:00100000:2.0:1782757809.612415:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196652928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757809.614041:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196652928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1619us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757809.614055:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 662 00000100:00100000:3.0:1782757809.631713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.631751:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653056 00000100:00100000:3.0:1782757809.631760:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653056 00000100:00100000:3.0:1782757809.631852:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 663 00000100:00100000:3.0:1782757809.631863:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196653056:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757809.631963:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196653056:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.631971:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 663 00000100:00100000:3.0:1782757809.634916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.634951:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653184 00000100:00100000:3.0:1782757809.634960:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653184 00000100:00100000:3.0:1782757809.635024:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 364 00000100:00100000:3.0:1782757809.635034:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196653184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757809.636487:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196653184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1448us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.636497:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 364 00000100:00100000:3.0:1782757809.645667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.645717:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653312 00000100:00100000:3.0:1782757809.645727:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653312 00000100:00100000:3.0:1782757809.646506:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 365 00000100:00100000:3.0:1782757809.646520:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196653312:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757809.650278:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:43914:x1869355196653312:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 3748us (8452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.650291:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 365 00000100:00100000:2.0:1782757809.653159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.653324:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653440 00000100:00100000:3.0:1782757809.653335:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653440 00000100:00100000:3.0:1782757809.653384:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 664 00000100:00100000:3.0:1782757809.653394:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196653440:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757809.653973:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43914:x1869355196653440:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 578us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.653982:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 664 00000100:00100000:3.0:1782757809.709334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757809.709435:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653568 00000100:00100000:1.0:1782757809.709446:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653568 00000100:00100000:1.0:1782757809.709507:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 665 00000100:00100000:1.0:1782757809.709518:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:43915:x1869355196653568:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757809.709540:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757809.709564:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.709653:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.709668:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.709681:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757809.709936:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1782757809.709941:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757809.710026:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.710054:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647b2 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.710076:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647b2 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757809.710085:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:1.0:1782757809.710088:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757809.710092:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782757809.710164:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43915:x1869355196653568:12345-192.168.204.31@tcp:101:rm.0 Request processed in 648us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757809.710172:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 665 00000100:00100000:3.0:1782757809.712801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757809.713053:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653824 00000100:00100000:0.0:1782757809.713062:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653824 00000100:00100000:0.0:1782757809.713122:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 666 00000100:00100000:0.0:1782757809.713134:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43915:x1869355196653824:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757809.713156:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757809.713179:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9bd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647b9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757809.713444:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00010000:0.0:1782757809.713673:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9bd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647b9 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757809.713689:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:0.0:1782757809.713692:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782757809.713698:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193146c00/0xdd99f5c4777d9bd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647b9 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757809.713714:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193146c00, rc 0) 00000100:00100000:0.0:1782757809.713778:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43915:x1869355196653824:12345-192.168.204.31@tcp:101:rm.0 Request processed in 645us (985us total) trans 4294967551 rc 301/301 00000100:00100000:0.0:1782757809.713786:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 666 00010000:00010000:0.0:1782757809.714150:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757809.724193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.724247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196653952 00000100:00100000:3.0:1782757809.724257:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196653952 00000100:00100000:3.0:1782757809.725547:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:3.0:1782757809.725568:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43915:x1869355196653952:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782757809.763618:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43915:x1869355196653952:12345-192.168.204.31@tcp:37:rm.0 Request processed in 38049us (39423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757809.763633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:3.0:1782757809.777793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.777839:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654208 00000100:00100000:3.0:1782757809.777852:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654208 00000100:00100000:3.0:1782757809.777903:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:3.0:1782757809.777912:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:43915:x1869355196654208:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:3.0:1782757809.778377:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43915:x1869355196654208:12345-192.168.204.31@tcp:35:rm.0 Request processed in 464us (594us total) trans 4294967552 rc 0/0 00000100:00100000:3.0:1782757809.778386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:3.0:1782757809.786640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757809.786686:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654464 00000100:00100000:3.0:1782757809.786696:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654464 00000100:00100000:3.0:1782757809.786765:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 667 00000100:00100000:3.0:1782757809.786785:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:43915:x1869355196654464:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782757809.786866:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782757809.786897:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9bce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647b2 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.786921:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917193147e00/0xdd99f5c4777d9b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6479d expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.786931:0:5801:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d97c2) 00010000:00010000:3.0:1782757809.786935:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:3.0:1782757809.786958:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757809.786985:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.786999:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787023:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787036:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787044:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787049:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787443:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787452:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787458:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787606:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787614:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787621:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787627:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757809.787632:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787639:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787648:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782757809.787652:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757809.787656:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787662:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9bf1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787678:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787684:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787690:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787695:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757809.787698:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787704:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787712:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782757809.787714:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757809.787717:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787723:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9be3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787734:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787745:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787751:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787755:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757809.787758:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787763:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787769:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff917191f75f00) 00010000:00010000:3.0:1782757809.787772:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757809.787775:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757809.787781:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777d9bea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757809.787899:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:43915:x1869355196654464:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1121us (1277us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782757809.787909:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 667 00010000:00010000:3.0:1782757810.732032:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757811.119112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757811.119134:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211511040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757811.119202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757811.119379:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511040 00000100:00100000:1.0:1782757811.119396:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511040 00000100:00100000:1.0:1782757811.119459:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1782757811.119470:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211511040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757811.119508:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757811.119558:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211511040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757811.119566:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1782757811.119620:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211511040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757811.120049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782757811.470188:0:75563:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb98ff180 20000000:00000080:1.0:1782757811.470208:0:75563:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30cbc00 uarg=0000000000000000 00010000:00010000:1.0:1782757811.473792:0:75563:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757811.473816:0:75563:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757811.474149:0:75563:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757811.474171:0:75563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.474189:0:75563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.474196:0:75563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.474239:0:75563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.474255:0:75563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 18 pid: 5793 timeout: 1979 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757811.474272:0:75563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75563:1869355211511168:0@lo:104: 00000100:00100000:2.0:1782757811.474338:0:75563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757811.474428:0:75563:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782757811.474481:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511168 00000100:00100000:3.0:1782757811.474488:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511168 00000100:00100000:3.0:1782757811.474642:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1782757811.474653:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75563:x1869355211511168:12345-0@lo:104: 00010000:00010000:3.0:1782757811.474668:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757811.474783:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757811.474789:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75563:x1869355211511168:12345-0@lo:104: Request processed in 139us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757811.474796:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:0.0:1782757811.474863:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757811.474870:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.474877:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757811.474881:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.474889:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757811.474895:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757811.474904:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757811.474936:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.474942:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757811.474963:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.474969:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777d9b49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9b50 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.474984:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757811.474985:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757811.474987:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757811.475006:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211511296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757811.475037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757811.475080:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511296 00000100:00100000:0.0:1782757811.475084:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511296 00010000:00010000:0.0:1782757811.475104:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 19 pid: 5793 timeout: 1979 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757811.475126:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782757811.475132:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211511296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757811.475141:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757811.475146:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 19 pid: 5793 timeout: 1979 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475156:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 19 pid: 5793 timeout: 1979 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475172:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475179:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475193:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475200:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475205:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475210:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475216:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757811.475220:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475227:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475235:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757811.475243:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757811.475271:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211511296:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757811.475280:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782757811.475319:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211511296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757811.475629:0:75563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9b50 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9b49 expref: 18 pid: 5793 timeout: 1979 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757811.475639:0:75563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75563:1869355211511168:0@lo:104: 00010000:00010000:2.0:1782757811.475651:0:75563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.475660:0:75563:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.475667:0:75563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757811.475672:0:75563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777d9bf8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757811.755990:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757812.423010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757812.423063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757812.423098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757812.423131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757812.423215:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654848 00000100:00100000:3.0:1782757812.423226:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654848 00000100:00100000:3.0:1782757812.423296:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654976 00000100:00100000:3.0:1782757812.423300:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654976 00000100:00100000:3.0:1782757812.423327:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:3.0:1782757812.423337:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196654848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757812.423422:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196654848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757812.423430:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:3.0:1782757812.423448:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:3.0:1782757812.423455:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196654976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757812.423481:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196654976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757812.423488:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:3.0:1782757812.423507:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654720 00000100:00100000:3.0:1782757812.423510:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654720 00000100:00100000:3.0:1782757812.423539:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1310 00000100:00100000:3.0:1782757812.423545:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196654720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757812.423575:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196654720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757812.423583:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1310 00000100:00100000:1.0:1782757812.424240:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196654592 00000100:00100000:1.0:1782757812.424247:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196654592 00000100:00100000:1.0:1782757812.424289:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00100000:1.0:1782757812.424296:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196654592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757812.424334:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196654592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757812.424341:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00080000:0.0:1782757812.424434:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757812.424439:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757812.424442:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782757812.635372:0:75611:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc4e7ab550 20000000:00000080:2.0:1782757812.635391:0:75611:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081115000 uarg=0000000000000000 00010000:00010000:2.0:1782757812.635615:0:75611:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782757812.635629:0:75611:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782757812.635649:0:75611:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757812.635669:0:75611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.636985:0:75611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637000:0:75611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637013:0:75611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637020:0:75611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637027:0:75611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637034:0:75611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757812.637038:0:75611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637046:0:75611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637059:0:75611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637067:0:75611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757812.637074:0:75611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777d9bff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757812.789610:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782757813.045173:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757813.045182:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757813.045186:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757813.045231:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.045243:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.045254:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757813.045279:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211511424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757813.045365:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.045428:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782757813.045866:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511424 00000100:00100000:0.0:1782757813.045876:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511424 00000100:00100000:0.0:1782757813.045930:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1782757813.045940:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211511424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757813.045955:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757813.045971:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c06 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757813.045996:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757813.046007:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757813.046016:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147a00, rc 0) 00000100:00100000:0.0:1782757813.046067:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211511424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757813.046074:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1782757813.046171:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211511424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757813.046186:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.046195:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757813.046211:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757813.046216:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.046224:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757813.164560:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211511552:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.164647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.164733:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511552 00000100:00100000:3.0:1782757813.164741:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511552 00000100:00100000:3.0:1782757813.164790:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1782757813.164800:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211511552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.164874:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211511552:12345-0@lo:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757813.164881:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1782757813.164922:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211511552:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.164962:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211511680:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.164985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.165017:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511680 00000100:00100000:3.0:1782757813.165020:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511680 00000100:00100000:3.0:1782757813.165050:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1782757813.165057:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211511680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165090:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211511680:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757813.165103:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00080000:3.0:1782757813.165119:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757813.165140:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211511680:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165169:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211511808:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.165223:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511808 00000100:00100000:3.0:1782757813.165226:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511808 00000100:00100000:3.0:1782757813.165396:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:3.0:1782757813.165404:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211511808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165439:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211511808:12345-0@lo:400:kworker.0 Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757813.165445:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00080000:3.0:1782757813.165462:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757813.165477:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211511808:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165509:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211511936:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.165557:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211511936 00000100:00100000:3.0:1782757813.165560:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211511936 00000100:00100000:3.0:1782757813.165583:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1782757813.165588:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211511936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165619:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211511936:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757813.165625:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00080000:3.0:1782757813.165692:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757813.165710:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211511936:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165747:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211512064:0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.165790:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512064 00000100:00100000:3.0:1782757813.165792:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512064 00000100:00100000:3.0:1782757813.165814:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1782757813.165820:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211512064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757813.165871:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211512064:12345-0@lo:400:kworker.0 Request processed in 51us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757813.165877:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:3.0:1782757813.165890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757813.165904:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211512064:0@lo:400:kworker.0 00000020:00000080:3.0:1782757813.618439:0:75660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1a5b5a90 20000000:00000080:3.0:1782757813.618457:0:75660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b347c000 uarg=0000000000000000 00010000:00010000:3.0:1782757813.618681:0:75660:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757813.618695:0:75660:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757813.618715:0:75660:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757813.618733:0:75660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.618749:0:75660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.618757:0:75660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.618795:0:75660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.618809:0:75660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 18 pid: 5793 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757813.618903:0:75660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75660:1869355211512192:0@lo:104: 00000100:00100000:3.0:1782757813.618977:0:75660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757813.619066:0:75660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1782757813.619109:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512192 00000100:00100000:0.0:1782757813.619116:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512192 00000100:00100000:0.0:1782757813.619209:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782757813.619230:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75660:x1869355211512192:12345-0@lo:104: 00010000:00010000:0.0:1782757813.619242:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757813.619351:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757813.619358:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75660:x1869355211512192:12345-0@lo:104: Request processed in 141us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757813.619365:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:2.0:1782757813.619417:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757813.619425:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757813.619431:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757813.619436:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757813.619444:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757813.619451:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757813.619458:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757813.619494:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757813.619501:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757813.619520:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757813.619526:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777d9c06 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757813.619540:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757813.619542:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757813.619543:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757813.619679:0:75660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75660:1869355211512192:0@lo:104: 00010000:00010000:3.0:1782757813.619697:0:75660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757813.619723:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211512320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757813.619750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757813.619855:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512320 00000100:00100000:1.0:1782757813.619860:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512320 00010000:00010000:1.0:1782757813.619881:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757813.619905:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782757813.619912:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211512320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757813.619921:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757813.619926:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619935:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619946:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193147a00/0xdd99f5c4777d9c0d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c06 expref: 19 pid: 5793 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619957:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619970:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619982:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619989:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.619995:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.620001:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.620006:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757813.620010:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.620016:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.620029:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757813.620037:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757813.620068:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211512320:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757813.620075:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782757813.620102:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211512320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757813.620287:0:75660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.620295:0:75660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757813.620301:0:75660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777d9c14 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757813.686656:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211512448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757813.686896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757813.687114:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512448 00000100:00100000:1.0:1782757813.687122:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512448 00000100:00100000:1.0:1782757813.687181:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1782757813.687190:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211512448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757813.687237:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757813.692894:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211512448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5695us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757813.692911:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1782757813.698906:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211512448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757813.804819:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782757814.700448:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757814.700456:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757814.700462:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757814.700515:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757814.700528:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757814.700539:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757814.700567:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211512576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757814.700639:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757814.700693:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916540 going to sleep for 11 seconds 00000100:00100000:0.0:1782757814.701390:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512576 00000100:00100000:0.0:1782757814.701399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512576 00000100:00100000:0.0:1782757814.701541:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1782757814.701552:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211512576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757814.701569:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757814.701584:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c1b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757814.701609:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757814.701620:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757814.701633:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147600, rc 0) 00000100:00100000:0.0:1782757814.701686:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211512576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757814.701693:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1782757814.707903:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211512576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757814.707932:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757814.707943:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757814.707966:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757814.707971:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757814.707978:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782757814.790280:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967551 is committed 00000001:00080000:1.0:1782757814.790334:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 00010000:00010000:3.0:1782757814.828800:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757815.854123:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757816.241562:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782757816.241585:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211512704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757816.241654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757816.241723:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512704 00000100:00100000:0.0:1782757816.241730:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512704 00000100:00100000:0.0:1782757816.241778:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1782757816.241787:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211512704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757816.241819:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757816.241886:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211512704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757816.241893:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00080000:0.0:1782757816.241920:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757816.241951:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211512704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757816.880084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757817.247099:0:75857:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe43436b60 20000000:00000080:1.0:1782757817.247120:0:75857:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d81800 uarg=0000000000000000 00010000:00010000:1.0:1782757817.247702:0:75857:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757817.247713:0:75857:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757817.247727:0:75857:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757817.247741:0:75857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.247754:0:75857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.247760:0:75857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.247798:0:75857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.247811:0:75857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 18 pid: 5796 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757817.248018:0:75857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75857:1869355211512832:0@lo:104: 00000100:00100000:1.0:1782757817.248091:0:75857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757817.248174:0:75857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782757817.248210:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512832 00000100:00100000:3.0:1782757817.248217:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512832 00000100:00100000:3.0:1782757817.248266:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1782757817.248287:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75857:x1869355211512832:12345-0@lo:104: 00010000:00010000:3.0:1782757817.248300:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757817.248426:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757817.248431:0:75857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75857:1869355211512832:0@lo:104: 00000100:00100000:3.0:1782757817.248433:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:75857:x1869355211512832:12345-0@lo:104: Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757817.248441:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:1.0:1782757817.248451:0:75857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248491:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757817.248498:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248505:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757817.248509:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248518:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757817.248527:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757817.248533:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757817.248601:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248608:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782757817.248656:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1782757817.248673:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248679:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690600/0xdd99f5c4777d9c1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.248692:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757817.248694:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757817.248695:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757817.248769:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211512960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757817.248802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757817.249074:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211512960 00000100:00100000:0.0:1782757817.249079:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211512960 00010000:00010000:0.0:1782757817.249101:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757817.249158:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1782757817.249166:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211512960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757817.249180:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757817.249186:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249196:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249210:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c1b expref: 19 pid: 5796 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249224:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249231:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249245:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249252:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249258:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249263:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249285:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757817.249289:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249297:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249315:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757817.249332:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757817.249413:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211512960:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757817.249420:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:1.0:1782757817.249471:0:75857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.249479:0:75857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757817.249486:0:75857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c29 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757817.250340:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211512960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757817.524744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757817.524803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757817.524855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757817.524870:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655488 00000100:00100000:2.0:1782757817.524881:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655488 00000100:00100000:0.0:1782757817.524883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757817.524904:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655360 00000100:00100000:0.0:1782757817.524908:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655360 00000100:00100000:1.0:1782757817.524982:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655232 00000100:00100000:1.0:1782757817.524987:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655232 00000100:00100000:1.0:1782757817.525023:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1314 00000100:00100000:1.0:1782757817.525034:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757817.525112:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757817.525119:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1314 00000100:00100000:1.0:1782757817.525147:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655104 00000100:00100000:1.0:1782757817.525150:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655104 00000100:00100000:1.0:1782757817.525188:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1088 00000100:00100000:1.0:1782757817.525195:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196655104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757817.525221:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196655104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757817.525228:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1088 00000100:00100000:0.0:1782757817.525450:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1782757817.525459:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757817.525499:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757817.525506:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1782757817.525527:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:0.0:1782757817.525533:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757817.525557:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757817.525563:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00080000:0.0:1782757817.527166:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757817.527778:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757817.527782:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782757817.900021:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757818.287844:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211513216:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.287913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.287969:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211513728:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.287996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.288022:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782757818.288028:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211513088:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.288079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211513600:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.288127:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211513344:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.288170:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757818.288175:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211513472:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757818.288225:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513216 00000100:00100000:0.0:1782757818.288232:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513216 00000100:00100000:0.0:1782757818.288286:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513600 00000100:00100000:0.0:1782757818.288290:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513600 00000100:00100000:0.0:1782757818.288320:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1782757818.288329:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211513216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288385:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211513216:12345-0@lo:400:kworker.0 Request processed in 56us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.288393:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1782757818.288418:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513344 00000100:00100000:0.0:1782757818.288421:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513344 00000100:00100000:0.0:1782757818.288436:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1782757818.288442:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211513600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288470:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211513600:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.288481:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1782757818.288493:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1782757818.288500:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211513344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288531:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211513344:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.288537:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1782757818.288558:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513728 00000100:00100000:0.0:1782757818.288562:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513728 00000100:00100000:0.0:1782757818.288817:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513472 00000100:00100000:0.0:1782757818.288844:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513472 00000100:00100000:0.0:1782757818.288866:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1782757818.288872:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211513728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288907:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211513728:12345-0@lo:400:kworker.0 Request processed in 35us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.288914:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1782757818.288927:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1782757818.288934:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211513472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.288962:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211513472:12345-0@lo:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.288967:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1782757818.288985:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513088 00000100:00100000:0.0:1782757818.288988:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513088 00000100:00100000:0.0:1782757818.289011:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1782757818.289017:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211513088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289047:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211513088:12345-0@lo:400:kworker.0 Request processed in 30us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.289056:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:0.0:1782757818.289097:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757818.289100:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757818.289102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757818.289135:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211513472:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289147:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211513344:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289179:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211513088:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289189:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211513600:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289198:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211513216:0@lo:400:kworker.0 00000100:00100000:0.0:1782757818.289205:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211513728:0@lo:400:kworker.0 10000000:01000000:3.0:1782757818.676933:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757818.676946:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757818.676954:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757818.677040:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757818.677057:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757818.677073:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757818.677109:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211513856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757818.677209:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757818.677287:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46840 going to sleep for 11 seconds 00000100:00100000:0.0:1782757818.677622:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513856 00000100:00100000:0.0:1782757818.677633:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513856 00000100:00100000:0.0:1782757818.677708:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1782757818.677719:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211513856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757818.677740:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757818.677760:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c30 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757818.677793:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757818.677806:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757818.677816:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917193147600, rc 0) 00000100:00100000:0.0:1782757818.677918:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211513856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757818.677927:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1782757818.678053:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211513856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757818.678081:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757818.678091:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757818.678119:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757818.678126:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757818.678137:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757818.797066:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211513984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757818.797169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757818.797663:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211513984 00000100:00100000:3.0:1782757818.797675:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211513984 00000100:00100000:3.0:1782757818.797757:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1782757818.797769:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211513984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757818.797858:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757818.797926:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211513984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757818.797935:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1782757818.809290:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211513984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757818.924479:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757819.948948:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757820.971984:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757821.356105:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211514112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757821.356178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757821.356301:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514112 00000100:00100000:0.0:1782757821.356309:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514112 00000100:00100000:0.0:1782757821.356376:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1782757821.356386:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211514112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757821.356423:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757821.356474:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211514112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757821.356482:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1782757821.356554:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211514112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757821.356787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757821.996264:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757822.646977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757822.647025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757822.647077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757822.647106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757822.647253:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655616 00000100:00100000:3.0:1782757822.647264:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655616 00000100:00100000:3.0:1782757822.647319:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1091 00000100:00100000:3.0:1782757822.647329:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196655616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757822.647401:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196655616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757822.647408:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1091 00000100:00100000:2.0:1782757822.649690:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656000 00000100:00100000:2.0:1782757822.649702:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656000 00000100:00100000:2.0:1782757822.649773:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655872 00000100:00100000:2.0:1782757822.649776:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655872 00000100:00100000:2.0:1782757822.649806:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:2.0:1782757822.649817:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196656000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757822.649934:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196656000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 117us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757822.649942:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:2.0:1782757822.649960:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:2.0:1782757822.649967:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757822.649991:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757822.649997:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00080000:1.0:1782757822.650239:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757822.650244:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757822.650332:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196655744 00000100:00100000:0.0:1782757822.650337:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196655744 00000100:00100000:0.0:1782757822.650391:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1318 00000100:00100000:0.0:1782757822.650399:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757822.650431:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196655744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (3466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757822.650437:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1318 00000100:00080000:1.0:1782757822.651309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782757823.024489:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757823.405885:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211514496:0@lo:400:kworker.0 00000100:00100000:3.0:1782757823.405956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757823.406012:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757823.406017:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211514624:0@lo:400:kworker.0 00000100:00100000:3.0:1782757823.406044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757823.406072:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514624 00000100:00100000:3.0:1782757823.406078:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514624 00000100:00100000:3.0:1782757823.406316:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1782757823.406326:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211514624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757823.406381:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211514624:12345-0@lo:400:kworker.0 Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757823.406388:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:3.0:1782757823.406407:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757823.406434:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211514624:0@lo:400:kworker.0 00000100:00100000:1.0:1782757823.406635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514496 00000100:00100000:1.0:1782757823.406640:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514496 00000100:00100000:1.0:1782757823.406668:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1782757823.406675:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211514496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757823.406708:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211514496:12345-0@lo:400:kworker.0 Request processed in 34us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757823.406714:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1782757823.406795:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211514240:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.406849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757823.406881:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211514752:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.406900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757823.406919:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782757823.406925:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211514368:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.406943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757823.406956:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211514880:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.406974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757823.406999:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514752 00000100:00100000:0.0:1782757823.407002:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514752 00000100:00100000:0.0:1782757823.407023:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514368 00000100:00100000:0.0:1782757823.407025:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514368 00000100:00100000:0.0:1782757823.407039:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1782757823.407045:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211514752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.407077:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211514752:12345-0@lo:400:kworker.0 Request processed in 32us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757823.407083:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1782757823.407104:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1782757823.407110:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211514368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.407137:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211514368:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757823.407142:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1782757823.407178:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514880 00000100:00100000:0.0:1782757823.407182:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514880 00000100:00100000:0.0:1782757823.407207:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1782757823.407213:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.407241:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211514880:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757823.407246:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1782757823.407274:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211514368:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.407282:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211514880:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.407290:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211514752:0@lo:400:kworker.0 00000100:00100000:1.0:1782757823.407376:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211514240 00000100:00100000:1.0:1782757823.407380:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211514240 00000100:00100000:1.0:1782757823.407401:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1782757823.407407:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211514240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757823.407434:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211514240:12345-0@lo:400:kworker.0 Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757823.407439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:3.0:1782757823.408658:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757823.408666:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757823.408703:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211514496:0@lo:400:kworker.0 00000100:00100000:0.0:1782757823.409678:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211514240:0@lo:400:kworker.0 00000100:00100000:2.0:1782757823.916454:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757823.916479:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757823.916551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757823.916654:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515008 00000100:00100000:3.0:1782757823.916662:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515008 00000100:00100000:3.0:1782757823.916712:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1782757823.916721:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757823.916757:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757823.916802:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757823.916809:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1782757823.916935:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211515008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757824.046581:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757825.068669:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757826.092029:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757826.493615:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211515136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757826.493689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757826.493767:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515136 00000100:00100000:3.0:1782757826.493774:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515136 00000100:00100000:3.0:1782757826.493854:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1782757826.493864:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211515136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757826.493901:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757826.493945:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211515136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757826.493953:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00080000:3.0:1782757826.493974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757826.494009:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211515136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782757827.116671:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757827.775344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757827.775403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757827.775501:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656128 00000100:00100000:0.0:1782757827.775515:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656128 00000100:00100000:0.0:1782757827.775590:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:0.0:1782757827.775601:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196656128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757827.775683:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196656128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757827.775695:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:1.0:1782757827.776232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757827.776268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757827.776313:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656256 00000100:00100000:0.0:1782757827.776319:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656256 00000100:00100000:0.0:1782757827.776370:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:0.0:1782757827.776377:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757827.776435:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757827.776443:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00080000:2.0:1782757827.776450:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757827.786582:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656384 00000100:00100000:3.0:1782757827.786847:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656384 00000100:00100000:3.0:1782757827.786986:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656512 00000100:00100000:3.0:1782757827.786990:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656512 00000100:00100000:1.0:1782757827.787044:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00100000:1.0:1782757827.787057:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757827.787151:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (11747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757827.787160:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00080000:0.0:1782757827.787579:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757827.787584:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757827.788013:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00100000:3.0:1782757827.788022:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757827.788088:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196656512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (11818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757827.788094:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 986 00010000:00010000:1.0:1782757828.140748:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757828.524973:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211515264:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757828.525115:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211515776:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757828.525168:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782757828.525173:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211515392:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757828.525211:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211515904:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757828.525275:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515776 00000100:00100000:0.0:1782757828.525282:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515776 00000100:00100000:0.0:1782757828.525330:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515392 00000100:00100000:0.0:1782757828.525333:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515392 00000100:00100000:0.0:1782757828.525355:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1782757828.525363:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211515776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525416:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211515776:12345-0@lo:400:kworker.0 Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757828.525423:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1782757828.525449:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1782757828.525455:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211515392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525483:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211515392:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757828.525489:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1782757828.525511:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515904 00000100:00100000:0.0:1782757828.525515:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515904 00000100:00100000:0.0:1782757828.525540:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1782757828.525547:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525579:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211515904:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757828.525585:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00080000:0.0:1782757828.525602:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757828.525606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757828.525639:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211515392:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525648:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211515904:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.525655:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211515776:0@lo:400:kworker.0 00000100:00100000:1.0:1782757828.525728:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515264 00000100:00100000:1.0:1782757828.525732:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515264 00000100:00100000:1.0:1782757828.525771:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1782757828.525778:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211515264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757828.525814:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211515264:12345-0@lo:400:kworker.0 Request processed in 37us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757828.525837:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1782757828.525872:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211515264:0@lo:400:kworker.0 00000100:00100000:3.0:1782757828.525980:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211515520:0@lo:400:kworker.0 00000100:00100000:3.0:1782757828.526009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757828.526026:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757828.526031:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211515648:0@lo:400:kworker.0 00000100:00100000:3.0:1782757828.526062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757828.526094:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515648 00000100:00100000:3.0:1782757828.526098:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515648 00000100:00100000:3.0:1782757828.526129:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1782757828.526135:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211515648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757828.526166:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211515648:12345-0@lo:400:kworker.0 Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757828.526172:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00080000:3.0:1782757828.526188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757828.526209:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211515648:0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.526275:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211515520 00000100:00100000:0.0:1782757828.526278:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211515520 00000100:00100000:0.0:1782757828.526303:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1782757828.526308:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211515520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757828.526340:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211515520:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757828.526346:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00080000:3.0:1782757828.531967:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757828.532115:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211515520:0@lo:400:kworker.0 00000001:02000400:3.0:1782757828.641299:0:76203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 14:30:26 (1782757826) 00000100:00100000:1.0:1782757829.036512:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757829.036550:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211516032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757829.036636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757829.036776:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516032 00000100:00100000:2.0:1782757829.036784:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516032 00000100:00100000:2.0:1782757829.039146:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1782757829.039169:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211516032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757829.039222:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757829.039325:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211516032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757829.039333:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1782757829.039617:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211516032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757829.164088:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1782757829.768285:0:76251:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782757829.778253:0:76251:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1782757830.191247:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782757830.875039:0:76299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc61623860 20000000:00000080:2.0:1782757830.875057:0:76299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081115000 uarg=0000000000000000 10000000:01000000:2.0:1782757830.875967:0:76299:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782757830.875986:0:76299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.876012:0:76299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.876021:0:76299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.876059:0:76299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.876073:0:76299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 18 pid: 5796 timeout: 1999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757830.876088:0:76299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76299:1869355211516160:0@lo:104: 00000100:00100000:2.0:1782757830.876150:0:76299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757830.876319:0:76299:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782757830.876579:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516160 00000100:00100000:1.0:1782757830.876586:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516160 00000100:00100000:1.0:1782757830.876681:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1782757830.876691:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76299:x1869355211516160:12345-0@lo:104: 00010000:00010000:1.0:1782757830.876705:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757830.876771:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757830.876776:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76299:x1869355211516160:12345-0@lo:104: Request processed in 88us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757830.876782:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:0.0:1782757830.876850:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757830.876857:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.876864:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757830.876869:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.876877:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757830.876883:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757830.876888:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757830.876915:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.876922:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757830.876940:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.876946:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777d9c30 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c37 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.876961:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757830.876963:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757830.876965:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757830.876980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757830.876991:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211516288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757830.877033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757830.877071:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516288 00000100:00100000:0.0:1782757830.877076:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516288 00010000:00010000:0.0:1782757830.877093:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 19 pid: 5796 timeout: 1999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757830.877116:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1782757830.877123:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211516288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757830.877133:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757830.877138:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 19 pid: 5796 timeout: 1999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877148:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 19 pid: 5796 timeout: 1999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877162:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877169:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877182:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877187:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877193:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877203:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877209:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757830.877213:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877219:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877227:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757830.877234:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757830.877261:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211516288:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757830.877267:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1782757830.877313:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211516288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757830.877456:0:76299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193147600/0xdd99f5c4777d9c37 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c30 expref: 18 pid: 5796 timeout: 1999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757830.877467:0:76299:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76299:1869355211516160:0@lo:104: 00010000:00010000:2.0:1782757830.877480:0:76299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.877488:0:76299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.877494:0:76299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757830.877500:0:76299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777d9c3e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757831.213628:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757831.604108:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211516416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757831.604265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757831.604353:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516416 00000100:00100000:0.0:1782757831.604361:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516416 00000100:00100000:0.0:1782757831.604641:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1782757831.604655:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211516416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757831.604761:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757831.605042:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211516416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 389us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757831.605055:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:0.0:1782757831.605096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757831.605154:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211516416:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782757831.713713:0:76347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee956c4f0 20000000:00000080:1.0:1782757831.713814:0:76347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d83000 uarg=0000000000000000 10000000:01000000:1.0:1782757831.714153:0:76347:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757831.714176:0:76347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714193:0:76347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714203:0:76347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714210:0:76347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714217:0:76347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714224:0:76347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714231:0:76347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757831.714235:0:76347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714243:0:76347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714256:0:76347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714263:0:76347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757831.714270:0:76347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777d9c45 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757832.236031:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782757832.236112:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757832.236118:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757832.236124:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757832.236170:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.236183:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.236458:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757832.236577:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211516544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757832.236647:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757832.236704:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917187284f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782757832.236887:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516544 00000100:00100000:0.0:1782757832.236895:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516544 00000100:00100000:0.0:1782757832.236950:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1782757832.236960:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211516544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757832.236974:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757832.236998:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c4c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757832.237021:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757832.237030:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757832.237039:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757832.237143:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211516544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757832.237151:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1782757832.240927:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211516544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757832.241023:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.241035:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757832.241066:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757832.241072:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.241080:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782757832.393032:0:76395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff20850b20 20000000:00000080:1.0:1782757832.393050:0:76395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d83800 uarg=0000000000000000 10000000:01000000:1.0:1782757832.393457:0:76395:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757832.393478:0:76395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.393498:0:76395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.393507:0:76395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.393548:0:76395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.393562:0:76395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 18 pid: 5796 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757832.393577:0:76395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76395:1869355211516672:0@lo:104: 00000100:00100000:1.0:1782757832.393642:0:76395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757832.393696:0:76395:0:(client.c:2701:ptlrpc_set_wait()) set ffff917187284f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782757832.394399:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516672 00000100:00100000:0.0:1782757832.394407:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516672 00000100:00100000:0.0:1782757832.394523:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1782757832.394534:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76395:x1869355211516672:12345-0@lo:104: 00010000:00010000:0.0:1782757832.394553:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757832.394641:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757832.394648:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76395:x1869355211516672:12345-0@lo:104: Request processed in 117us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757832.394654:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:2.0:1782757832.394721:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757832.394728:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.394736:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757832.394741:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.394755:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757832.394763:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757832.394769:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757832.394802:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.394808:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757832.394847:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.394855:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777d9c4c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.394868:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757832.394870:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757832.394872:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757832.394883:0:76395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76395:1869355211516672:0@lo:104: 00000100:00100000:2.0:1782757832.394889:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211516800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757832.394917:0:76395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757832.394923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757832.394966:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516800 00000100:00100000:2.0:1782757832.394971:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516800 00010000:00010000:2.0:1782757832.395002:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757832.395032:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782757832.395039:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211516800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757832.395050:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757832.395055:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395078:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395091:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9c53 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c4c expref: 19 pid: 5796 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395103:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395113:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395132:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395139:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395146:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395152:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395158:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757832.395162:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395174:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395196:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757832.395205:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757832.395241:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211516800:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757832.395248:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1782757832.395269:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211516800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757832.395497:0:76395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.395505:0:76395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757832.395510:0:76395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9c5a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757832.896249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757832.896299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757832.896333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757832.896359:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656896 00000100:00100000:0.0:1782757832.896369:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656896 00000100:00100000:0.0:1782757832.896423:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657024 00000100:00100000:0.0:1782757832.896426:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657024 00000100:00100000:0.0:1782757832.896448:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 366 00000100:00100000:0.0:1782757832.896457:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196656896:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782757832.896488:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9acb 00000100:00080000:0.0:1782757832.896614:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917191a81800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782757832.896654:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:0.0:1782757832.897049:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196656896:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 590us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757832.897059:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 366 00000100:00100000:0.0:1782757832.897077:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00100000:0.0:1782757832.897084:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196657024:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782757832.897097:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9b57 00000100:00080000:0.0:1782757832.897102:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9171b785f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782757832.897123:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:0.0:1782757832.897260:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196657024:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 175us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757832.897270:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00080000:0.0:1782757832.897291:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757832.897295:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782757832.897308:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757832.897314:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757832.897409:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757832.897434:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656768 00000100:00100000:0.0:1782757832.897439:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656768 00000100:00100000:0.0:1782757832.897472:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1326 00000100:00100000:0.0:1782757832.897479:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196656768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757832.897509:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196656768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757832.897516:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1326 00000100:00080000:0.0:1782757832.897535:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757832.897676:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196656640 00000100:00100000:1.0:1782757832.897681:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196656640 00000100:00100000:1.0:1782757832.897716:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000100:00100000:1.0:1782757832.897723:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196656640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757832.897757:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196656640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757832.897764:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000020:00000080:0.0:1782757833.134076:0:76443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1c7f1f70 20000000:00000080:0.0:1782757833.134094:0:76443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708270ac00 uarg=0000000000000000 10000000:01000000:0.0:1782757833.134363:0:76443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757833.134384:0:76443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134399:0:76443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134410:0:76443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134417:0:76443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134429:0:76443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134437:0:76443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134444:0:76443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757833.134448:0:76443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134457:0:76443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134469:0:76443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134477:0:76443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757833.134484:0:76443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c61 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757833.261052:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757833.654081:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211517184:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757833.654284:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757833.654292:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211517312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757833.654488:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211517056:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757833.654543:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211517568:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757833.654582:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782757833.654587:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211516928:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757833.654638:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211517440:0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.654658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757833.659546:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517184 00000100:00100000:0.0:1782757833.659568:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517184 00000100:00100000:0.0:1782757833.659663:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517056 00000100:00100000:0.0:1782757833.659667:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517056 00000100:00100000:0.0:1782757833.659695:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517440 00000100:00100000:0.0:1782757833.659698:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517440 00000100:00100000:0.0:1782757833.659720:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1782757833.659730:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211517184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.659887:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211517184:12345-0@lo:400:kworker.0 Request processed in 158us (5700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757833.659895:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1782757833.659926:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1782757833.659932:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211517056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.659982:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211517056:12345-0@lo:400:kworker.0 Request processed in 50us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757833.659989:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1782757833.660001:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1782757833.660008:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211517440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.660037:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211517440:12345-0@lo:400:kworker.0 Request processed in 30us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757833.660043:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1782757833.660066:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517312 00000100:00100000:0.0:1782757833.660069:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517312 00000100:00100000:0.0:1782757833.660097:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517568 00000100:00100000:0.0:1782757833.660101:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517568 00000100:00100000:0.0:1782757833.660121:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1782757833.660128:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211517312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.660162:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211517312:12345-0@lo:400:kworker.0 Request processed in 35us (5834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757833.660169:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1782757833.660182:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1782757833.660187:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211517568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.660217:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211517568:12345-0@lo:400:kworker.0 Request processed in 30us (5651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757833.660225:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:2.0:1782757833.660490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757833.660496:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757833.660499:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757833.661059:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211516928 00000100:00100000:2.0:1782757833.661066:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211516928 00000100:00100000:2.0:1782757833.661119:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1782757833.661128:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211516928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757833.661176:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211516928:12345-0@lo:400:kworker.0 Request processed in 49us (6558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757833.661183:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1782757833.662926:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211517440:0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.662975:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211517056:0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.662992:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211517568:0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.663027:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211516928:0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.663063:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211517312:0@lo:400:kworker.0 00000100:00100000:0.0:1782757833.663077:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211517184:0@lo:400:kworker.0 10000000:01000000:3.0:1782757833.966418:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757833.966432:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757833.966440:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757833.966517:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757833.966532:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757833.966545:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757833.966578:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211517696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757833.966669:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757833.966750:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782757833.967118:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517696 00000100:00100000:2.0:1782757833.967128:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517696 00000100:00100000:2.0:1782757833.967191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1782757833.967202:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211517696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757833.967220:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757833.967237:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c68 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757833.967402:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757833.967416:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757833.967427:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782757833.967487:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211517696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757833.967495:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1782757833.969048:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211517696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757833.969087:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757833.969100:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757833.969131:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757833.969138:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757833.969147:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757834.156199:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757834.160198:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211517824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757834.160276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1782757834.166619:0:76491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed3941a50 20000000:00000080:0.0:1782757834.166639:0:76491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082709400 uarg=0000000000000000 00000100:00100000:3.0:1782757834.167022:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517824 00000100:00100000:3.0:1782757834.167033:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517824 00000100:00100000:2.0:1782757834.167216:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1782757834.167228:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211517824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757834.167269:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757834.167349:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211517824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757834.167368:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1782757834.167604:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211517824:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1782757834.169309:0:76491:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757834.169337:0:76491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.169610:0:76491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.169622:0:76491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.169665:0:76491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.169680:0:76491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 18 pid: 5796 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757834.169697:0:76491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76491:1869355211517952:0@lo:104: 00000100:00100000:0.0:1782757834.169761:0:76491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757834.169877:0:76491:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782757834.169949:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782757834.169973:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211517952 00000100:00100000:1.0:1782757834.169981:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211517952 00000100:00100000:1.0:1782757834.170023:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782757834.170032:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3471450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76491:x1869355211517952:12345-0@lo:104: 00010000:00010000:1.0:1782757834.170046:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757834.170108:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757834.170114:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3471450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76491:x1869355211517952:12345-0@lo:104: Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757834.170121:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:2.0:1782757834.171060:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757834.171069:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757834.171079:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757834.171083:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757834.171092:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757834.171099:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757834.171103:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757834.171146:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757834.171153:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757834.171175:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757834.171182:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777d9c68 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757834.171206:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757834.171207:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757834.171209:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757834.171217:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757834.171231:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211518080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757834.171281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757834.171401:0:76491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76491:1869355211517952:0@lo:104: 00010000:00010000:0.0:1782757834.171421:0:76491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757834.173282:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518080 00000100:00100000:0.0:1782757834.173296:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518080 00010000:00010000:0.0:1782757834.173344:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757834.173397:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1782757834.173407:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211518080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757834.173422:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757834.173427:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173438:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173456:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777d9c6f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c68 expref: 19 pid: 5796 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173473:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173482:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173500:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173508:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173515:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173522:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173529:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757834.173534:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173542:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173559:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173570:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757834.173646:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211518080:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757834.173653:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:0.0:1782757834.173726:0:76491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173734:0:76491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757834.173741:0:76491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525600/0xdd99f5c4777d9c76 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757834.185508:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211518080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757834.295390:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757835.150090:0:76540:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea4a635e0 20000000:00000080:1.0:1782757835.150108:0:76540:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d81400 uarg=0000000000000000 10000000:01000000:1.0:1782757835.150322:0:76540:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757835.150344:0:76540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150359:0:76540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150370:0:76540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150377:0:76540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150385:0:76540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150392:0:76540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150398:0:76540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757835.150402:0:76540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150411:0:76540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150426:0:76540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150434:0:76540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757835.150440:0:76540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9c7d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757835.307940:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782757836.081525:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757836.081533:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757836.081538:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757836.081639:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757836.081652:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757836.081663:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757836.081690:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211518208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757836.081782:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757836.081863:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b8a240 going to sleep for 11 seconds 00000100:00100000:1.0:1782757836.082310:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518208 00000100:00100000:1.0:1782757836.082329:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518208 00000100:00100000:1.0:1782757836.082381:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1782757836.082391:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211518208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757836.082406:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757836.082421:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9c84 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757836.082447:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757836.082458:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757836.082468:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782757836.082524:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211518208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757836.082535:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1782757836.084581:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211518208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757836.084618:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757836.084630:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757836.084651:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757836.084656:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757836.084665:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757836.339862:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757836.718218:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211518336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757836.718285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757836.718478:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518336 00000100:00100000:3.0:1782757836.718487:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518336 00000100:00100000:3.0:1782757836.718546:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1782757836.718557:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211518336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757836.718592:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757836.718646:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211518336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757836.718653:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1782757836.718698:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211518336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757836.718753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782757837.356061:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782757837.807990:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782757837.808000:0:6622:0:(genops.c:906:class_export_put()) final put ffff917191a80000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782757837.808075:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff917191a80000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:2.0:1782757837.808130:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917191a81800 for lustre-OST0000 00000001:00100000:1.0:1782757837.824728:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782757837.824735:0:7507:0:(genops.c:906:class_export_put()) final put ffff91719035f800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782757837.824803:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91719035f800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:2.0:1782757837.824884:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b785f800 for lustre-OST0001 00000100:00100000:2.0:1782757838.028735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757838.028794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757838.028976:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657152 00000100:00100000:1.0:1782757838.028988:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657152 00000100:00100000:1.0:1782757838.029052:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:0.0:1782757838.029055:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657280 00000100:00100000:0.0:1782757838.029061:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657280 00000100:00100000:1.0:1782757838.029066:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196657152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757838.029115:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1330 00000100:00100000:0.0:1782757838.029124:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196657280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757838.029144:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196657152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757838.029152:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:0.0:1782757838.029197:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196657280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.029205:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1330 00000100:00080000:0.0:1782757838.029247:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782757838.192799:0:76692:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce2431380 20000000:00000080:1.0:1782757838.192816:0:76692:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d81c00 uarg=0000000000000000 10000000:01000000:1.0:1782757838.193509:0:76692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757838.193531:0:76692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757838.193549:0:76692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757838.193558:0:76692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757838.193595:0:76692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757838.193610:0:76692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 18 pid: 5793 timeout: 2006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757838.193640:0:76692:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76692:1869355211518464:0@lo:104: 00000100:00100000:1.0:1782757838.193705:0:76692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757838.193769:0:76692:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782757838.194855:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518464 00000100:00100000:0.0:1782757838.194876:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518464 00000100:00100000:0.0:1782757838.194926:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1782757838.194936:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76692:x1869355211518464:12345-0@lo:104: 00010000:00010000:0.0:1782757838.194959:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195029:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757838.195034:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76692:x1869355211518464:12345-0@lo:104: Request processed in 101us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.195040:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1782757838.195073:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757838.195079:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195086:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757838.195091:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195099:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757838.195107:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757838.195112:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757838.195144:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195149:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757838.195168:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195175:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777d9c84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9c8b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195191:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757838.195193:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757838.195195:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757838.195212:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211518592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757838.195243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.195298:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518592 00000100:00100000:0.0:1782757838.195302:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518592 00000100:00100000:2.0:1782757838.195309:0:76692:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76692:1869355211518464:0@lo:104: 00010000:00010000:0.0:1782757838.195319:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 2006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757838.195328:0:76692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757838.195341:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1782757838.195347:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211518592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757838.195357:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757838.195362:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 2006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195372:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 2006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195385:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777d9c8b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9c84 expref: 19 pid: 5793 timeout: 2006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195396:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195404:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195417:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195423:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195429:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195435:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195440:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757838.195443:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195450:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195471:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757838.195480:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757838.195506:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211518592:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.195513:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1782757838.195543:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211518592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757838.195545:0:76692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757838.195552:0:76692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757838.195560:0:76692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777d9c92 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757838.393518:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757838.766740:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211518848:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.766814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.766908:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211519360:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.766935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.767130:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782757838.767137:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211518720:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.767196:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211519232:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.767249:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211518976:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.767292:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757838.767297:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211519104:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757838.767351:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518848 00000100:00100000:0.0:1782757838.767359:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518848 00000100:00100000:0.0:1782757838.767396:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519232 00000100:00100000:0.0:1782757838.767399:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519232 00000100:00100000:0.0:1782757838.767423:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518976 00000100:00100000:0.0:1782757838.767426:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518976 00000100:00100000:0.0:1782757838.767442:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1782757838.767449:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211518848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767502:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211518848:12345-0@lo:400:kworker.0 Request processed in 53us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.767509:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1782757838.767536:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1782757838.767542:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211519232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767572:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211519232:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.767578:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1782757838.767591:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1782757838.767597:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211518976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767628:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211518976:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.767634:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1782757838.767652:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519360 00000100:00100000:0.0:1782757838.767655:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519360 00000100:00100000:0.0:1782757838.767680:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519104 00000100:00100000:0.0:1782757838.767683:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519104 00000100:00100000:0.0:1782757838.767702:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1782757838.767708:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211519360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767737:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211519360:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.767743:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1782757838.767753:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1782757838.767758:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211519104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.767781:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211519104:12345-0@lo:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757838.767787:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:0.0:1782757838.767814:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757838.767817:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757838.767819:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757838.768193:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211519104:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.768209:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211518976:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.768246:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211519232:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.768256:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211518848:0@lo:400:kworker.0 00000100:00100000:0.0:1782757838.768266:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211519360:0@lo:400:kworker.0 00000100:00100000:2.0:1782757838.772648:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211518720 00000100:00100000:2.0:1782757838.773041:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211518720 00000100:00100000:2.0:1782757838.773153:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1782757838.773164:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211518720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757838.773264:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211518720:12345-0@lo:400:kworker.0 Request processed in 102us (6092us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757838.773271:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1782757838.773359:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211518720:0@lo:400:kworker.0 00000020:00000080:3.0:1782757839.042510:0:76740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd321009a0 20000000:00000080:3.0:1782757839.042531:0:76740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc1800 uarg=0000000000000000 10000000:01000000:3.0:1782757839.042753:0:76740:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757839.042776:0:76740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042793:0:76740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042804:0:76740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042810:0:76740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042816:0:76740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042864:0:76740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042870:0:76740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757839.042874:0:76740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042883:0:76740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042895:0:76740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042903:0:76740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757839.042913:0:76740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777d9c99 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757839.288238:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757839.288261:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211519488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757839.288331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757839.288401:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519488 00000100:00100000:3.0:1782757839.288409:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519488 00000100:00100000:3.0:1782757839.288469:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1782757839.288478:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211519488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757839.288516:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757839.288558:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211519488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757839.288565:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1782757839.288621:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211519488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757839.414037:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782757839.469178:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757839.469185:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757839.469190:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757839.469234:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757839.469246:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757839.469257:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757839.469284:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211519616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757839.469350:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757839.469409:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782757839.469499:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519616 00000100:00100000:2.0:1782757839.469507:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519616 00000100:00100000:2.0:1782757839.469559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1782757839.469569:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211519616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757839.469583:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757839.469596:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9ca0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757839.469620:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757839.469631:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757839.469640:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757839.469688:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211519616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757839.469695:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1782757839.469808:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211519616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757839.469869:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757839.469879:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757839.469899:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757839.469904:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757839.469912:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757840.428086:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757841.452289:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757841.837020:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757841.837044:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211519744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757841.837582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757841.839215:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519744 00000100:00100000:3.0:1782757841.839227:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519744 00000100:00100000:3.0:1782757841.839430:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1782757841.839439:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211519744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757841.839477:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757841.839712:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211519744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757841.839720:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00080000:2.0:1782757841.839846:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757841.840750:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211519744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757842.476481:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757842.768626:0:76938:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd88e8ed70 20000000:00000080:1.0:1782757842.768647:0:76938:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d82c00 uarg=0000000000000000 00010000:00010000:1.0:1782757842.774025:0:76938:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757842.774049:0:76938:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757842.774067:0:76938:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757842.774250:0:76938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.774273:0:76938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.774283:0:76938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.774328:0:76938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.774345:0:76938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 18 pid: 5793 timeout: 2011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757842.774361:0:76938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76938:1869355211519872:0@lo:104: 00000100:00100000:1.0:1782757842.774430:0:76938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757842.774612:0:76938:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067900 going to sleep for 11 seconds 00000100:00100000:3.0:1782757842.779680:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211519872 00000100:00100000:3.0:1782757842.779696:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211519872 00000100:00100000:3.0:1782757842.779853:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1782757842.779866:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76938:x1869355211519872:12345-0@lo:104: 00010000:00010000:3.0:1782757842.779898:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757842.779996:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782757842.780003:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:76938:x1869355211519872:12345-0@lo:104: Request processed in 141us (5573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757842.780010:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:2.0:1782757842.780080:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757842.780087:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780108:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757842.780111:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780120:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757842.780129:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757842.780135:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757842.780178:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780184:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757842.780205:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780212:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181525c00/0xdd99f5c4777d9ca0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9ca7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780229:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757842.780231:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757842.780233:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757842.780256:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211520000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757842.780299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757842.780350:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520000 00000100:00100000:2.0:1782757842.780354:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520000 00010000:00010000:2.0:1782757842.780374:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 19 pid: 5793 timeout: 2011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757842.780396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782757842.780403:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211520000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757842.780413:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757842.780418:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 19 pid: 5793 timeout: 2011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780428:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 19 pid: 5793 timeout: 2011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780444:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780465:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780481:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780488:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780495:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780501:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780506:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757842.780510:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780518:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780526:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757842.780534:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757842.780564:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211520000:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757842.780570:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782757842.780610:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211520000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757842.784246:0:76938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777d9ca7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9ca0 expref: 18 pid: 5793 timeout: 2011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757842.784274:0:76938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76938:1869355211519872:0@lo:104: 00010000:00010000:1.0:1782757842.784299:0:76938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.784310:0:76938:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.784317:0:76938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757842.784323:0:76938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777d9cae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757843.127577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757843.127685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757843.127872:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657536 00000100:00100000:0.0:1782757843.127882:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657536 00000100:00100000:0.0:1782757843.127958:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1334 00000100:00100000:0.0:1782757843.127968:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196657536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757843.128055:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196657536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757843.128064:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1334 00000100:00080000:1.0:1782757843.128234:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757843.129433:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657408 00000100:00100000:2.0:1782757843.129560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657408 00000100:00100000:2.0:1782757843.129618:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1103 00000100:00100000:2.0:1782757843.129627:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196657408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757843.129690:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196657408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757843.129699:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1103 00010000:00010000:2.0:1782757843.505935:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757843.886347:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211520256:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757843.886476:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211520768:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757843.886536:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757843.886541:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211520384:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757843.886599:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520256 00000100:00100000:1.0:1782757843.886606:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520256 00000100:00100000:1.0:1782757843.886655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520384 00000100:00100000:1.0:1782757843.886658:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520384 00000100:00100000:1.0:1782757843.886692:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1782757843.886701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211520256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886782:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211520256:12345-0@lo:400:kworker.0 Request processed in 81us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757843.886790:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1782757843.886811:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1782757843.886817:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211520384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886880:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211520384:12345-0@lo:400:kworker.0 Request processed in 63us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757843.886886:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1782757843.886906:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520768 00000100:00100000:1.0:1782757843.886909:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520768 00000100:00100000:1.0:1782757843.886939:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1782757843.886947:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211520768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.886982:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211520768:12345-0@lo:400:kworker.0 Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757843.886989:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:1.0:1782757843.887014:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757843.887020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757843.887058:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211520384:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.887573:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211520256:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.887587:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211520768:0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.887970:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211520512:0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757843.888047:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782757843.888053:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211520128:0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757843.888126:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211520640:0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757843.888183:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520128 00000100:00100000:3.0:1782757843.888188:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520128 00000100:00100000:3.0:1782757843.888223:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1782757843.888231:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211520128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888273:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211520128:12345-0@lo:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757843.888280:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1782757843.888314:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520640 00000100:00100000:3.0:1782757843.888319:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520640 00000100:00100000:3.0:1782757843.888369:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1782757843.888377:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211520640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888413:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211520640:12345-0@lo:400:kworker.0 Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757843.888419:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00080000:3.0:1782757843.888440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757843.888457:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211520128:0@lo:400:kworker.0 00000100:00100000:3.0:1782757843.888467:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211520640:0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.888851:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520512 00000100:00100000:1.0:1782757843.888857:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520512 00000100:00100000:1.0:1782757843.888896:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1782757843.888904:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211520512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757843.888946:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211520512:12345-0@lo:400:kworker.0 Request processed in 43us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757843.888953:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00080000:3.0:1782757843.891025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757843.891100:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211520512:0@lo:400:kworker.0 00000100:00100000:2.0:1782757844.396063:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757844.396650:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211520896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757844.396728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757844.400800:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211520896 00000100:00100000:3.0:1782757844.400818:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211520896 00000100:00100000:3.0:1782757844.400901:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1782757844.400912:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211520896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757844.400959:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757844.401571:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211520896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 657us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757844.401580:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1782757844.401648:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211520896:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1782757844.527665:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782757844.527674:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782757844.527680:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782757844.527728:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757844.527750:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757844.527763:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757844.527790:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211521024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782757844.527886:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757844.527934:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183344f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782757844.528370:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521024 00000100:00100000:0.0:1782757844.528379:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521024 00000100:00100000:0.0:1782757844.528444:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1782757844.528454:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211521024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757844.528471:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757844.528487:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9cb5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757844.528526:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757844.528538:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757844.528547:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525200, rc 0) 00000100:00100000:0.0:1782757844.528604:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211521024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757844.528611:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1782757844.528714:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211521024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757844.528731:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757844.528752:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757844.528771:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757844.528776:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757844.528784:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757844.529699:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757845.548693:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757846.573537:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757846.688200:0:77134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6085bd40 20000000:00000080:3.0:1782757846.688220:0:77134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b347e000 uarg=0000000000000000 00010000:00010000:3.0:1782757846.688759:0:77134:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757846.688776:0:77134:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757846.688791:0:77134:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757846.688812:0:77134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.688971:0:77134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.688980:0:77134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.689022:0:77134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.689038:0:77134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 18 pid: 5793 timeout: 2015 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757846.689052:0:77134:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77134:1869355211521152:0@lo:104: 00000100:00100000:3.0:1782757846.689120:0:77134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757846.689248:0:77134:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782757846.689298:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521152 00000100:00100000:1.0:1782757846.689305:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521152 00000100:00100000:1.0:1782757846.689396:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1782757846.689407:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77134:x1869355211521152:12345-0@lo:104: 00010000:00010000:1.0:1782757846.689419:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757846.689489:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757846.689496:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77134:x1869355211521152:12345-0@lo:104: Request processed in 91us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757846.689504:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:2.0:1782757846.689560:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757846.689567:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689574:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757846.689578:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689587:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757846.689594:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757846.689600:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757846.689636:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689643:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757846.689665:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689671:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777d9cb5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cbc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689688:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757846.689690:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757846.689691:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757846.689722:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211521280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757846.689759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757846.689797:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521280 00000100:00100000:2.0:1782757846.689801:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521280 00010000:00010000:2.0:1782757846.689849:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 19 pid: 5793 timeout: 2015 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757846.689872:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782757846.689879:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211521280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757846.689889:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757846.689894:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 19 pid: 5793 timeout: 2015 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689903:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 19 pid: 5793 timeout: 2015 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689918:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689926:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689940:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689948:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689956:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689963:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689968:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757846.689972:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689979:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689988:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757846.689998:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757846.690029:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211521280:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757846.690036:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782757846.690075:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211521280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757846.690173:0:77134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525200/0xdd99f5c4777d9cbc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9cb5 expref: 18 pid: 5793 timeout: 2015 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757846.690185:0:77134:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77134:1869355211521152:0@lo:104: 00010000:00010000:3.0:1782757846.690201:0:77134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.690210:0:77134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.690215:0:77134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757846.690221:0:77134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9cc3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757846.956150:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757846.956182:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211521408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757846.956264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757846.956360:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521408 00000100:00100000:3.0:1782757846.956369:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521408 00000100:00100000:3.0:1782757846.956438:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1782757846.956448:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211521408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757846.956492:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757846.956550:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211521408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757846.956557:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1782757846.956596:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211521408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757846.956606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782757847.468916:0:77182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd207ca90 20000000:00000080:1.0:1782757847.468937:0:77182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718bf16000 uarg=0000000000000000 00010000:00010000:1.0:1782757847.469202:0:77182:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757847.469218:0:77182:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757847.469232:0:77182:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757847.469255:0:77182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469275:0:77182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469292:0:77182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469299:0:77182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469306:0:77182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469314:0:77182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469320:0:77182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757847.469325:0:77182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469334:0:77182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469349:0:77182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469357:0:77182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757847.469363:0:77182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777d9cca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757847.595980:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757848.246690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757848.246747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757848.246783:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657664 00000100:00100000:1.0:1782757848.246794:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657664 00000100:00100000:1.0:1782757848.246885:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1106 00000100:00100000:1.0:1782757848.246897:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196657664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757848.246983:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196657664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757848.246992:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1106 00000100:00100000:2.0:1782757848.247203:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657792 00000100:00100000:2.0:1782757848.247208:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657792 00000100:00100000:2.0:1782757848.247253:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00100000:2.0:1782757848.247261:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196657792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757848.247306:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196657792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757848.247317:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00080000:1.0:1782757848.247364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1782757848.495153:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782757848.495164:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782757848.495170:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782757848.495229:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757848.495240:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757848.495250:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757848.495280:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211521536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782757848.495367:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757848.495433:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782757848.501241:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521536 00000100:00100000:3.0:1782757848.501257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521536 00000100:00100000:3.0:1782757848.501327:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1782757848.501337:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211521536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757848.501356:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757848.501377:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9cd1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757848.501405:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757848.501419:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757848.501427:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782757848.501525:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211521536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (6157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757848.501531:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1782757848.501741:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211521536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757848.501761:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757848.501772:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757848.501793:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757848.501799:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757848.501807:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757848.642420:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757849.004107:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211522048:0@lo:400:kworker.0 00000100:00100000:1.0:1782757849.004198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757849.004263:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757849.004269:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211521920:0@lo:400:kworker.0 00000100:00100000:1.0:1782757849.004299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757849.004436:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522048 00000100:00100000:1.0:1782757849.004447:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522048 00000100:00100000:1.0:1782757849.004526:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1782757849.004536:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211522048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757849.004610:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211522048:12345-0@lo:400:kworker.0 Request processed in 74us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757849.004618:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1782757849.004663:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521920 00000100:00100000:1.0:1782757849.004667:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521920 00000100:00100000:1.0:1782757849.004704:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1782757849.004712:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757849.004750:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211521920:12345-0@lo:400:kworker.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757849.004757:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:1.0:1782757849.004779:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757849.004785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757849.004984:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211521920:0@lo:400:kworker.0 00000100:00100000:1.0:1782757849.004997:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211522048:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.005602:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211521664:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.005756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757849.005794:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211522176:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.005848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757849.005873:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782757849.005881:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211521792:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.005905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757849.005922:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211522304:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.005943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757849.006069:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521664 00000100:00100000:2.0:1782757849.006074:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521664 00000100:00100000:2.0:1782757849.006114:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1782757849.006122:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006165:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211521664:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757849.006172:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1782757849.006203:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522176 00000100:00100000:2.0:1782757849.006207:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522176 00000100:00100000:2.0:1782757849.006235:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211521792 00000100:00100000:2.0:1782757849.006238:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211521792 00000100:00100000:2.0:1782757849.006253:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1782757849.006257:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006291:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211522176:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757849.006298:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1782757849.006311:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1782757849.006317:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006344:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211521792:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757849.006350:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1782757849.006370:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522304 00000100:00100000:2.0:1782757849.006374:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522304 00000100:00100000:2.0:1782757849.006402:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1782757849.006410:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006443:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211522304:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757849.006744:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00080000:2.0:1782757849.006767:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757849.006772:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757849.006812:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211521792:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006847:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211522304:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006859:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211521664:0@lo:400:kworker.0 00000100:00100000:2.0:1782757849.006869:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211522176:0@lo:400:kworker.0 00000100:00100000:0.0:1782757849.517987:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211522432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757849.518078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757849.518164:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522432 00000100:00100000:0.0:1782757849.518172:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522432 00000100:00100000:0.0:1782757849.518224:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1782757849.518233:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211522432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757849.518281:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757849.518339:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211522432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757849.518347:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1782757849.518404:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211522432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757849.645019:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757850.668397:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757851.695115:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757852.076149:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757852.076171:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211522560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757852.076239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757852.076334:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522560 00000100:00100000:3.0:1782757852.076342:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522560 00000100:00100000:3.0:1782757852.076404:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1782757852.076414:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211522560:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757852.076635:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782757852.076666:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757852.076734:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211522560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757852.076742:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1782757852.076854:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211522560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757852.718871:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757852.902201:0:77478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4467fc90 20000000:00000080:3.0:1782757852.902306:0:77478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d83000 uarg=0000000000000000 00010000:00010000:3.0:1782757852.905145:0:77478:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757852.905167:0:77478:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757852.905183:0:77478:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757852.905203:0:77478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.905221:0:77478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.905230:0:77478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.905270:0:77478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.905285:0:77478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 18 pid: 5794 timeout: 2021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757852.905301:0:77478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77478:1869355211522688:0@lo:104: 00000100:00100000:3.0:1782757852.905368:0:77478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757852.905422:0:77478:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782757852.905485:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522688 00000100:00100000:2.0:1782757852.905493:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522688 00000100:00100000:2.0:1782757852.905535:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1782757852.905544:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77478:x1869355211522688:12345-0@lo:104: 00010000:00010000:2.0:1782757852.905558:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.905648:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757852.905654:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77478:x1869355211522688:12345-0@lo:104: Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757852.905662:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:1.0:1782757852.905872:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757852.905879:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757852.905887:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782757852.905901:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757852.905909:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782757852.905916:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757852.905922:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782757852.905955:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757852.905961:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782757852.905981:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757852.905989:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181525a00/0xdd99f5c4777d9cd1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757852.906007:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757852.906009:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757852.906011:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757852.906019:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757852.906030:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211522816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757852.906061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757852.906103:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522816 00000100:00100000:2.0:1782757852.906108:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522816 00010000:00010000:2.0:1782757852.906126:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 19 pid: 5794 timeout: 2021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757852.906161:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782757852.906168:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211522816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757852.906178:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757852.906183:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 19 pid: 5794 timeout: 2021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906194:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 19 pid: 5794 timeout: 2021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906210:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906217:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906230:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906237:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906243:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906259:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906266:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757852.906269:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906277:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906285:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757852.906302:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757852.906342:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211522816:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757852.906349:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1782757852.906372:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211522816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757852.906778:0:77478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9cd8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9cd1 expref: 18 pid: 5794 timeout: 2021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757852.906789:0:77478:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77478:1869355211522688:0@lo:104: 00010000:00010000:3.0:1782757852.906803:0:77478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.906811:0:77478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.906818:0:77478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757852.907431:0:77478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777d9cdf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757853.366346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757853.366401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757853.366433:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658048 00000100:00100000:1.0:1782757853.366442:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658048 00000100:00100000:1.0:1782757853.366508:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00100000:1.0:1782757853.366520:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196658048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757853.366611:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196658048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757853.366619:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00100000:3.0:1782757853.367024:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196657920 00000100:00100000:3.0:1782757853.367028:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196657920 00000100:00100000:3.0:1782757853.367060:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00100000:3.0:1782757853.367066:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196657920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757853.367113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196657920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757853.367119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00080000:2.0:1782757853.373767:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1782757853.703456:0:77526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff947d0e40 20000000:00000080:3.0:1782757853.703477:0:77526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7af6000 uarg=0000000000000000 00010000:00010000:3.0:1782757853.703740:0:77526:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757853.703757:0:77526:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757853.703774:0:77526:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757853.703796:0:77526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703813:0:77526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703855:0:77526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703863:0:77526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703871:0:77526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703879:0:77526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703886:0:77526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757853.703891:0:77526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703899:0:77526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703914:0:77526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703922:0:77526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757853.703934:0:77526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777d9ce6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757853.749369:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757854.129474:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211522944:0@lo:400:kworker.0 00000100:00100000:2.0:1782757854.129570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757854.129702:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211522944 00000100:00100000:3.0:1782757854.129711:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211522944 00000100:00100000:3.0:1782757854.129765:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1782757854.129775:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211522944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.132255:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211523200:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.132325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757854.132366:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757854.132372:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211523072:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.132395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757854.133338:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523200 00000100:00100000:1.0:1782757854.133350:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523200 00000100:00100000:3.0:1782757854.133534:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211522944:12345-0@lo:400:kworker.0 Request processed in 3757us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757854.133544:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1782757854.133866:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523072 00000100:00100000:1.0:1782757854.133872:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523072 00000100:00100000:1.0:1782757854.133912:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1782757854.133922:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211523200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757854.136637:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1782757854.136662:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.136924:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211523200:12345-0@lo:400:kworker.0 Request processed in 3002us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757854.136933:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1782757854.136984:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211523328:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.137023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757854.137079:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523328 00000100:00100000:1.0:1782757854.137086:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523328 00000100:00100000:1.0:1782757854.137128:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1782757854.137135:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211523328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.137172:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211523328:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757854.137178:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1782757854.137217:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211523328:0@lo:400:kworker.0 00000100:00100000:3.0:1782757854.137303:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211523072:12345-0@lo:400:kworker.0 Request processed in 653us (4905us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757854.137310:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1782757854.137628:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211523584:0@lo:400:kworker.0 00000100:00100000:3.0:1782757854.137657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757854.137872:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523584 00000100:00100000:0.0:1782757854.137877:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523584 00000100:00100000:0.0:1782757854.137908:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1782757854.137915:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211523584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757854.137960:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211523584:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757854.137966:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1782757854.138605:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211523584:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.138782:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757854.138791:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211523456:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.140788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757854.140880:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211523072:0@lo:400:kworker.0 00000100:00100000:1.0:1782757854.140895:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211523200:0@lo:400:kworker.0 00000100:00100000:2.0:1782757854.141490:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211522944:0@lo:400:kworker.0 00000100:00080000:2.0:1782757854.141517:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757854.141523:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757854.141526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757854.141543:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523456 00000100:00100000:2.0:1782757854.141560:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523456 00000100:00100000:2.0:1782757854.141623:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1782757854.141632:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211523456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757854.142575:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211523456:12345-0@lo:400:kworker.0 Request processed in 940us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757854.142585:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:1.0:1782757854.145057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757854.145130:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211523456:0@lo:400:kworker.0 10000000:01000000:2.0:1782757854.253404:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757854.253413:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757854.253419:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757854.253466:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757854.253478:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757854.253488:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757854.253513:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211523712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757854.253593:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757854.253659:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183344540 going to sleep for 11 seconds 00000100:00100000:0.0:1782757854.253787:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523712 00000100:00100000:0.0:1782757854.253796:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523712 00000100:00100000:0.0:1782757854.253872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1782757854.253883:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211523712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757854.253896:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757854.253910:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9ced expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757854.253937:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757854.253947:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757854.253957:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525400, rc 0) 00000100:00100000:0.0:1782757854.254007:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211523712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757854.254013:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1782757854.254059:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211523712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757854.254076:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757854.254083:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757854.254101:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757854.254105:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757854.254111:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757854.652871:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757854.652899:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211523840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757854.652982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757854.653063:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523840 00000100:00100000:2.0:1782757854.653070:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523840 00000100:00100000:2.0:1782757854.653119:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1782757854.653129:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211523840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757854.653168:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757854.653215:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211523840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757854.653222:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1782757854.653276:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211523840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757854.764970:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757855.788151:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757856.816016:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757857.054726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757857.054815:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658176 00000100:00100000:3.0:1782757857.054917:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658176 00000100:00100000:2.0:1782757857.055068:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 668 00000100:00100000:2.0:1782757857.055079:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45147:x1869355196658176:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757857.055099:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757857.056584:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647c0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.056661:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.056675:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.056689:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782757857.056939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782757857.057376:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782757857.057382:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757857.057465:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.057506:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647c0 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.057524:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647c0 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.057533:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757857.057536:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757857.057539:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757857.057612:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45147:x1869355196658176:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2534us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757857.057621:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 668 00000100:00100000:3.0:1782757857.069948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757857.070066:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658304 00000100:00100000:2.0:1782757857.070077:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658304 00000100:00100000:2.0:1782757857.070141:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 669 00000100:00100000:2.0:1782757857.070152:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45147:x1869355196658304:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757857.070174:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757857.070196:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647c7 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070263:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070278:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070291:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070328:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070336:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070343:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070630:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070639:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070645:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070652:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757857.070657:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070665:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070678:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757857.070681:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757857.070686:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070692:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777d9d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070705:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070710:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070716:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070721:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757857.070723:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070729:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070740:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1a00) 00010000:00010000:2.0:1782757857.070742:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757857.070745:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070750:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070778:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647c7 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070788:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757857.070790:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757857.070794:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647c7 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.070803:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694600, rc 0) 00000100:00100000:2.0:1782757857.070933:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45147:x1869355196658304:12345-192.168.204.31@tcp:101:rm.0 Request processed in 783us (995us total) trans 0 rc 301/301 00000100:00100000:2.0:1782757857.070941:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 669 00000100:00100000:1.0:1782757857.148153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757857.148264:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658688 00000100:00100000:2.0:1782757857.148274:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658688 00000100:00100000:2.0:1782757857.148333:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 670 00000100:00100000:2.0:1782757857.148345:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45151:x1869355196658688:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782757857.148401:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757857.148430:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9d02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647c0 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148455:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782757857.148466:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757857.148772:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148786:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148797:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148875:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148883:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.148899:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757857.150001:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00010000:00010000:2.0:1782757857.150017:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150026:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150033:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150040:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757857.150046:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150055:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150071:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782757857.150074:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757857.150078:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.150084:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9d1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757857.150102:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d2b55ea reply state 0000000012564bdd transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757857.150112:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757857.150216:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45151:x1869355196658688:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1870us (2070us total) trans 4294967553 rc 0/0 00000100:00100000:2.0:1782757857.150225:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 670 00000100:00100000:1.0:1782757857.176242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757857.176336:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658432 00000100:00100000:2.0:1782757857.176346:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658432 00000100:00100000:2.0:1782757857.176412:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 671 00000100:00100000:2.0:1782757857.176422:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196658432:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782757857.176472:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782757857.176556:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196658432:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757857.176565:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 671 00010000:00010000:3.0:1782757857.178190:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178206:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178219:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178224:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757857.178229:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178236:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178252:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1900) 00010000:00010000:3.0:1782757857.178256:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757857.178260:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.178266:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9d25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757857.196206:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211523968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757857.196283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757857.196466:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211523968 00000100:00100000:3.0:1782757857.196475:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211523968 00000100:00100000:3.0:1782757857.196564:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1782757857.196575:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211523968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757857.196615:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757857.196671:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211523968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757857.196678:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00080000:1.0:1782757857.196778:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757857.196862:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211523968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757857.240361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757857.240541:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658816 00000100:00100000:0.0:1782757857.240551:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658816 00000100:00100000:0.0:1782757857.240614:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 672 00000100:00100000:0.0:1782757857.240624:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45155:x1869355196658816:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782757857.240651:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757857.240676:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647ce expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240740:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240754:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240765:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757857.240866:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782757857.240870:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757857.240901:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240936:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ce expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240955:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ce expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.240968:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782757857.240971:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757857.240974:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757857.241042:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45155:x1869355196658816:12345-192.168.204.31@tcp:101:chown.0 Request processed in 419us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757857.241049:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 672 00000100:00100000:2.0:1782757857.245089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757857.245285:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196658944 00000100:00100000:3.0:1782757857.245295:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196658944 00000100:00100000:3.0:1782757857.245351:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 673 00000100:00100000:3.0:1782757857.245360:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45155:x1869355196658944:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782757857.245380:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757857.245406:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647d5 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245462:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245475:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245485:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245508:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245516:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245522:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245775:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245788:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245805:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757857.245880:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00000004:00200000:3.0:1782757857.245884:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757857.245911:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245930:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245936:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245943:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245949:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757857.245953:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245960:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245973:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:3.0:1782757857.245975:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757857.245980:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245986:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.245999:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246013:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246018:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246022:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757857.246025:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246033:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246039:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75300) 00010000:00010000:3.0:1782757857.246041:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757857.246043:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246049:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777d9d48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246074:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647d5 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246084:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647d5 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.246091:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757857.246094:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757857.246096:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782757857.246154:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45155:x1869355196658944:12345-192.168.204.31@tcp:101:chown.0 Request processed in 794us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757857.246162:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 673 00000100:00100000:1.0:1782757857.249126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757857.249200:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659200 00000100:00100000:0.0:1782757857.249209:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659200 00000100:00100000:0.0:1782757857.249272:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 674 00000100:00100000:0.0:1782757857.249282:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45155:x1869355196659200:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:0.0:1782757857.249332:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757857.249359:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9d4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647d5 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.249379:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75400) 00010000:00010000:0.0:1782757857.249390:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757857.249413:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.249426:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757857.249434:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757857.249663:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031b9eff1 reply state 000000002055eef7 transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757857.249679:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757857.249693:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00000100:00100000:0.0:1782757857.249783:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45155:x1869355196659200:12345-192.168.204.31@tcp:36:chown.0 Request processed in 501us (665us total) trans 4294967554 rc 0/0 00000100:00100000:0.0:1782757857.249790:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 674 00010000:00010000:2.0:1782757857.252043:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252062:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252070:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252077:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757857.252083:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252092:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252110:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:2.0:1782757857.252113:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757857.252117:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757857.252123:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9d56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757857.837098:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782757858.208160:0:77724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4f7e6550 20000000:00000080:0.0:1782757858.208179:0:77724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917191997800 uarg=0000000000000000 00010000:00010000:0.0:1782757858.208976:0:77724:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782757858.209017:0:77724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782757858.209022:0:77724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757858.209034:0:77724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9d33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ce expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.209058:0:77724:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782757858.209076:0:77724:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757858.209088:0:77724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.209102:0:77724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.209111:0:77724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.209161:0:77724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.209177:0:77724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 18 pid: 5793 timeout: 2026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757858.209193:0:77724:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77724:1869355211524096:0@lo:104: 00000100:00100000:0.0:1782757858.209256:0:77724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757858.209403:0:77724:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b697540 going to sleep for 11 seconds 00000100:00100000:1.0:1782757858.209553:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524096 00000100:00100000:1.0:1782757858.209562:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524096 00000100:00100000:1.0:1782757858.209664:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1782757858.209677:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77724:x1869355211524096:12345-0@lo:104: 00010000:00010000:1.0:1782757858.209692:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757858.209765:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782757858.209772:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:77724:x1869355211524096:12345-0@lo:104: Request processed in 99us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757858.209781:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:3.0:1782757858.209848:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757858.209856:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.209864:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782757858.209868:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.209878:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782757858.209886:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757858.209892:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782757858.209924:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.209931:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782757858.209953:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.209961:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777d9ced lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9cf4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.209976:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757858.209979:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757858.209981:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757858.209999:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211524224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757858.210031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757858.210066:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524224 00000100:00100000:3.0:1782757858.210070:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524224 00010000:00010000:3.0:1782757858.210088:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 19 pid: 5793 timeout: 2026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757858.210110:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782757858.210117:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211524224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757858.210128:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757858.210133:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 19 pid: 5793 timeout: 2026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210161:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 19 pid: 5793 timeout: 2026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210176:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210186:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210202:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210209:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210215:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210222:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210227:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757858.210231:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210238:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210247:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757858.210256:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757858.210284:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211524224:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757858.210290:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782757858.210329:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211524224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757858.210572:0:77724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525400/0xdd99f5c4777d9cf4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9ced expref: 18 pid: 5793 timeout: 2026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757858.210582:0:77724:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77724:1869355211524096:0@lo:104: 00010000:00010000:0.0:1782757858.210597:0:77724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.210605:0:77724:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.210611:0:77724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757858.210618:0:77724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525c00/0xdd99f5c4777d9d5d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757858.486887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757858.486928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757858.486964:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659328 00000100:00100000:3.0:1782757858.486974:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659328 00000100:00100000:3.0:1782757858.487028:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:3.0:1782757858.487037:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196659328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757858.487111:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196659328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757858.487119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:2.0:1782757858.487278:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659456 00000100:00100000:2.0:1782757858.487282:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659456 00000100:00100000:2.0:1782757858.487327:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1346 00000100:00100000:2.0:1782757858.487335:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196659456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757858.487393:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196659456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757858.487400:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1346 00010000:00010000:1.0:1782757858.867333:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782757859.140107:0:77772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcd95c7d0 20000000:00000080:0.0:1782757859.140135:0:77772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708270ac00 uarg=0000000000000000 00010000:00010000:0.0:1782757859.141168:0:77772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782757859.141247:0:77772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782757859.141563:0:77772:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757859.141594:0:77772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141616:0:77772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141632:0:77772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141639:0:77772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141646:0:77772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141654:0:77772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141661:0:77772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757859.141667:0:77772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141677:0:77772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141696:0:77772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141705:0:77772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757859.141712:0:77772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525a00/0xdd99f5c4777d9d64 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757859.246073:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211524352:0@lo:400:kworker.0 00000100:00100000:3.0:1782757859.246178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757859.246227:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524352 00000100:00100000:0.0:1782757859.246238:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524352 00000100:00100000:0.0:1782757859.246304:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1782757859.246315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211524352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.247434:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211524480:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.247503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757859.247532:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211524992:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.247559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757859.247579:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757859.247585:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211524864:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.247605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757859.248114:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211524608:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757859.248168:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757859.248174:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211524736:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757859.248228:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524992 00000100:00100000:1.0:1782757859.248236:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524992 00000100:00100000:1.0:1782757859.248289:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524736 00000100:00100000:1.0:1782757859.248292:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524736 00000100:00100000:1.0:1782757859.248315:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1782757859.248324:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211524992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248379:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211524992:12345-0@lo:400:kworker.0 Request processed in 55us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757859.248387:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1782757859.248411:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1782757859.248417:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211524736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248446:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211524736:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757859.248465:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1782757859.248484:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524480 00000100:00100000:1.0:1782757859.248487:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524480 00000100:00100000:1.0:1782757859.248508:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524864 00000100:00100000:1.0:1782757859.248510:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524864 00000100:00100000:1.0:1782757859.248525:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211524608 00000100:00100000:1.0:1782757859.248528:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211524608 00000100:00100000:1.0:1782757859.248543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1782757859.248549:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211524480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248580:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211524480:12345-0@lo:400:kworker.0 Request processed in 30us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757859.248586:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1782757859.248597:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1782757859.248603:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211524864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248644:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211524864:12345-0@lo:400:kworker.0 Request processed in 41us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757859.248650:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1782757859.248662:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1782757859.248667:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211524608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248692:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211524608:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757859.248698:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00080000:1.0:1782757859.248718:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757859.248723:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757859.248725:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757859.248790:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211524736:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248801:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211524608:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248851:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211524864:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248861:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211524480:0@lo:400:kworker.0 00000100:00100000:1.0:1782757859.248871:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211524992:0@lo:400:kworker.0 00000100:00100000:3.0:1782757859.249210:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211524352:0@lo:400:kworker.0 00000100:00100000:0.0:1782757859.249577:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211524352:12345-0@lo:400:kworker.0 Request processed in 3261us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757859.249587:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1782757859.765635:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211525120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757859.765731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757859.765927:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525120 00000100:00100000:2.0:1782757859.765936:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525120 00000100:00100000:2.0:1782757859.765998:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1782757859.766008:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211525120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757859.766050:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757859.766115:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211525120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757859.766122:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1782757859.766460:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211525120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757859.887877:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757860.144184:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757860.144192:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757860.144197:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757860.144259:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757860.144272:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757860.144284:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757860.144312:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211525248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757860.144385:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757860.144445:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e30240 going to sleep for 11 seconds 00000100:00100000:3.0:1782757860.144646:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525248 00000100:00100000:3.0:1782757860.144654:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525248 00000100:00100000:3.0:1782757860.144714:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1782757860.144724:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211525248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757860.144739:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757860.144754:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777d9d6b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757860.144790:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757860.144802:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757860.144812:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757860.144902:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211525248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757860.144910:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1782757860.144954:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211525248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757860.144969:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757860.144979:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757860.145002:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782757860.145008:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757860.145015:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782757860.827559:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967554 is committed 00010000:00010000:0.0:1782757860.909331:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757861.932152:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757862.319006:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211525376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757862.319110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757862.319259:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525376 00000100:00100000:3.0:1782757862.319270:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525376 00000100:00100000:3.0:1782757862.319363:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1782757862.319377:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211525376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757862.319438:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757862.319500:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211525376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757862.319508:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00080000:1.0:1782757862.319675:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757862.319725:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211525376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757862.473846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757862.474245:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659584 00000100:00100000:1.0:1782757862.474259:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659584 00000100:00100000:1.0:1782757862.474370:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:1.0:1782757862.474382:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196659584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757862.474413:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757862.474417:0:7497:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777d9d33) 00010000:00010000:1.0:1782757862.474419:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757862.474501:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196659584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (697us total) trans 0 rc 116/116 00000100:00100000:1.0:1782757862.474510:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00080000:0.0:1782757862.476033:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782757862.956064:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757863.570386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757863.571008:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659712 00000100:00100000:3.0:1782757863.571019:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659712 00000100:00100000:3.0:1782757863.571086:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 675 00000100:00100000:3.0:1782757863.571097:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45260:x1869355196659712:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782757863.571119:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757863.571142:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9d79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647dc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.571633:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.571652:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.571667:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757863.572142:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782757863.572147:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757863.572249:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.572277:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9d79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647dc expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.572296:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647dc expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.572304:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757863.572307:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757863.572311:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782757863.572410:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45260:x1869355196659712:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1314us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757863.572418:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 675 00000100:00100000:3.0:1782757863.577092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.577560:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196659840 00000100:00100000:1.0:1782757863.577571:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196659840 00000100:00100000:1.0:1782757863.577631:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 676 00000100:00100000:1.0:1782757863.577641:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45260:x1869355196659840:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757863.577662:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757863.577683:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647e3 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577757:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577771:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577782:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577796:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577802:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.577809:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578219:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578229:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578237:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757863.578334:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757863.578338:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757863.578432:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578462:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578469:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578477:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578484:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.578490:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578498:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578512:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782757863.578515:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.578520:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578527:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9d8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578539:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578544:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578550:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578555:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.578558:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578564:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578572:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757863.578574:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.578577:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578583:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9d95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578613:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647e3 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578625:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647e3 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.578632:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782757863.578634:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757863.578636:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757863.578708:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45260:x1869355196659840:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1068us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757863.578717:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 676 00000100:00100000:0.0:1782757863.584301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757863.584432:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660096 00000100:00100000:2.0:1782757863.584443:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660096 00000100:00100000:2.0:1782757863.584512:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 677 00000100:00100000:2.0:1782757863.584522:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45260:x1869355196660096:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782757863.584587:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757863.584629:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777d9d9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647e3 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.584652:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782757863.584665:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757863.584694:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.584716:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.584726:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757863.609972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757863.610108:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660224 00000100:00100000:0.0:1782757863.610119:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660224 00000100:00100000:0.0:1782757863.610170:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1115 00000100:00100000:0.0:1782757863.610182:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196660224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757863.610272:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196660224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757863.610279:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1115 00000001:00080000:1.0:1782757863.674927:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967555 is committed 00000004:00010000:2.0:1782757863.675426:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000956b136b reply state 00000000d4369094 transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757863.675442:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782757863.675610:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00080000:2.0:1782757863.675799:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782757863.676052:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45260:x1869355196660096:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 91523us (91753us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1782757863.676062:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 677 00010000:00010000:2.0:1782757863.676100:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676109:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676117:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676123:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757863.676129:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676136:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676152:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782757863.676155:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757863.676159:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.676165:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9da3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757863.779175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757863.779255:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660352 00000100:00100000:3.0:1782757863.779267:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660352 00000100:00100000:3.0:1782757863.779388:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 678 00000100:00100000:3.0:1782757863.779400:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45264:x1869355196660352:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757863.779428:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757863.779449:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647ea expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779513:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779527:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779539:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779551:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779557:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.779563:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780121:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780132:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780139:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757863.780224:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1782757863.780228:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757863.780310:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780324:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780330:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780337:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780343:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757863.780347:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780354:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780378:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757863.780381:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757863.780385:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780391:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777d9db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780404:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780410:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780415:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780421:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757863.780423:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780428:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780435:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75d00) 00010000:00010000:3.0:1782757863.780438:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757863.780440:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780446:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780477:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ea expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780489:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ea expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.780496:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782757863.780498:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757863.780500:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782757863.780563:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45264:x1869355196660352:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1165us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757863.780570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 678 00000100:00100000:3.0:1782757863.790352:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757863.790889:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660608 00000100:00100000:0.0:1782757863.790904:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660608 00000100:00100000:0.0:1782757863.790985:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 679 00000100:00100000:0.0:1782757863.790996:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45264:x1869355196660608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782757863.791025:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757863.791052:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9dc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647f1 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.791486:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.791506:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.791520:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.798383:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.798411:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757863.798426:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782757863.803487:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1782757863.803936:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9ddb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.803953:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.803966:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804004:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804010:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804016:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804022:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.804026:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804033:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804046:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:1.0:1782757863.804048:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.804053:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804058:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9dcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757863.804075:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000212ca518 reply state 00000000393bc3db transno 4294967556 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757863.804083:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782757863.804116:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9dc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f1 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804129:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9ddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f1 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.804135:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757863.804138:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757863.804140:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782757863.804478:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45264:x1869355196660608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 13482us (14141us total) trans 4294967556 rc 0/0 00000100:00100000:1.0:1782757863.804488:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 679 00010000:00010000:2.0:1782757863.808741:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808766:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808774:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808781:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757863.808786:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808795:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808867:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff91718bcfdc00) 00010000:00010000:2.0:1782757863.808872:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757863.808878:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.808885:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9dd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757863.810013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757863.810506:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660864 00000100:00100000:2.0:1782757863.810520:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660864 00000100:00100000:2.0:1782757863.810659:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 680 00000100:00100000:2.0:1782757863.810687:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45264:x1869355196660864:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782757863.810767:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757863.810803:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777d9ddb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f1 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.810844:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:2.0:1782757863.810858:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757863.810915:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.810930:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757863.810942:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757863.811216:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068d89bb0 reply state 00000000153f8cf1 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757863.811233:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757863.811386:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45264:x1869355196660864:12345-192.168.204.31@tcp:36:touch.0 Request processed in 716us (1381us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1782757863.811394:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 680 00000100:00100000:0.0:1782757863.818925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757863.819602:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196660992 00000100:00100000:3.0:1782757863.819619:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196660992 00000100:00100000:3.0:1782757863.819710:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 681 00000100:00100000:3.0:1782757863.819722:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45264:x1869355196660992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757863.819756:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757863.819783:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9df0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647f8 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.819900:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9df0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f8 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.819920:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9df0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f8 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757863.819945:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:3.0:1782757863.819948:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782757863.819953:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782757863.820289:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45264:x1869355196660992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 566us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757863.820309:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 681 00010000:00010000:1.0:1782757863.820477:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820489:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820497:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820504:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.820509:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820525:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820542:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:1.0:1782757863.820545:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.820551:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.820557:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777d9de9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757863.827635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.829020:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196661120 00000100:00100000:1.0:1782757863.829037:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196661120 00000100:00100000:0.0:1782757863.829318:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 368 00000100:00100000:0.0:1782757863.829330:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196661120:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:0.0:1782757863.829385:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1932 last 0 00000020:00000080:0.0:1782757863.829427:0:6597:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d9df7 00002000:00100000:0.0:1782757863.829443:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917189070000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782757863.829474:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782757863.829809:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782757863.829879:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917189071800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782757863.829989:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196661120:12345-192.168.204.31@tcp:8:touch.0 Request processed in 659us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757863.829998:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 368 00000100:00100000:2.0:1782757863.832992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.833466:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196661248 00000100:00100000:1.0:1782757863.833480:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196661248 00000100:00100000:1.0:1782757863.833594:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 369 00000100:00100000:1.0:1782757863.833608:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196661248:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:0.0:1782757863.834707:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757863.906642:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:0:x1869355196661248:12345-192.168.204.31@tcp:2:touch.0 Request processed in 73018us (73645us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1782757863.906662:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 369 00000100:00100000:3.0:1782757863.909719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.910255:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196661504 00000100:00100000:1.0:1782757863.910271:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196661504 00000100:00100000:1.0:1782757863.910354:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:1.0:1782757863.910377:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45264:x1869355196661504:12345-192.168.204.31@tcp:35:touch.0 00000001:00100000:0.0:1782757863.910892:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:0.0:1782757863.910917:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00000100:00100000:1.0:1782757863.910997:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45264:x1869355196661504:12345-192.168.204.31@tcp:35:touch.0 Request processed in 622us (1289us total) trans 4294967558 rc 0/0 00000100:00100000:1.0:1782757863.911005:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00010000:00010000:0.0:1782757863.980408:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757863.986969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.987101:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196661632 00000100:00100000:1.0:1782757863.987117:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196661632 00000100:00100000:1.0:1782757863.987198:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 682 00000100:00100000:1.0:1782757863.987211:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45268:x1869355196661632:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757863.987257:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757863.987285:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9dfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf647ff expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987378:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987395:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987408:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987424:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987431:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987438:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987570:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987579:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987590:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757863.987635:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 0 00000004:00200000:1.0:1782757863.987641:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757863.987665:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987679:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987688:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987696:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987702:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987708:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.987712:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987721:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987735:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:1.0:1782757863.987738:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.987745:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987756:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987772:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987777:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987783:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987787:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757863.987790:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987796:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987802:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782757863.987804:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757863.987807:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987812:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987938:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ff expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987960:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ff expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.987967:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:1.0:1782757863.987970:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757863.987973:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782757863.988051:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45268:x1869355196661632:12345-192.168.204.31@tcp:101:rm.0 Request processed in 841us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757863.988059:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 682 00000100:00100000:2.0:1782757863.995555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757863.995649:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196661760 00000100:00100000:1.0:1782757863.995664:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196661760 00000100:00100000:1.0:1782757863.995757:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 370 00000100:00100000:1.0:1782757863.995770:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196661760:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757863.995797:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757863.995871:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64806 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782757863.995910:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x6a42b9e6, atime: 0x6a42b9e6, ctime: 0x6a42b9e6, blocks: 0x1 00010000:00010000:1.0:1782757863.995943:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1932s v=(0 0) 00010000:00010000:1.0:1782757863.995948:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757863.995960:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.995984:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757863.996006:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782757863.996082:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196661760:12345-192.168.204.31@tcp:101:rm.0 Request processed in 314us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757863.996090:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 370 00000100:00100000:0.0:1782757864.002122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757864.002345:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662016 00000100:00100000:2.0:1782757864.002366:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662016 00000100:00100000:2.0:1782757864.002474:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 683 00000100:00100000:2.0:1782757864.002488:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45268:x1869355196662016:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782757864.002565:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757864.002605:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9e13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ff expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.002632:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777d9df0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647f8 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.002644:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782757864.002658:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757864.002702:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003247:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003264:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003287:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003295:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003301:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003453:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003460:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.003468:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757864.004193:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:2.0:1782757864.004206:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1932407382296ns, next at 1933407379167ns, rc = 0 00010000:00010000:2.0:1782757864.004284:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004297:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004307:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004317:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004328:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004334:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004366:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757864.004396:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004402:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004408:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004414:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757864.004419:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004426:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004439:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782757864.004442:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757864.004447:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004454:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004476:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004484:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004490:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004495:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757864.004498:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004504:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004512:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:2.0:1782757864.004514:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757864.004517:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757864.004522:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777d9e21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757864.004533:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d26870a3 reply state 00000000b08b51fa transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757864.004543:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757864.004669:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45268:x1869355196662016:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2179us (2558us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1782757864.004680:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 683 00010000:00010000:1.0:1782757864.005480:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757864.005490:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757864.005500:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757864.005504:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757864.005512:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757864.005526:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff917182dd1300) 00010000:00010000:1.0:1782757864.005529:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782757864.005533:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757864.005539:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757864.005562:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757864.005564:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757864.005565:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782757864.006012:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782757864.008559:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008581:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008595:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008602:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757864.008608:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008617:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008641:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff917182dd1a00) 00010000:00010000:3.0:1782757864.008644:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757864.008650:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757864.008656:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9e28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757864.364371:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211525632:0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.364475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757864.364497:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211525888:0@lo:400:kworker.0 00000100:00100000:3.0:1782757864.364542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757864.364562:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211526144:0@lo:400:kworker.0 00000100:00100000:3.0:1782757864.364582:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757864.364592:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211525760:0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.364597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757864.364626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757864.364642:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782757864.364651:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211525504:0@lo:400:kworker.0 00000100:00100000:3.0:1782757864.364680:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525888 00000100:00100000:1.0:1782757864.364690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757864.364692:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525888 00000100:00100000:1.0:1782757864.364717:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211526016:0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.364740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757864.364776:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526144 00000100:00100000:3.0:1782757864.364781:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526144 00000100:00100000:2.0:1782757864.364920:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525504 00000100:00100000:2.0:1782757864.364925:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525504 00000100:00100000:2.0:1782757864.364965:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1782757864.364974:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211525504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757864.365040:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211525504:12345-0@lo:400:kworker.0 Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757864.365048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1782757864.365087:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525632 00000100:00100000:2.0:1782757864.365091:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525632 00000100:00100000:2.0:1782757864.365116:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211525760 00000100:00100000:2.0:1782757864.365119:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211525760 00000100:00100000:2.0:1782757864.365139:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526016 00000100:00100000:2.0:1782757864.365142:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526016 00000100:00100000:2.0:1782757864.365156:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1782757864.365161:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211525632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757864.365196:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211525632:12345-0@lo:400:kworker.0 Request processed in 35us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757864.365203:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1782757864.365215:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1782757864.365221:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757864.365255:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211525760:12345-0@lo:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757864.365261:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1782757864.365272:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1782757864.365277:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211526016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757864.365307:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211526016:12345-0@lo:400:kworker.0 Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757864.365313:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1782757864.365376:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211525760:0@lo:400:kworker.0 00000100:00080000:0.0:1782757864.365512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757864.365519:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757864.365521:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757864.365549:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211525504:0@lo:400:kworker.0 00000100:00100000:0.0:1782757864.365560:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211526016:0@lo:400:kworker.0 00000100:00100000:0.0:1782757864.365572:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211525632:0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.366344:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1782757864.366372:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.366450:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211525888:12345-0@lo:400:kworker.0 Request processed in 86us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757864.366458:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1782757864.366479:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1782757864.366487:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757864.366525:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211526144:12345-0@lo:400:kworker.0 Request processed in 39us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757864.366531:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1782757864.366590:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211526144:0@lo:400:kworker.0 00000100:00100000:0.0:1782757864.367785:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211525888:0@lo:400:kworker.0 00000100:00100000:2.0:1782757864.892028:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211526272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757864.892132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757864.892287:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526272 00000100:00100000:0.0:1782757864.892297:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526272 00000100:00100000:0.0:1782757864.892376:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1782757864.892388:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211526272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757864.892443:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757864.901572:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211526272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9171us (9425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757864.901604:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1782757864.901998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211526272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757865.004351:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757865.300697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757865.300811:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662144 00000100:00100000:2.0:1782757865.300848:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662144 00000100:00100000:2.0:1782757865.300909:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 684 00000100:00100000:2.0:1782757865.300920:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45284:x1869355196662144:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782757865.300949:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757865.301157:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6480d expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301227:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301242:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301253:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757865.301321:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1782757865.301325:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757865.301376:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301402:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6480d expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301421:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6480d expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.301429:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:2.0:1782757865.301432:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757865.301436:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782757865.301495:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45284:x1869355196662144:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 577us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757865.301502:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 684 00000100:00100000:3.0:1782757865.308974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757865.309212:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662400 00000100:00100000:0.0:1782757865.309223:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662400 00000100:00100000:0.0:1782757865.309281:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 685 00000100:00100000:0.0:1782757865.309290:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45284:x1869355196662400:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757865.309355:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757865.309388:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6480d expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.309411:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777d9dbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647ea expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.309422:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75500) 00010000:00010000:0.0:1782757865.309433:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757865.309458:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.309471:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.309480:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782757865.347043:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967560 is committed 00000004:00080000:1.0:1782757865.347074:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000100:00100000:3.0:1782757865.347274:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211526400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757865.347369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757865.347443:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526400 00000100:00100000:3.0:1782757865.347451:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526400 00000100:00100000:3.0:1782757865.347493:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782757865.347501:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211526400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782757865.347527:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:21 count 1 00010000:00010000:3.0:1782757865.347553:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.347577:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.347587:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782757865.347591:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757865.347596:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.347621:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.347636:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 5 pid: 6599 timeout: 2033 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757865.347658:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211526528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782757865.347712:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181377840 going to sleep for 11 seconds 00000004:00010000:2.0:1782757865.348345:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004da18f1e reply state 0000000066c8e42e transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757865.348358:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782757865.348501:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00080000:2.0:1782757865.348605:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782757865.348623:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45284:x1869355196662400:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 39333us (39665us total) trans 4294967560 rc 0/0 00000100:00100000:2.0:1782757865.348631:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 685 00010000:00010000:1.0:1782757865.348852:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348861:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348869:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348877:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181524c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.348881:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348890:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348905:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:1.0:1782757865.348908:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757865.348912:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.348919:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9e4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757865.353560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757865.355391:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211526528:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782757865.355422:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757865.357463:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662528 00000100:00100000:2.0:1782757865.357476:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662528 00010000:00010000:2.0:1782757865.357589:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 2033 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757865.357637:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 358 00000100:00100000:2.0:1782757865.357659:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196662528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757865.357673:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757865.357679:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 2033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.357699:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 2033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.358407:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777d9e1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64806 expref: 6 pid: 6599 timeout: 2033 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.358429:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757865.358434:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757865.358440:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.358450:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.358482:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757865.358616:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.358627:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.358638:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.358652:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.358679:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1782757865.358753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757865.359303:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211526400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11800us (11932us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1782757865.359313:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:1.0:1782757865.359352:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757865.359358:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.359367:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757865.359371:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.359382:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.359396:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.359403:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777d9e52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.359421:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757865.359423:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757865.359425:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782757865.359621:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91719fe5f100/2, rc 0, transno 4294967339 00000100:00100000:2.0:1782757865.359624:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196662528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1964us (6071us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757865.359631:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211526400:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782757865.359639:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 358 00000100:00100000:2.0:1782757865.392289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757865.392373:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662656 00000100:00100000:3.0:1782757865.392383:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662656 00000100:00100000:3.0:1782757865.392477:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:3.0:1782757865.392489:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45288:x1869355196662656:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757865.392514:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757865.392535:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64814 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392596:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392611:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392622:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392688:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392695:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.392701:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395128:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395147:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395163:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757865.395259:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1782757865.395264:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757865.395360:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395376:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395382:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395390:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395396:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757865.395400:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395408:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395421:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757865.395424:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757865.395429:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395435:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395451:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395457:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395464:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395469:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757865.395472:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395479:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395487:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75c00) 00010000:00010000:3.0:1782757865.395489:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757865.395492:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395498:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9e67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395538:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64814 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395553:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64814 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.395565:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782757865.395567:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757865.395570:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782757865.395650:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45288:x1869355196662656:12345-192.168.204.31@tcp:101:touch.0 Request processed in 3163us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757865.395659:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:3.0:1782757865.409607:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757865.409882:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196662912 00000100:00100000:2.0:1782757865.409893:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196662912 00000100:00100000:2.0:1782757865.409950:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:2.0:1782757865.409960:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45288:x1869355196662912:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782757865.409981:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757865.410001:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9e75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6481b expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410344:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410359:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410371:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410433:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410440:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.410447:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782757865.412525:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:0.0:1782757865.413743:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9e8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413763:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413928:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413974:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413983:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413989:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.413996:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757865.414001:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.414008:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.414021:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:0.0:1782757865.414024:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757865.414029:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.414034:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9e7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757865.414048:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007133953f reply state 000000000e647697 transno 4294967561 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757865.414057:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757865.414095:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9e75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6481b expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.414113:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6481b expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757865.414187:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:0.0:1782757865.414191:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757865.414194:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525e00, rc 0) 00000100:00100000:0.0:1782757865.414282:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45288:x1869355196662912:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4323us (4684us total) trans 4294967561 rc 0/0 00000100:00100000:0.0:1782757865.414292:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 687 00010000:00010000:1.0:1782757865.424492:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424511:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424519:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424525:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.424529:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424536:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424553:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff917182dd1c00) 00010000:00010000:1.0:1782757865.424556:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757865.424560:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.424565:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9e83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757865.425059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757865.434943:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663168 00000100:00100000:2.0:1782757865.434961:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663168 00000100:00100000:2.0:1782757865.435037:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 688 00000100:00100000:2.0:1782757865.435049:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45288:x1869355196663168:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782757865.435136:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757865.435170:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9e8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6481b expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.435196:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:2.0:1782757865.435210:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757865.435259:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.435273:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.435282:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757865.435444:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f4b66ba reply state 00000000f79395b3 transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757865.435455:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757865.435559:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45288:x1869355196663168:12345-192.168.204.31@tcp:36:touch.0 Request processed in 512us (10504us total) trans 4294967562 rc 0/0 00000100:00100000:2.0:1782757865.435565:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 688 00000100:00100000:0.0:1782757865.442782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782757865.443038:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443051:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443060:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443066:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757865.443071:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443079:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443101:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782757865.443104:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757865.443108:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757865.443113:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777d9e98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757865.443254:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663296 00000100:00100000:3.0:1782757865.443266:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663296 00000100:00100000:3.0:1782757865.443318:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 689 00000100:00100000:3.0:1782757865.443336:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45288:x1869355196663296:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757865.443360:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757865.443378:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64822 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.443435:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64822 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.443447:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64822 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.443466:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782757865.443468:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782757865.443471:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782757865.443535:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45288:x1869355196663296:12345-192.168.204.31@tcp:101:touch.0 Request processed in 209us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757865.443543:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 689 00000100:00100000:0.0:1782757865.449916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757865.457981:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663424 00000100:00100000:1.0:1782757865.457997:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663424 00000100:00100000:1.0:1782757865.458059:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 372 00000100:00100000:1.0:1782757865.458068:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196663424:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:1.0:1782757865.458103:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1933 last 0 00000020:00000080:1.0:1782757865.459065:0:6597:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777d9ea6 00002000:00100000:1.0:1782757865.459080:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917081aff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782757865.459092:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782757865.460730:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782757865.460779:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081af9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782757865.460881:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196663424:12345-192.168.204.31@tcp:8:touch.0 Request processed in 2811us (10975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757865.460892:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 372 00000100:00100000:2.0:1782757865.465479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757865.472845:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663552 00000100:00100000:3.0:1782757865.472860:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663552 00000100:00100000:3.0:1782757865.473015:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 373 00000100:00100000:3.0:1782757865.473028:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196663552:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:0.0:1782757865.473771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757865.524433:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:0:x1869355196663552:12345-192.168.204.31@tcp:2:touch.0 Request processed in 51397us (59117us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1782757865.524446:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 373 00000001:00100000:1.0:1782757865.524478:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:1.0:1782757865.524490:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000100:00100000:0.0:1782757865.526687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757865.526754:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663808 00000100:00100000:1.0:1782757865.526764:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663808 00000100:00100000:1.0:1782757865.526815:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:1.0:1782757865.526853:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45288:x1869355196663808:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782757865.527162:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45288:x1869355196663808:12345-192.168.204.31@tcp:35:touch.0 Request processed in 339us (484us total) trans 4294967563 rc 0/0 00000100:00100000:1.0:1782757865.527170:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:0.0:1782757865.558899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757865.558993:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196663936 00000100:00100000:1.0:1782757865.559004:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196663936 00000100:00100000:1.0:1782757865.559065:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00100000:1.0:1782757865.559075:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45292:x1869355196663936:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757865.559102:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757865.559122:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64829 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559191:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559205:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559216:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559242:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559250:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559256:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559370:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559378:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559385:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757865.559416:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x39:0x0]: returning size 0 00000004:00200000:1.0:1782757865.559421:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757865.559438:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559450:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559458:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559466:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559473:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559479:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.559484:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559492:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559503:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:1.0:1782757865.559506:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757865.559510:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559515:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559527:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559532:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559539:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559545:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.559547:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559553:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559558:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782757865.559560:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757865.559563:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559568:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559596:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9ead lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64829 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559609:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64829 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.559616:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917191f75c00) 00010000:00010000:1.0:1782757865.559619:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757865.559621:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782757865.559689:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45292:x1869355196663936:12345-192.168.204.31@tcp:101:rm.0 Request processed in 615us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757865.559698:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00100000:2.0:1782757865.572208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757865.573054:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664064 00000100:00100000:1.0:1782757865.573066:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664064 00000100:00100000:1.0:1782757865.573134:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 374 00000100:00100000:1.0:1782757865.573144:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196664064:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757865.573164:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757865.573187:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64830 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782757865.573215:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6a42b9e8, atime: 0x6a42b9e8, ctime: 0x6a42b9e8, blocks: 0x1 00010000:00010000:1.0:1782757865.573495:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1933s v=(0 0) 00010000:00010000:1.0:1782757865.573500:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757865.573510:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.573530:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.573544:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782757865.573609:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196664064:12345-192.168.204.31@tcp:101:rm.0 Request processed in 466us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757865.573616:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 374 00000100:00100000:0.0:1782757865.577234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757865.577452:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664320 00000100:00100000:3.0:1782757865.577462:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664320 00000100:00100000:3.0:1782757865.577561:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 691 00000100:00100000:3.0:1782757865.577570:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45292:x1869355196664320:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782757865.577620:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757865.577648:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64829 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577669:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9e9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64822 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577681:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782757865.577690:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757865.577709:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577722:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577731:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577744:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577751:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577757:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577911:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,1 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577920:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.577927:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782757865.579178:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:3.0:1782757865.579189:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1933982365640ns, next at 1934982363360ns, rc = 0 00010000:00010000:3.0:1782757865.579245:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579258:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579275:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579284:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579292:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579518:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579549:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782757865.579596:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757865.579605:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579617:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757865.579621:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579630:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579634:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579644:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579650:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579656:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757865.579660:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579666:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579678:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782757865.579680:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757865.579685:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 2/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579692:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777d9ede lrc: 0/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579710:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579714:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782757865.579717:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579724:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579729:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782757865.579735:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.579736:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579740:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579752:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777d9ee5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579753:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757865.579772:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782757865.579775:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757865.579778:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579782:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757865.579784:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777d9ed0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.579786:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757865.579789:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1782757865.579799:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e64086e reply state 000000006b9efeba transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757865.579809:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782757865.579944:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45292:x1869355196664320:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2370us (2722us total) trans 4294967564 rc 0/0 00000100:00100000:3.0:1782757865.579952:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 691 00010000:00010000:1.0:1782757865.582666:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582683:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582690:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582696:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757865.582700:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582711:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582728:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff917191f75900) 00010000:00010000:1.0:1782757865.582731:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757865.582735:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757865.582742:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777d9ed7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.029462:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757866.394081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.397518:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664448 00000100:00100000:1.0:1782757866.397534:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664448 00000100:00100000:1.0:1782757866.397621:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 692 00000100:00100000:1.0:1782757866.397633:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45306:x1869355196664448:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757866.397658:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782757866.397674:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757866.397678:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64837 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397743:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397757:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397768:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757866.397861:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757866.397866:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757866.397895:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397921:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64837 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397938:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64837 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.397946:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:1.0:1782757866.397948:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757866.397952:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782757866.398025:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45306:x1869355196664448:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 394us (3957us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.398032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 692 00000100:00100000:0.0:1782757866.401502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.403380:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664704 00000100:00100000:1.0:1782757866.403394:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664704 00000100:00100000:1.0:1782757866.403493:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 693 00000100:00100000:1.0:1782757866.403505:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45306:x1869355196664704:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782757866.403556:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782757866.403583:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9ef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64837 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.403601:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777d9e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64814 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.403612:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:1.0:1782757866.403623:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757866.403649:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.403661:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.403671:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757866.403939:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc6f32a0 reply state 0000000085f48548 transno 4294967565 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757866.403949:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757866.403964:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:1.0:1782757866.404055:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45306:x1869355196664704:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 551us (2560us total) trans 4294967565 rc 0/0 00000100:00100000:1.0:1782757866.404062:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 693 00010000:00010000:2.0:1782757866.406812:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406853:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406861:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406867:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757866.406873:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406880:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406899:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:2.0:1782757866.406902:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757866.406907:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757866.406915:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9efa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757866.627237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757866.627338:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664832 00000100:00100000:3.0:1782757866.627351:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664832 00000100:00100000:3.0:1782757866.627419:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:3.0:1782757866.627442:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196664832:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757866.627550:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196664832:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 122us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757866.627559:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:2.0:1782757866.630148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.630260:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196664960 00000100:00100000:1.0:1782757866.630269:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196664960 00000100:00100000:1.0:1782757866.630326:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 375 00000100:00100000:1.0:1782757866.630335:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45318:x1869355196664960:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782757866.630728:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45318:x1869355196664960:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 393us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.630735:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 375 00000100:00100000:2.0:1782757866.633422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757866.633625:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665088 00000100:00100000:0.0:1782757866.633634:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665088 00000100:00100000:0.0:1782757866.633700:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 376 00000100:00100000:0.0:1782757866.633711:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45318:x1869355196665088:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757866.634114:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45318:x1869355196665088:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 404us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757866.634122:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 376 00000100:00100000:0.0:1782757866.650238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.656240:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665216 00000100:00100000:1.0:1782757866.656258:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665216 00000100:00100000:2.0:1782757866.656532:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00100000:2.0:1782757866.656544:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665216:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757866.657208:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665216:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 665us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757866.657217:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00100000:2.0:1782757866.672727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.673130:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665344 00000100:00100000:1.0:1782757866.673139:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665344 00000100:00100000:1.0:1782757866.673201:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:1.0:1782757866.673213:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665344:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757866.673325:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665344:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 113us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.673334:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:3.0:1782757866.678028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.678168:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665472 00000100:00100000:1.0:1782757866.678179:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665472 00000100:00100000:1.0:1782757866.678265:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 377 00000100:00100000:1.0:1782757866.678276:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45318:x1869355196665472:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782757866.678642:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45318:x1869355196665472:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 367us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.678651:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 377 00000100:00100000:0.0:1782757866.683615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.683715:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665600 00000100:00100000:1.0:1782757866.683949:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665600 00000100:00100000:1.0:1782757866.683995:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 378 00000100:00100000:1.0:1782757866.684004:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45318:x1869355196665600:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782757866.684380:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45318:x1869355196665600:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 375us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.684387:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 378 00000100:00100000:2.0:1782757866.687364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.687454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665728 00000100:00100000:1.0:1782757866.687464:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665728 00000100:00100000:1.0:1782757866.687516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 697 00000100:00100000:1.0:1782757866.687525:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665728:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757866.687966:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45318:x1869355196665728:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 440us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.687973:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 697 00000100:00100000:2.0:1782757866.781735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757866.781853:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196665856 00000100:00100000:0.0:1782757866.781864:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196665856 00000100:00100000:0.0:1782757866.781924:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 698 00000100:00100000:0.0:1782757866.781935:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45322:x1869355196665856:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782757866.781965:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757866.781986:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9f01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6483e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782043:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782057:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782070:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782083:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782090:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782097:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782390:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782400:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782407:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757866.782438:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:0.0:1782757866.782442:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757866.782464:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782475:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782482:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782489:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782495:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757866.782498:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782507:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782517:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:0.0:1782757866.782520:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757866.782525:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782531:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782548:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782554:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782560:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782565:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757866.782568:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782573:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782579:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff91718bcfdf00) 00010000:00010000:0.0:1782757866.782581:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757866.782584:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782589:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777d9f0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782614:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777d9f01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6483e expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782630:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6483e expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.782642:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782757866.782644:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782757866.782646:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757866.782707:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45322:x1869355196665856:12345-192.168.204.31@tcp:101:dd.0 Request processed in 774us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757866.782715:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 698 00000100:00100000:0.0:1782757866.790012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.790380:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666112 00000100:00100000:1.0:1782757866.790391:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666112 00000100:00100000:1.0:1782757866.790481:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 699 00000100:00100000:1.0:1782757866.790491:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45322:x1869355196666112:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782757866.790514:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757866.790533:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9f1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64845 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790658:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790672:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790682:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790696:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790703:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.790710:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782757866.791522:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:1.0:1782757866.791685:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791697:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791706:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791738:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791745:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791753:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791760:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757866.791764:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791771:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791784:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:1.0:1782757866.791787:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757866.791792:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791798:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757866.791811:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b239e5eb reply state 00000000dfd36893 transno 4294967566 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757866.791919:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782757866.791951:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9f1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64845 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791966:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64845 expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.791974:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782757866.791977:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757866.791979:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782757866.792097:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+15:45322:x1869355196666112:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1607us (2101us total) trans 4294967566 rc 0/0 00000100:00100000:1.0:1782757866.792106:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 699 00010000:00010000:1.0:1782757866.798915:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798934:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798943:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798949:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757866.798954:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798963:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798981:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9171a0e3a900) 00010000:00010000:1.0:1782757866.798984:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757866.798990:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.798997:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777d9f2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757866.808335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757866.808447:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666240 00000100:00100000:3.0:1782757866.808556:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666240 00000100:00100000:3.0:1782757866.808755:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 379 00000100:00100000:3.0:1782757866.808767:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45322:x1869355196666240:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782757866.808786:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757866.808809:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6484c expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782757866.808856:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782757866.808880:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1935s v=(0 0) 00010000:00010000:3.0:1782757866.808885:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757866.808895:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757866.808913:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757866.808927:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782757866.808991:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45322:x1869355196666240:12345-192.168.204.31@tcp:101:dd.0 Request processed in 226us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757866.808997:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 379 00000100:00100000:2.0:1782757866.827530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757866.828203:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666368 00000100:00100000:3.0:1782757866.828214:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666368 00002000:00100000:2.0:1782757866.828366:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9170810e2680 x1869355196666368/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:537/0 lens 488/0 e 0 to 0 dl 1782757877 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782757866.828378:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170810e2680 with x1869355196666368 ext(0->1048575) 00002000:00010000:2.0:1782757866.828385:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9170810e2680 00000100:00100000:2.0:1782757866.828478:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1782757866.828488:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196666368:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:2.0:1782757866.868741:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196666368:12345-192.168.204.31@tcp:4:dd.0 Request processed in 40243us (41210us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1782757866.868756:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00002000:00100000:2.0:1782757866.868770:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9170810e2680 x1869355196666368/t4294967340(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:537/0 lens 488/448 e 0 to 0 dl 1782757877 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782757866.868782:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170810e2680 with x1869355196666368 ext(0->1048575) 00002000:00010000:2.0:1782757866.868790:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9170810e2680 00000100:00100000:2.0:1782757866.879348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.879454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666496 00000100:00100000:1.0:1782757866.879466:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666496 00000100:00100000:1.0:1782757866.879533:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 700 00000100:00100000:1.0:1782757866.879543:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+14:45322:x1869355196666496:12345-192.168.204.31@tcp:44:dd.0 00000100:00100000:0.0:1782757866.961489:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+14:45322:x1869355196666496:12345-192.168.204.31@tcp:44:dd.0 Request processed in 81937us (82142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757866.961502:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 700 00000001:00080000:0.0:1782757866.961540:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967566 is committed 00000004:00080000:0.0:1782757866.961560:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00000100:00100000:0.0:1782757866.961847:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211526656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782757866.961893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757866.961958:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526656 00000100:00100000:0.0:1782757866.961966:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526656 00000100:00100000:0.0:1782757866.962011:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1782757866.962019:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211526656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757866.962047:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00010000:00010000:0.0:1782757866.962069:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.962089:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.962104:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782757866.962108:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757866.962113:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.962137:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.962150:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 5 pid: 6599 timeout: 2035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757866.962162:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211526784:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757866.962199:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181377c00 going to sleep for 11 seconds 00000100:00080000:3.0:1782757866.962324:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757866.964839:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211526784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782757866.964869:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757866.965394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.965457:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666752 00000100:00100000:1.0:1782757866.965465:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666752 00010000:00010000:1.0:1782757866.965505:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 2035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757866.965546:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 359 00000100:00100000:1.0:1782757866.965555:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196666752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757866.965572:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757866.965577:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 2035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.965599:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 2035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.965625:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777d9ec9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64830 expref: 6 pid: 6599 timeout: 2035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.965652:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757866.965657:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757866.965663:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.965673:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.965702:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757866.965755:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196666752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 200us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757866.965762:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 359 00010000:00010000:0.0:1782757866.966023:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.966033:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.966050:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.966058:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757866.966079:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782757866.966667:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211526656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4646us (4771us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1782757866.966676:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1782757866.966815:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757866.966855:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.966865:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757866.966870:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.966880:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.966895:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.966908:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000738e1a25/0xdd99f5c4777d9f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757866.966925:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757866.966927:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757866.966929:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757866.967599:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082d62300/2, rc 0, transno 4294967339 00000100:00100000:3.0:1782757866.967609:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211526656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782757866.968178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757866.968258:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196666624 00000100:00100000:1.0:1782757866.968265:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196666624 00000100:00100000:1.0:1782757866.968317:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00100000:1.0:1782757866.968325:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196666624:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:1.0:1782757866.997695:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000001:00080000:1.0:1782757866.997714:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000100:00100000:3.0:1782757866.997940:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196666624:12345-192.168.204.31@tcp:16:dd.0 Request processed in 29609us (29759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757866.997952:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00100000:3.0:1782757866.999802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757867.000263:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667008 00000100:00100000:0.0:1782757867.000273:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667008 00000100:00100000:0.0:1782757867.000342:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:0.0:1782757867.000352:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45322:x1869355196667008:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:0.0:1782757867.001163:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967567 00000100:00100000:0.0:1782757867.001367:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45322:x1869355196667008:12345-192.168.204.31@tcp:35:dd.0 Request processed in 1014us (1571us total) trans 4294967568 rc 0/0 00000100:00100000:0.0:1782757867.001377:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 74 00000020:00080000:0.0:1782757867.001383:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782757867.052153:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757867.440978:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757867.440999:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757867.441067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757867.441134:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211526912 00000100:00100000:3.0:1782757867.441141:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211526912 00000100:00100000:3.0:1782757867.441189:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1782757867.441199:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211526912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757867.441219:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1782757867.441259:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211526912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757867.441266:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00080000:3.0:1782757867.441285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757867.441339:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:3.0:1782757867.441344:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91719fe5f100, transno 4294967339 00000100:00100000:3.0:1782757867.441360:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211526912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757868.078011:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782757868.171067:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967568 is committed 00000100:00100000:0.0:1782757868.725361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757868.725408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757868.725451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757868.725551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757868.725604:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667520 00000100:00100000:0.0:1782757868.725616:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667520 00000100:00100000:0.0:1782757868.725682:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667392 00000100:00100000:0.0:1782757868.725685:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667392 00000100:00100000:0.0:1782757868.725711:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1003 00000100:00100000:0.0:1782757868.725725:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196667520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757868.725860:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196667520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757868.725869:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1003 00000100:00100000:0.0:1782757868.725888:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:0.0:1782757868.725895:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196667392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757868.725919:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196667392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757868.725925:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:3.0:1782757868.726377:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667264 00000100:00100000:3.0:1782757868.726383:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667264 00000100:00100000:3.0:1782757868.726435:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1353 00000100:00100000:3.0:1782757868.726443:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196667264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757868.726482:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196667264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757868.726489:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1353 00000100:00080000:3.0:1782757868.726520:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782757868.726526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757868.726528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757868.731194:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667136 00000100:00100000:2.0:1782757868.731218:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667136 00000100:00100000:2.0:1782757868.731744:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1117 00000100:00100000:2.0:1782757868.731756:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196667136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757868.731974:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196667136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 218us (6520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757868.731982:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1117 00010000:00010000:1.0:1782757869.100646:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757869.487603:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211527040:0@lo:400:kworker.0 00000100:00100000:3.0:1782757869.487713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757869.487818:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527040 00000100:00100000:1.0:1782757869.487845:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527040 00000100:00100000:1.0:1782757869.487902:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1782757869.487911:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211527040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757869.488060:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211527168:0@lo:400:kworker.0 00000100:00100000:0.0:1782757869.488094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757869.491220:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527168 00000100:00100000:0.0:1782757869.491241:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527168 00000100:00100000:0.0:1782757869.491345:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1782757869.491358:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211527168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757869.491508:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211527168:12345-0@lo:400:kworker.0 Request processed in 151us (3411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757869.491516:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1782757869.491583:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211527168:0@lo:400:kworker.0 00000100:00100000:1.0:1782757869.491809:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211527040:12345-0@lo:400:kworker.0 Request processed in 3897us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757869.495195:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211527040:0@lo:400:kworker.0 00000100:00100000:1.0:1782757869.496221:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1782757869.501489:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757869.501515:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211527296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.501584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757869.501631:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527296 00000100:00100000:2.0:1782757869.501638:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527296 00000100:00100000:2.0:1782757869.501695:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1782757869.501704:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211527296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.501751:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211527296:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757869.501758:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1782757869.501796:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211527296:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.501855:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211527424:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.501880:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757869.501905:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527424 00000100:00100000:2.0:1782757869.501908:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527424 00000100:00100000:2.0:1782757869.501932:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1782757869.501938:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211527424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.501966:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211527424:12345-0@lo:400:kworker.0 Request processed in 28us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757869.501971:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1782757869.501989:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211527424:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.502013:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757869.502019:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211527552:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.502039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757869.502058:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527552 00000100:00100000:2.0:1782757869.502061:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527552 00000100:00100000:2.0:1782757869.502080:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1782757869.502085:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211527552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.502113:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211527552:12345-0@lo:400:kworker.0 Request processed in 27us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757869.502118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1782757869.502138:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211527552:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.502161:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211527680:0@lo:400:kworker.0 00000100:00100000:2.0:1782757869.502179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782757869.502698:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757869.502704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757869.502720:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527680 00000100:00100000:3.0:1782757869.502725:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527680 00000100:00100000:3.0:1782757869.502762:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1782757869.502770:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211527680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757869.502817:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211527680:12345-0@lo:400:kworker.0 Request processed in 49us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757869.502838:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1782757869.502887:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211527680:0@lo:400:kworker.0 00000100:00080000:2.0:1782757869.503124:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782757869.555784:0:78163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1937958958561ns, next at 1933407379167ns, rc = 0 00000004:00080000:1.0:1782757869.556060:0:78163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1937959237018ns, next at 1934982363360ns, rc = 0 00000004:00080000:0.0:1782757869.564205:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00000004:00080000:0.0:1782757869.564235:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00000100:00100000:1.0:1782757869.997080:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211527808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757869.997162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757869.998446:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527808 00000100:00100000:0.0:1782757869.998458:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527808 00000100:00100000:0.0:1782757869.998529:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1782757869.998540:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211527808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757869.998594:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757869.998674:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211527808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757869.998682:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1782757869.999479:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211527808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757870.124425:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782757870.628966:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00010000:00010000:1.0:1782757871.158698:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757871.569018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757871.570349:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667648 00000100:00100000:0.0:1782757871.570362:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667648 00000100:00100000:0.0:1782757871.570486:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:0.0:1782757871.570499:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196667648:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757871.570607:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196667648:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 111us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757871.570615:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00080000:2.0:1782757871.574133:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757871.578092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757871.578480:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667776 00000100:00100000:1.0:1782757871.578491:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667776 00000100:00100000:1.0:1782757871.578568:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 382 00000100:00100000:1.0:1782757871.578579:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45515:x1869355196667776:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782757871.578997:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45515:x1869355196667776:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 419us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757871.579006:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 382 00000100:00080000:3.0:1782757871.579309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757871.587857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757871.587990:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196667904 00000100:00100000:3.0:1782757871.588002:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196667904 00000100:00100000:3.0:1782757871.588076:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 383 00000100:00100000:3.0:1782757871.588087:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45515:x1869355196667904:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757871.588417:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45515:x1869355196667904:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 331us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757871.588425:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 383 00000100:00080000:2.0:1782757871.588544:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757871.596170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757871.596224:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668032 00000100:00100000:0.0:1782757871.596234:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668032 00000100:00100000:0.0:1782757871.596291:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:0.0:1782757871.596301:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668032:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757871.597076:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668032:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 774us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757871.597085:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:2.0:1782757871.604886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757871.604926:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668160 00000100:00100000:2.0:1782757871.604937:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668160 00000100:00100000:2.0:1782757871.604989:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:2.0:1782757871.605000:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668160:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757871.605093:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668160:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757871.605101:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:2.0:1782757871.607073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757871.607151:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668288 00000100:00100000:3.0:1782757871.607161:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668288 00000100:00100000:3.0:1782757871.607227:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 384 00000100:00100000:3.0:1782757871.607237:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45515:x1869355196668288:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757871.607642:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45515:x1869355196668288:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 405us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757871.607651:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 384 00000100:00100000:2.0:1782757871.609630:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757871.609953:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668416 00000100:00100000:3.0:1782757871.609963:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668416 00000100:00100000:3.0:1782757871.610020:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:3.0:1782757871.610030:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45515:x1869355196668416:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757871.610397:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45515:x1869355196668416:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 368us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757871.610406:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:3.0:1782757871.613511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757871.615665:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668544 00000100:00100000:0.0:1782757871.615679:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668544 00000100:00100000:0.0:1782757871.618318:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 704 00000100:00100000:0.0:1782757871.618340:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668544:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757871.618795:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45515:x1869355196668544:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 461us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757871.618803:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 704 00000100:00100000:2.0:1782757871.703663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757871.703869:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668800 00000100:00100000:0.0:1782757871.703880:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668800 00000100:00100000:0.0:1782757871.703954:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:0.0:1782757871.703964:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45519:x1869355196668800:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782757871.704034:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757871.704064:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64845 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704080:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:0.0:1782757871.704090:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757871.704111:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704124:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704133:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704146:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704154:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704163:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704645:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704655:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.704664:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782757871.706379:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:0.0:1782757871.706395:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1940109571657ns, next at 1941109567657ns, rc = 0 00010000:00010000:0.0:1782757871.706685:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706701:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706790:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706801:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706807:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706812:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706870:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782757871.706895:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.706902:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706932:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757871.706939:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706947:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757871.706951:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706959:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706972:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:1.0:1782757871.706976:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782757871.706981:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706986:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777d9f63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757871.706999:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757871.707001:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757871.707003:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757871.707106:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707113:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757871.707117:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707124:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707134:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782757871.707137:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782757871.707140:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707145:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777d9f5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707166:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707173:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707183:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707187:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757871.707190:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707196:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707202:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782757871.707216:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757871.707219:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757871.707224:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777d9f4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757871.707235:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000071f49d8 reply state 0000000061adaa89 transno 4294967569 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757871.707244:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782757871.707378:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45519:x1869355196668800:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3411us (3722us total) trans 4294967569 rc 0/0 00000100:00100000:0.0:1782757871.707387:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 705 00010000:00010000:3.0:1782757871.710247:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710266:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710274:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710281:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757871.710287:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710296:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710315:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff91718bcfd000) 00010000:00010000:3.0:1782757871.710318:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757871.710323:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757871.710329:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777d9f55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757872.172401:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757872.558341:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211527936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757872.558425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757872.559558:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211527936 00000100:00100000:1.0:1782757872.559571:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211527936 00000100:00100000:1.0:1782757872.559642:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1782757872.559653:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211527936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757872.559709:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782757872.559780:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211527936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757872.559787:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1782757872.559881:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211527936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757872.560019:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782757873.199216:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757873.854017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757873.854075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757873.854117:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757873.854147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757873.854204:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669056 00000100:00100000:2.0:1782757873.854217:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669056 00000100:00100000:2.0:1782757873.854303:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1357 00000100:00100000:2.0:1782757873.854315:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196669056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757873.854422:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196669056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757873.854430:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1357 00000100:00100000:2.0:1782757873.854458:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669184 00000100:00100000:2.0:1782757873.854462:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669184 00000100:00100000:2.0:1782757873.854502:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669312 00000100:00100000:2.0:1782757873.854505:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669312 00000100:00100000:2.0:1782757873.854531:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:2.0:1782757873.854538:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196669184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757873.854566:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196669184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757873.854572:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:2.0:1782757873.854583:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1008 00000100:00100000:2.0:1782757873.854588:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196669312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757873.854611:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196669312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757873.854618:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1008 00000100:00080000:2.0:1782757873.854640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757873.854645:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757873.854647:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757873.854987:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196668928 00000100:00100000:3.0:1782757873.854994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196668928 00000100:00100000:3.0:1782757873.855039:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1119 00000100:00100000:3.0:1782757873.855048:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196668928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757873.855079:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196668928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757873.855086:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1119 00010000:00010000:1.0:1782757874.229676:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757874.264200:0:78308:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1942667375090ns, next at 1941109567657ns, rc = 0 00000001:00080000:1.0:1782757874.345595:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967569 is committed 00000004:00080000:1.0:1782757874.345613:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000004:00080000:1.0:1782757874.345641:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00000100:00100000:1.0:1782757874.346290:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757874.346321:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211528064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782757874.346416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757874.346683:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528064 00000100:00100000:2.0:1782757874.346693:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528064 00000100:00100000:2.0:1782757874.346960:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782757874.346973:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211528064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782757874.347018:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00010000:00010000:2.0:1782757874.347053:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.347080:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.347090:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1782757874.347095:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757874.347101:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.347300:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.347318:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 5 pid: 6598 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757874.347332:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211528192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782757874.347427:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9fd80 going to sleep for 11 seconds 00000100:00080000:3.0:1782757874.349508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757874.351292:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211528192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782757874.351337:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757874.354578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757874.355008:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669440 00000100:00100000:2.0:1782757874.355022:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669440 00010000:00010000:2.0:1782757874.355075:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757874.355125:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 360 00000100:00100000:2.0:1782757874.355147:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196669440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757874.355176:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757874.355183:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.355205:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.355235:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ced6bb/0xdd99f5c4777d9f40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6484c expref: 6 pid: 6598 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.355255:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757874.355260:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782757874.355267:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.355278:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.355323:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757874.355387:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196669440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 252us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757874.355394:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 360 00010000:00010000:3.0:1782757874.355521:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757874.355533:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757874.355550:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757874.355560:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757874.355588:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782757874.356569:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211528064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9594us (10149us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1782757874.356582:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00010000:2.0:1782757874.357126:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757874.357147:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.357170:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757874.357176:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.357193:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.357213:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.357222:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a37f7ea5/0xdd99f5c4777d9f6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757874.357249:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757874.357251:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757874.357253:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757874.357419:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917083658380/2, rc 0, transno 4294967341 00000100:00100000:1.0:1782757874.357440:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211528064:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782757874.358037:0:78308:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1942761213438ns, next at 1934982363360ns, rc = 0 00000004:00080000:3.0:1782757874.376218:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00000100:00100000:0.0:1782757874.604312:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211528448:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.604479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757874.604572:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211528960:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.604621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757874.604659:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757874.604666:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211528576:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.604692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757874.605031:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528448 00000100:00100000:0.0:1782757874.605042:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528448 00000100:00100000:0.0:1782757874.605106:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528576 00000100:00100000:0.0:1782757874.605109:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528576 00000100:00100000:0.0:1782757874.605155:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:0.0:1782757874.605166:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211528448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.605237:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211528448:12345-0@lo:400:kworker.0 Request processed in 71us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757874.605246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1782757874.605437:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211528704:0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.605493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757874.605521:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782757874.605528:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211528320:0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.605565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757874.605597:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211528832:0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.605623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757874.605653:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528960 00000100:00100000:3.0:1782757874.605657:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528960 00000100:00100000:3.0:1782757874.605690:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528704 00000100:00100000:3.0:1782757874.605704:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528704 00000100:00100000:3.0:1782757874.605727:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1782757874.605734:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211528960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.605770:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211528960:12345-0@lo:400:kworker.0 Request processed in 36us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757874.605778:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1782757874.605794:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1782757874.605799:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211528704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.605846:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211528704:12345-0@lo:400:kworker.0 Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757874.605852:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1782757874.606060:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528320 00000100:00100000:3.0:1782757874.606065:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528320 00000100:00100000:3.0:1782757874.606090:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1782757874.606096:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.606129:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211528320:12345-0@lo:400:kworker.0 Request processed in 32us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757874.606135:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1782757874.606199:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211528320:0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.606216:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211528704:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.606665:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211528832 00000100:00100000:0.0:1782757874.606672:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211528832 00000100:00100000:0.0:1782757874.606708:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1782757874.606716:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.606761:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211528576:12345-0@lo:400:kworker.0 Request processed in 46us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757874.606768:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1782757874.606779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1782757874.606785:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.606838:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211528832:12345-0@lo:400:kworker.0 Request processed in 35us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757874.606844:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00080000:0.0:1782757874.606880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757874.606886:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757874.606912:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211528576:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.606925:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211528448:0@lo:400:kworker.0 00000100:00100000:0.0:1782757874.606935:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:0.0:1782757874.606941:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082d62300, transno 4294967339 00000100:00100000:0.0:1782757874.606955:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211528960:0@lo:400:kworker.0 00000100:00100000:3.0:1782757874.607394:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211528832:0@lo:400:kworker.0 00000100:00100000:0.0:1782757875.121871:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757875.121979:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757875.122190:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529088 00000100:00100000:2.0:1782757875.122201:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529088 00000100:00100000:2.0:1782757875.122268:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1782757875.122279:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211529088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757875.122334:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757875.122405:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211529088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757875.122413:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1782757875.122639:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211529088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757875.244022:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757876.268400:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782757876.756299:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00010000:00010000:2.0:1782757877.292176:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757877.683059:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757877.683182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757877.683277:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529216 00000100:00100000:1.0:1782757877.683286:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529216 00000100:00100000:1.0:1782757877.683419:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1782757877.683431:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211529216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757877.683479:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757877.683536:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211529216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757877.683543:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00080000:1.0:1782757877.683571:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757877.683604:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:1.0:1782757877.683610:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917083658380, transno 4294967341 00000100:00100000:1.0:1782757877.683629:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211529216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757878.325321:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757878.972692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757878.972892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757878.972939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757878.972987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757878.973029:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669696 00000100:00100000:2.0:1782757878.973045:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669696 00000100:00100000:2.0:1782757878.973166:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1361 00000100:00100000:2.0:1782757878.973178:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196669696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757878.973481:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196669696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 303us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757878.973490:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1361 00000100:00080000:0.0:1782757878.979902:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757878.980152:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669824 00000100:00100000:3.0:1782757878.980170:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669824 00000100:00100000:3.0:1782757878.980279:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669952 00000100:00100000:3.0:1782757878.980284:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669952 00000100:00100000:3.0:1782757878.980334:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1011 00000100:00100000:3.0:1782757878.980348:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196669824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757878.980450:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196669824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 106us (7558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757878.980460:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1011 00000100:00100000:3.0:1782757878.980490:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1012 00000100:00100000:3.0:1782757878.980496:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196669952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757878.980518:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196669952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757878.980524:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1012 00000100:00080000:0.0:1782757878.981615:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757878.981624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757878.983752:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196669568 00000100:00100000:1.0:1782757878.983770:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196669568 00000100:00100000:1.0:1782757878.983887:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1121 00000100:00100000:1.0:1782757878.983899:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196669568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757878.984019:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196669568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 122us (11348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757878.984028:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1121 00010000:00010000:1.0:1782757879.340403:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757879.726814:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211529344:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.726939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.726997:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211529856:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.727069:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757879.727075:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211529728:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.727321:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211529472:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.727361:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211529984:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727376:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.727388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757879.727391:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211529600:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757879.727452:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529344 00000100:00100000:3.0:1782757879.727462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529344 00000100:00100000:3.0:1782757879.727516:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1782757879.727527:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757879.727635:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529728 00000100:00100000:1.0:1782757879.727642:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529728 00000100:00100000:3.0:1782757879.727669:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211529344:12345-0@lo:400:kworker.0 Request processed in 142us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757879.727677:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1782757879.727685:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529984 00000100:00100000:1.0:1782757879.727688:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529984 00000100:00100000:1.0:1782757879.727710:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1782757879.727717:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211529728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727732:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211529344:0@lo:400:kworker.0 00000100:00100000:1.0:1782757879.727756:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211529728:12345-0@lo:400:kworker.0 Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757879.727760:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211529728:0@lo:400:kworker.0 00000100:00100000:1.0:1782757879.727763:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1782757879.727781:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1782757879.727787:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211529984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727874:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529856 00000100:00100000:3.0:1782757879.727878:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529856 00000100:00100000:1.0:1782757879.727886:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211529984:12345-0@lo:400:kworker.0 Request processed in 99us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757879.727892:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1782757879.727906:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529472 00000100:00100000:3.0:1782757879.727909:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529472 00000100:00100000:1.0:1782757879.727916:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211529600 00000100:00100000:1.0:1782757879.727919:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211529600 00000100:00100000:3.0:1782757879.727928:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1782757879.727933:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757879.727938:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1782757879.727943:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211529472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.727970:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211529856:12345-0@lo:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757879.727971:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211529472:12345-0@lo:400:kworker.0 Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757879.727977:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1782757879.727980:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1782757879.727988:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1782757879.727993:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211529600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782757879.728003:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757879.728008:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757879.728010:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757879.728019:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211529600:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757879.728024:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1782757879.728068:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211529600:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.728078:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211529472:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.728088:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211529984:0@lo:400:kworker.0 00000100:00100000:3.0:1782757879.728115:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211529856:0@lo:400:kworker.0 00000100:00100000:0.0:1782757880.236165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757880.236201:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211530112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757880.236311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757880.236567:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530112 00000100:00100000:1.0:1782757880.236578:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530112 00000100:00100000:1.0:1782757880.236790:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1782757880.236803:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211530112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757880.236880:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757880.236955:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211530112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757880.236963:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1782757880.237067:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211530112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757880.364460:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757881.388311:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757882.415547:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757882.796207:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757882.796230:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211530240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757882.796309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757882.796506:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530240 00000100:00100000:1.0:1782757882.796516:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530240 00000100:00080000:0.0:1782757882.796572:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757882.796596:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1782757882.796606:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211530240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757882.796646:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757882.796713:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211530240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757882.796721:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1782757882.796754:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211530240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757883.436341:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757884.085322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757884.085374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757884.085420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757884.085463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757884.085559:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670208 00000100:00100000:1.0:1782757884.085569:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670208 00000100:00100000:1.0:1782757884.085646:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1365 00000100:00100000:1.0:1782757884.085659:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196670208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757884.085745:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196670208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757884.085753:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1365 00000100:00100000:1.0:1782757884.085782:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670464 00000100:00100000:1.0:1782757884.085786:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670464 00000100:00100000:1.0:1782757884.085810:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670336 00000100:00100000:1.0:1782757884.085813:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670336 00000100:00100000:1.0:1782757884.085866:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1015 00000100:00100000:1.0:1782757884.085873:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196670464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757884.085898:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196670464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757884.085905:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1015 00000100:00100000:1.0:1782757884.085916:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1016 00000100:00100000:1.0:1782757884.085923:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196670336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757884.085944:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196670336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757884.085951:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1016 00000100:00080000:0.0:1782757884.086043:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757884.086048:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757884.086051:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757884.087060:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670080 00000100:00100000:2.0:1782757884.087069:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670080 00000100:00100000:2.0:1782757884.087120:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1123 00000100:00100000:2.0:1782757884.087128:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196670080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757884.087195:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196670080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757884.087203:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1123 00010000:00010000:2.0:1782757884.460251:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757884.844856:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211530496:0@lo:400:kworker.0 00000100:00100000:0.0:1782757884.844928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757884.844993:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211531008:0@lo:400:kworker.0 00000100:00100000:0.0:1782757884.845020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757884.845043:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757884.845050:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211530624:0@lo:400:kworker.0 00000100:00100000:0.0:1782757884.845071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757884.845155:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211530368:0@lo:400:kworker.0 00000100:00100000:1.0:1782757884.845194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757884.845223:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211530880:0@lo:400:kworker.0 00000100:00100000:2.0:1782757884.845246:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530496 00000100:00100000:1.0:1782757884.845252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757884.845258:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530496 00000100:00100000:1.0:1782757884.845274:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757884.845281:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211530752:0@lo:400:kworker.0 00000100:00100000:2.0:1782757884.845305:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530624 00000100:00100000:1.0:1782757884.845306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757884.845310:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530624 00000100:00100000:1.0:1782757884.845341:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530368 00000100:00100000:2.0:1782757884.845342:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530880 00000100:00100000:2.0:1782757884.845347:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530880 00000100:00100000:1.0:1782757884.845347:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530368 00000100:00100000:2.0:1782757884.845390:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1782757884.845400:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757884.845405:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1782757884.845415:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211530368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782757884.845515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757884.845547:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211530496:0@lo:400:kworker.0 00000100:00100000:0.0:1782757884.845600:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1782757884.845611:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757884.846735:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1782757884.846749:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211530880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757884.856061:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211530496:12345-0@lo:400:kworker.0 Request processed in 10652us (11122us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757884.856079:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1782757884.856130:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531008 00000100:00100000:2.0:1782757884.856139:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531008 00000100:00100000:2.0:1782757884.856203:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211530752 00000100:00100000:2.0:1782757884.856206:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211530752 00000100:00100000:2.0:1782757884.856235:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1782757884.856243:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211531008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757884.856320:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211531008:12345-0@lo:400:kworker.0 Request processed in 78us (11298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757884.856326:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1782757884.856338:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1782757884.856344:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757884.856388:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211530752:12345-0@lo:400:kworker.0 Request processed in 44us (11083us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757884.856393:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00080000:2.0:1782757884.856479:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757884.856874:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757884.856891:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211530368:12345-0@lo:400:kworker.0 Request processed in 11474us (11693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757884.856903:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1782757884.856932:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211531008:0@lo:400:kworker.0 00000100:00100000:1.0:1782757884.856991:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211530752:0@lo:400:kworker.0 00000100:00100000:1.0:1782757884.857007:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211530368:0@lo:400:kworker.0 00000100:00100000:0.0:1782757884.858909:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211530624:12345-0@lo:400:kworker.0 Request processed in 13293us (13827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757884.858924:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1782757884.860274:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211530624:0@lo:400:kworker.0 00000100:00100000:3.0:1782757884.865943:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211530880:12345-0@lo:400:kworker.0 Request processed in 19190us (20686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757884.865970:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1782757884.866147:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211530880:0@lo:400:kworker.0 00000100:00100000:1.0:1782757885.356265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757885.356290:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211531136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757885.356372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757885.356502:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531136 00000100:00100000:2.0:1782757885.356510:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531136 00000100:00100000:2.0:1782757885.356566:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1782757885.356576:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211531136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757885.356626:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757885.356694:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211531136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757885.356701:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1782757885.356973:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211531136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757885.484331:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757886.508128:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757887.532643:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757887.916068:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211531264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757887.916154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757887.916286:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531264 00000100:00100000:2.0:1782757887.916294:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531264 00000100:00080000:3.0:1782757887.916358:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757887.916360:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1782757887.916371:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211531264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782757887.916420:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757887.916467:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211531264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757887.916475:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1782757887.920228:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211531264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757888.426642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757888.426938:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670592 00000100:00100000:2.0:1782757888.426948:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670592 00000100:00100000:2.0:1782757888.427021:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 706 00000100:00100000:2.0:1782757888.427032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196670592:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:3.0:1782757888.427047:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757888.427127:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196670592:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 97us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757888.427147:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 706 00000100:00100000:3.0:1782757888.433213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757888.437246:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670720 00000100:00100000:2.0:1782757888.437262:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670720 00000100:00080000:1.0:1782757888.437347:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757888.437370:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 387 00000100:00100000:2.0:1782757888.437382:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196670720:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757888.437813:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196670720:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 432us (4608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757888.437841:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 387 00000100:00100000:3.0:1782757888.444233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757888.445393:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670848 00000100:00100000:2.0:1782757888.445405:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670848 00000100:00100000:2.0:1782757888.445485:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 388 00000100:00100000:2.0:1782757888.445496:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196670848:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782757888.445866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757888.445888:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196670848:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 383us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757888.445897:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 388 00000100:00100000:1.0:1782757888.458270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757888.459506:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196670976 00000100:00100000:2.0:1782757888.459517:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196670976 00000100:00100000:2.0:1782757888.459624:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 707 00000100:00100000:2.0:1782757888.459635:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196670976:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757888.476757:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196670976:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 17114us (18485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757888.476770:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 707 00000100:00100000:3.0:1782757888.490126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757888.490173:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671104 00000100:00100000:3.0:1782757888.490183:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671104 00000100:00100000:3.0:1782757888.490242:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 708 00000100:00100000:3.0:1782757888.490253:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196671104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757888.490357:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196671104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757888.490364:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 708 00000100:00100000:2.0:1782757888.497787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757888.497854:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671232 00000100:00100000:2.0:1782757888.497865:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671232 00000100:00100000:2.0:1782757888.497921:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 389 00000100:00100000:2.0:1782757888.497932:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196671232:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757888.498652:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196671232:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 719us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757888.498661:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 389 00000100:00100000:3.0:1782757888.504995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757888.505030:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671360 00000100:00100000:3.0:1782757888.505039:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671360 00000100:00100000:3.0:1782757888.505084:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 390 00000100:00100000:3.0:1782757888.505095:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196671360:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757888.505460:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45696:x1869355196671360:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 365us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757888.505468:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 390 00000100:00100000:3.0:1782757888.512448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757888.512495:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671488 00000100:00100000:3.0:1782757888.512505:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671488 00000100:00100000:3.0:1782757888.512556:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 709 00000100:00100000:3.0:1782757888.512566:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196671488:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757888.513197:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45696:x1869355196671488:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 628us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757888.513208:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 709 00010000:00010000:2.0:1782757888.560392:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757889.206911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757889.206945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757889.206978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757889.207007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757889.207038:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196672000 00000100:00100000:2.0:1782757889.207049:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196672000 00000100:00100000:2.0:1782757889.207101:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671872 00000100:00100000:2.0:1782757889.207104:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671872 00000100:00100000:2.0:1782757889.207130:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1019 00000100:00100000:2.0:1782757889.207140:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196672000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757889.207215:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671744 00000100:00100000:1.0:1782757889.207220:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671744 00000100:00100000:2.0:1782757889.207230:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196672000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.207239:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1019 00000100:00100000:2.0:1782757889.207256:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:2.0:1782757889.207263:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196671872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757889.207272:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1369 00000100:00100000:1.0:1782757889.207278:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196671744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757889.207286:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196671872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.207292:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:1.0:1782757889.207303:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196671744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.207310:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196671616 00000100:00100000:1.0:1782757889.207310:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1369 00000100:00100000:2.0:1782757889.207313:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196671616 00000100:00100000:2.0:1782757889.207340:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1125 00000100:00100000:2.0:1782757889.207347:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196671616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757889.207371:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196671616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.207378:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1125 00010000:00010000:2.0:1782757889.582891:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757889.964300:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211531776:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.964377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.964437:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782757889.964444:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211531392:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.964472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.964493:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211531904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.964518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.964544:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211531520:0@lo:400:kworker.0 00000100:00100000:1.0:1782757889.965088:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531392 00000100:00100000:1.0:1782757889.965112:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531392 00000100:00100000:1.0:1782757889.965173:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1782757889.965184:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757889.965411:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211531392:12345-0@lo:400:kworker.0 Request processed in 228us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757889.965419:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1782757889.965675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.965703:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211532032:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.965731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.965751:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757889.965757:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211531648:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.965778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757889.965808:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531776 00000100:00100000:2.0:1782757889.965812:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531776 00000100:00100000:2.0:1782757889.965874:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532032 00000100:00100000:2.0:1782757889.965878:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532032 00000100:00100000:2.0:1782757889.967697:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1782757889.967715:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.967799:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211531776:12345-0@lo:400:kworker.0 Request processed in 91us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.967807:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1782757889.967856:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1782757889.967865:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.967919:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211532032:12345-0@lo:400:kworker.0 Request processed in 56us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.967926:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1782757889.967948:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531904 00000100:00100000:2.0:1782757889.967954:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531904 00000100:00100000:2.0:1782757889.967988:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531520 00000100:00100000:2.0:1782757889.967991:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531520 00000100:00100000:2.0:1782757889.968010:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211531648 00000100:00100000:2.0:1782757889.968012:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211531648 00000100:00100000:2.0:1782757889.968032:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1782757889.968038:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211531904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.968072:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211531904:12345-0@lo:400:kworker.0 Request processed in 34us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.968078:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1782757889.968089:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1782757889.968095:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.968121:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211531520:12345-0@lo:400:kworker.0 Request processed in 26us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.968127:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1782757889.968137:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1782757889.968142:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211531648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.968185:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211531648:12345-0@lo:400:kworker.0 Request processed in 42us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757889.968191:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1782757889.969587:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211531648:0@lo:400:kworker.0 00000100:00100000:0.0:1782757889.969606:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211531520:0@lo:400:kworker.0 00000100:00100000:0.0:1782757889.969617:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211532032:0@lo:400:kworker.0 00000100:00080000:2.0:1782757889.970940:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757889.970948:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757889.970951:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757889.971001:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211531392:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.971018:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211531904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757889.971029:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211531776:0@lo:400:kworker.0 00000100:00100000:3.0:1782757890.321334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757890.321502:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196672128 00000100:00100000:2.0:1782757890.321513:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196672128 00000100:00100000:2.0:1782757890.321600:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 710 00000100:00100000:2.0:1782757890.321610:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45711:x1869355196672128:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782757890.321633:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757890.321658:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64853 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.321747:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.321763:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.321776:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757890.322052:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1782757890.322057:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757890.322137:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.322179:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64853 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.322197:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64853 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.322206:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:2.0:1782757890.322211:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757890.322214:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757890.322273:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45711:x1869355196672128:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 664us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757890.322280:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 710 00000100:00080000:3.0:1782757890.322873:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757890.330064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757890.330148:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196672384 00000100:00100000:1.0:1782757890.330172:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196672384 00000100:00100000:1.0:1782757890.330234:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 711 00000100:00100000:1.0:1782757890.330246:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45711:x1869355196672384:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782757890.330299:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782757890.330328:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9f78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64853 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.330351:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777d9f16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6483e expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.330363:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:1.0:1782757890.330375:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757890.330401:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.330415:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.330424:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757890.378598:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d5b01fc reply state 0000000047491905 transno 4294967570 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757890.378618:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757890.378775:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:1.0:1782757890.378923:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45711:x1869355196672384:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 48674us (48865us total) trans 4294967570 rc 0/0 00000100:00100000:1.0:1782757890.378933:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 711 00000001:00080000:0.0:1782757890.381936:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967570 is committed 00010000:00010000:1.0:1782757890.382319:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382333:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382341:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382346:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.382351:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382358:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382376:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757890.382379:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757890.382383:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.382388:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757890.465616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757890.465857:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196672512 00000100:00100000:1.0:1782757890.465868:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196672512 00000100:00100000:1.0:1782757890.466281:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:1.0:1782757890.466294:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45715:x1869355196672512:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782757890.466321:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757890.466340:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6485a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.466400:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.467028:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.467268:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.467289:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.467297:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.467307:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.468866:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.468881:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.468892:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757890.470339:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757890.470349:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757890.470600:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470620:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470627:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470635:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470642:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.470646:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470653:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470669:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782757890.470672:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.470676:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470682:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470696:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470702:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470707:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470712:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.470715:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470721:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470728:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757890.470730:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.470733:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470739:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777d9f94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470781:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777d9f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6485a expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470796:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6485a expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.470803:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757890.470805:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757890.470807:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782757890.470917:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45715:x1869355196672512:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 4625us (6784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757890.475113:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:2.0:1782757890.476186:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757890.476205:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757890.476293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757890.476438:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532160 00000100:00100000:1.0:1782757890.476447:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532160 00000100:00100000:1.0:1782757890.476512:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1782757890.476521:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211532160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757890.476561:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757890.476630:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211532160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757890.476638:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1782757890.476688:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757890.477312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757890.477636:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196672768 00000100:00100000:2.0:1782757890.477643:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196672768 00000100:00100000:2.0:1782757890.477696:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 713 00000100:00100000:2.0:1782757890.477705:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45715:x1869355196672768:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757890.477721:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757890.477742:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9fa2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64861 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478097:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478113:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478125:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478139:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478145:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.478156:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782757890.479132:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:2.0:1782757890.479431:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9fb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479447:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479457:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479494:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479501:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479509:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479515:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757890.479519:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479527:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.479540:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:2.0:1782757890.482373:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757890.482390:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.482402:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777d9fa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757890.482420:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8a4ebc0 reply state 00000000ce2aa5aa transno 4294967571 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757890.482429:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757890.486242:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777d9fa2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64861 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.486276:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64861 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.486287:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782757890.486290:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757890.486294:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:3.0:1782757890.486394:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45715:x1869355196672768:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 8688us (9083us total) trans 4294967571 rc 0/0 00000100:00100000:3.0:1782757890.486404:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 713 00010000:00010000:3.0:1782757890.494115:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494133:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494141:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494147:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757890.494152:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494169:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494185:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff917182dd1f00) 00010000:00010000:3.0:1782757890.494189:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757890.494193:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.494200:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777d9fb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757890.495265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757890.495297:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673024 00000100:00100000:1.0:1782757890.495306:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673024 00000100:00100000:1.0:1782757890.495359:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 714 00000100:00100000:1.0:1782757890.495369:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45715:x1869355196673024:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:1.0:1782757890.495442:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757890.495624:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777d9fb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64861 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.495641:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff917182dd1400) 00010000:00010000:1.0:1782757890.495651:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757890.495696:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.495709:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.495718:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757890.496021:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcc11b44 reply state 0000000059254955 transno 4294967572 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757890.496032:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782757890.496353:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45715:x1869355196673024:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 984us (1093us total) trans 4294967572 rc 0/0 00000100:00100000:1.0:1782757890.496361:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 714 00000100:00100000:2.0:1782757890.508488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782757890.508537:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508550:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508557:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508564:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.508569:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508578:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508594:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782757890.508597:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.508602:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.508608:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777d9fc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757890.511065:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673152 00000100:00100000:3.0:1782757890.511083:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673152 00000100:00100000:3.0:1782757890.511176:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 715 00000100:00100000:3.0:1782757890.511186:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45715:x1869355196673152:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782757890.511215:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757890.511241:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64868 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.511307:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64868 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.511322:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64868 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.511343:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782757890.511346:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782757890.511349:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782757890.511421:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45715:x1869355196673152:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 236us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757890.511428:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 715 00000100:00100000:3.0:1782757890.523938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757890.523974:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673280 00000100:00100000:3.0:1782757890.523984:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673280 00000100:00100000:3.0:1782757890.524053:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 391 00000100:00100000:3.0:1782757890.524069:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196673280:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:3.0:1782757890.528199:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196673280:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 4121us (4260us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1782757890.528216:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 391 00000100:00080000:1.0:1782757890.533976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757890.569013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757890.569088:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673536 00000100:00100000:3.0:1782757890.569100:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673536 00000100:00100000:3.0:1782757890.569167:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:3.0:1782757890.569178:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45715:x1869355196673536:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:3.0:1782757890.569542:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45715:x1869355196673536:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 365us (540us total) trans 4294967573 rc 0/0 00000100:00100000:3.0:1782757890.569551:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 75 00010000:00010000:2.0:1782757890.610916:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757890.643885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757890.644068:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673664 00000100:00100000:1.0:1782757890.644078:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673664 00000100:00100000:1.0:1782757890.644143:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 716 00000100:00100000:1.0:1782757890.644162:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45719:x1869355196673664:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782757890.644186:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757890.644206:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6486f expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644270:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644284:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644299:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644311:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644317:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644323:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644417:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644424:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644431:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757890.644468:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 0 00000004:00200000:1.0:1782757890.644473:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757890.644494:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644506:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644514:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644526:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644546:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644553:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.644558:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644565:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644577:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757890.644580:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.644585:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644590:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777d9fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644603:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644608:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644614:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644619:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.644622:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644627:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644633:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782757890.644635:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.644637:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644642:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644674:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6486f expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644686:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6486f expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.644693:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff917191f75700) 00010000:00010000:1.0:1782757890.644695:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782757890.644698:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782757890.644780:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45719:x1869355196673664:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 619us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757890.644787:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 716 00000100:00100000:1.0:1782757890.649088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757890.649691:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196673792 00000100:00100000:2.0:1782757890.649702:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196673792 00000100:00100000:2.0:1782757890.649956:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 392 00000100:00100000:2.0:1782757890.649969:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196673792:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:2.0:1782757890.650102:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757890.650124:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64876 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782757890.650163:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x6a42ba01, atime: 0x6a42ba01, ctime: 0x6a42ba01, blocks: 0x1 00010000:00010000:2.0:1782757890.650184:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1959s v=(0 0) 00010000:00010000:2.0:1782757890.650189:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757890.650199:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.650220:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.650240:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782757890.650308:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196673792:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 342us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757890.650316:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 392 00000100:00100000:0.0:1782757890.662621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757890.662750:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674048 00000100:00100000:1.0:1782757890.662761:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674048 00000100:00100000:1.0:1782757890.662871:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 717 00000100:00100000:1.0:1782757890.662885:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45719:x1869355196674048:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:1.0:1782757890.662941:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782757890.662971:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777d9fe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6486f expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.662996:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777d9fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64868 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663006:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff917191f75700) 00010000:00010000:1.0:1782757890.663018:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757890.663045:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663061:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663072:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663088:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663095:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663102:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663238:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663251:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.663259:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782757890.664368:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:1.0:1782757890.664381:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1959067557429ns, next at 1960067554426ns, rc = 0 00010000:00010000:1.0:1782757890.664569:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664582:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664592:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664601:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664608:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664613:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664639:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782757890.664664:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664670:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664677:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664683:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.664687:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664696:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664708:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757890.664711:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757890.664761:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757890.664770:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.664776:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757890.664780:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.664787:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.664795:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:2.0:1782757890.664798:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782757890.664801:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.664814:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da00b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757890.664861:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757890.664863:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757890.664865:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757890.664905:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664914:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da004 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664936:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664943:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664948:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664953:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757890.664956:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664965:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664973:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757890.664976:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757890.664979:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757890.664985:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777d9ff6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757890.664995:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0651196 reply state 000000000670501c transno 4294967574 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757890.665006:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782757890.665207:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45719:x1869355196674048:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 2321us (2593us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1782757890.665217:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 717 00010000:00010000:3.0:1782757890.691444:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691476:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691484:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691492:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757890.691497:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691504:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691523:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782757890.691527:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757890.691532:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757890.691539:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777d9ffd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757891.632788:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757892.091773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757892.091838:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674176 00000100:00100000:0.0:1782757892.091848:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674176 00000100:00100000:0.0:1782757892.091904:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 718 00000100:00100000:0.0:1782757892.091915:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45733:x1869355196674176:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782757892.091938:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757892.091958:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6487d expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092016:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092031:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092044:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757892.092100:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:0.0:1782757892.092104:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757892.092128:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092151:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6487d expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092167:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6487d expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.092177:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:0.0:1782757892.092181:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757892.092185:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525400, rc 0) 00000100:00100000:0.0:1782757892.092238:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45733:x1869355196674176:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 326us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757892.092245:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 718 00000100:00080000:0.0:1782757892.092398:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757892.098741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757892.099363:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674432 00000100:00100000:0.0:1782757892.099373:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674432 00000100:00100000:0.0:1782757892.100552:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 719 00000100:00100000:0.0:1782757892.100566:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:45733:x1869355196674432:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757892.100621:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757892.100659:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da019 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6487d expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.100682:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777d9f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6485a expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.100694:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:0.0:1782757892.100704:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757892.100730:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.100742:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.100752:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782757892.114731:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000004:00010000:0.0:1782757892.178544:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a762187a reply state 0000000088955073 transno 4294967575 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757892.178564:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757892.178726:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000001:00080000:3.0:1782757892.179903:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967575 is committed 00000004:00080000:3.0:1782757892.179922:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00010000:00080000:0.0:1782757892.180284:0:5801:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782757892.180307:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45733:x1869355196674432:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 79740us (81569us total) trans 4294967575 rc 0/0 00000100:00100000:0.0:1782757892.180317:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 719 00010000:00010000:0.0:1782757892.180459:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180469:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180478:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180484:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757892.180489:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180497:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180514:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782757892.180517:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757892.180521:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180532:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da020 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757892.180556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782757892.180570:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211532288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782757892.180628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757892.180686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532288 00000100:00100000:0.0:1782757892.180693:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532288 00000100:00100000:0.0:1782757892.180741:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1782757892.180751:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211532288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757892.180776:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:0.0:1782757892.180796:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180845:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180855:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782757892.180858:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757892.180863:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180888:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.180903:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 5 pid: 6598 timeout: 2060 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757892.180914:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211532416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757892.180969:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067a80 going to sleep for 11 seconds 00000100:00080000:0.0:1782757892.180982:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757892.185780:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211532416:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782757892.185867:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757892.189922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757892.190299:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674560 00000100:00100000:3.0:1782757892.190309:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674560 00010000:00010000:3.0:1782757892.190367:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 6 pid: 6598 timeout: 2060 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757892.190396:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 361 00000100:00100000:3.0:1782757892.190405:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196674560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782757892.190418:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757892.190424:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 6 pid: 6598 timeout: 2060 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190436:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 6 pid: 6598 timeout: 2060 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190457:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777d9fef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64876 expref: 6 pid: 6598 timeout: 2060 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190470:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757892.190474:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757892.190480:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190490:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190515:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757892.190564:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196674560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 159us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757892.190571:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 361 00010000:00010000:3.0:1782757892.190594:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190603:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190613:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190621:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757892.190651:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1782757892.191862:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782757892.191980:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757892.191990:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757892.192002:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757892.192006:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757892.192016:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757892.192032:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757892.192041:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000764850f2/0xdd99f5c4777da027 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757892.192066:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757892.192068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757892.192070:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757892.199494:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211532288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18736us (18855us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1782757892.199509:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000004:00080000:2.0:1782757892.199719:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917083551c00/2, rc 0, transno 4294967341 00000100:00100000:2.0:1782757892.199727:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211532288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782757892.274159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757892.274233:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674688 00000100:00100000:0.0:1782757892.274243:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674688 00000100:00100000:0.0:1782757892.274324:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 720 00000100:00100000:0.0:1782757892.274343:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45738:x1869355196674688:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782757892.274370:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757892.274393:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64884 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274478:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274492:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274502:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274635:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274644:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757892.274652:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277142:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277159:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277170:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757892.277262:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757892.277267:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757892.277720:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277735:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277740:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277747:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277753:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757892.277757:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277764:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277778:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782757892.277782:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757892.277786:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277791:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277814:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277858:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277865:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277870:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757892.277873:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277879:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277887:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff91718bcfd800) 00010000:00010000:1.0:1782757892.277889:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757892.277893:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277899:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da03c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277937:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64884 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277952:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64884 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757892.277959:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757892.277961:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782757892.277965:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782757892.278032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45738:x1869355196674688:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 3698us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757892.278041:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 720 00010000:00010000:0.0:1782757892.653333:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757893.036076:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757893.036099:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211532544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757893.036187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757893.036308:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532544 00000100:00100000:0.0:1782757893.036324:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532544 00000100:00100000:0.0:1782757893.036384:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1782757893.036395:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211532544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757893.036430:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757893.036476:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211532544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757893.036482:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1782757893.036526:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211532544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757893.037031:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757893.679662:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757894.095585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757894.096001:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196674816 00000100:00100000:1.0:1782757894.096013:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196674816 00000100:00100000:1.0:1782757894.096090:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 721 00000100:00100000:1.0:1782757894.096102:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45752:x1869355196674816:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757894.096123:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757894.096144:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da04a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6488b expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096213:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096227:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096240:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757894.096480:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757894.096485:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757894.096566:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096600:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da04a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6488b expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096616:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6488b expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757894.096626:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782757894.096629:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757894.096633:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782757894.096693:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45752:x1869355196674816:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 592us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757894.096700:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 721 00000100:00080000:2.0:1782757894.096777:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757894.109423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757894.111298:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675072 00000100:00100000:3.0:1782757894.111313:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675072 00000100:00100000:3.0:1782757894.111389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 722 00000100:00100000:3.0:1782757894.111400:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45752:x1869355196675072:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757894.111450:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757894.111477:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6488b expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.111504:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64884 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.111513:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:3.0:1782757894.111524:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757894.111550:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.111562:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.111571:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757894.112043:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071f0b06e reply state 0000000043963671 transno 4294967576 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757894.112053:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757894.112140:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:3.0:1782757894.112232:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45752:x1869355196675072:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 834us (2817us total) trans 4294967576 rc 0/0 00000100:00100000:3.0:1782757894.112240:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 722 00010000:00010000:0.0:1782757894.116841:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116870:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116879:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116887:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757894.116891:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116899:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116918:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75d00) 00010000:00010000:0.0:1782757894.116921:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757894.116926:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.116932:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da058 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757894.346706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757894.346747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757894.346785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757894.346814:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675328 00000100:00100000:2.0:1782757894.346841:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675328 00000100:00100000:2.0:1782757894.346908:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675456 00000100:00100000:2.0:1782757894.346911:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675456 00000100:00100000:2.0:1782757894.346935:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00100000:2.0:1782757894.346945:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196675328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757894.347022:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196675328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757894.347029:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00100000:2.0:1782757894.347047:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00100000:2.0:1782757894.347053:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196675456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757894.347078:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196675456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757894.347084:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00080000:2.0:1782757894.347101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757894.347105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757894.347161:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675200 00000100:00100000:3.0:1782757894.347166:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675200 00000100:00100000:3.0:1782757894.347194:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1127 00000100:00100000:3.0:1782757894.347201:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196675200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757894.347242:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196675200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757894.347251:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1127 00000100:00100000:2.0:1782757894.578391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757894.578539:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675584 00000100:00100000:1.0:1782757894.578551:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675584 00000100:00100000:1.0:1782757894.578622:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:1.0:1782757894.578634:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196675584:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757894.578751:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196675584:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 118us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757894.578768:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:2.0:1782757894.593638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.593754:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675712 00000100:00100000:0.0:1782757894.593776:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675712 00000100:00100000:0.0:1782757894.593877:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 394 00000100:00100000:0.0:1782757894.593889:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196675712:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757894.594460:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196675712:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 571us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.594469:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 394 00000100:00100000:2.0:1782757894.596455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.596646:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675840 00000100:00100000:0.0:1782757894.596657:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675840 00000100:00100000:0.0:1782757894.596718:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 395 00000100:00100000:0.0:1782757894.596728:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196675840:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757894.597152:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196675840:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 424us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.597160:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 395 00000100:00100000:1.0:1782757894.599927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757894.600114:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196675968 00000100:00100000:3.0:1782757894.600124:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196675968 00000100:00100000:3.0:1782757894.600179:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:3.0:1782757894.600190:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196675968:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757894.604464:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196675968:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 4259us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757894.604483:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:3.0:1782757894.626346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.626548:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676096 00000100:00100000:0.0:1782757894.626559:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676096 00000100:00100000:0.0:1782757894.626623:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 725 00000100:00100000:0.0:1782757894.626635:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196676096:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757894.626770:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196676096:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 137us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.626779:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 725 00000100:00100000:2.0:1782757894.636551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757894.636653:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676224 00000100:00100000:1.0:1782757894.636663:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676224 00000100:00100000:1.0:1782757894.636716:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 396 00000100:00100000:1.0:1782757894.636727:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196676224:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757894.637199:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196676224:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 472us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757894.637207:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 396 00000100:00100000:2.0:1782757894.639946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.640091:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676352 00000100:00100000:0.0:1782757894.640100:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676352 00000100:00100000:0.0:1782757894.640154:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 397 00000100:00100000:0.0:1782757894.640165:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196676352:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757894.640859:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45765:x1869355196676352:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 694us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.640868:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 397 00000100:00100000:2.0:1782757894.666467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.666630:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676480 00000100:00100000:0.0:1782757894.666642:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676480 00000100:00100000:0.0:1782757894.666713:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 726 00000100:00100000:0.0:1782757894.666725:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196676480:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757894.667456:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45765:x1869355196676480:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 610us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.667466:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 726 00010000:00010000:2.0:1782757894.701233:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757894.813021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757894.813108:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676608 00000100:00100000:3.0:1782757894.813118:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676608 00000100:00100000:3.0:1782757894.813176:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:3.0:1782757894.813184:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:45769:x1869355196676608:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782757894.813206:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757894.813228:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da05f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64892 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813313:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813542:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813555:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813571:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813578:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.813584:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814304:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814315:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814395:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757894.814485:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1782757894.814489:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757894.814567:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814581:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814588:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814595:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814601:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757894.814606:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814614:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814627:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782757894.814630:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757894.814635:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814642:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814655:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814661:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814668:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814673:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757894.814676:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814682:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814688:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75100) 00010000:00010000:3.0:1782757894.814690:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757894.814693:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814703:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da06d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814745:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da05f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64892 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814767:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64892 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.814774:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782757894.814777:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757894.814779:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782757894.816351:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45769:x1869355196676608:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 3157us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757894.816362:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:1.0:1782757894.829570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.830917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676864 00000100:00100000:0.0:1782757894.830928:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676864 00000100:00100000:0.0:1782757894.830999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 728 00000100:00100000:0.0:1782757894.831011:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45769:x1869355196676864:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782757894.831033:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757894.831055:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da07b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64899 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831515:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831531:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831548:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831564:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831571:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.831578:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782757894.838506:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:0.0:1782757894.842454:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842475:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842487:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842543:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842550:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842557:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842563:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181524c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757894.842568:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842576:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842587:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75600) 00010000:00010000:0.0:1782757894.842590:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757894.842594:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842600:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da082 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757894.842622:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000904271f2 reply state 0000000003aa1207 transno 4294967577 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757894.842631:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757894.842671:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da07b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64899 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842686:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64899 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757894.842692:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782757894.842694:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757894.842696:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525600, rc 0) 00000100:00100000:0.0:1782757894.842791:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:45769:x1869355196676864:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 11782us (13229us total) trans 4294967577 rc 0/0 00000100:00100000:0.0:1782757894.842800:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 728 00010000:00010000:3.0:1782757894.850700:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850718:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850724:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850730:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757894.850735:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850742:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850770:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff91718bcfd700) 00010000:00010000:3.0:1782757894.850774:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757894.850778:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.850785:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da089 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757894.851126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757894.851647:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196676992 00000100:00100000:3.0:1782757894.851656:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196676992 00000100:00100000:3.0:1782757894.851714:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 398 00000100:00100000:3.0:1782757894.851724:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45769:x1869355196676992:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782757894.851743:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757894.851769:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648a0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782757894.851794:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782757894.851817:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=1963s v=(0 0) 00010000:00010000:3.0:1782757894.851857:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757894.851868:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.851886:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757894.851899:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782757894.851950:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45769:x1869355196676992:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 227us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757894.851957:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 398 00000100:00100000:0.0:1782757894.922266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757894.922468:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677120 00000100:00100000:2.0:1782757894.922478:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677120 00002000:00100000:2.0:1782757894.922532:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff917083550000 x1869355196677120/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1782757905 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782757894.922543:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917083550000 with x1869355196677120 ext(0->1048575) 00002000:00010000:2.0:1782757894.922550:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917083550000 00000100:00100000:2.0:1782757894.922586:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1782757894.922596:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196677120:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:2.0:1782757894.958018:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196677120:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 35411us (35748us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1782757894.958032:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00002000:00100000:2.0:1782757894.958045:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff917083550000 x1869355196677120/t4294967342(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:565/0 lens 488/448 e 0 to 0 dl 1782757905 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782757894.958057:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917083550000 with x1869355196677120 ext(0->1048575) 00002000:00010000:2.0:1782757894.958064:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917083550000 00000100:00100000:1.0:1782757894.967294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757894.967464:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677248 00000100:00100000:3.0:1782757894.967474:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677248 00000100:00100000:0.0:1782757894.967929:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 729 00000100:00100000:0.0:1782757894.967949:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45769:x1869355196677248:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:3.0:1782757894.995661:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967577 is committed 00000100:00100000:0.0:1782757894.995952:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45769:x1869355196677248:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 28006us (28663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757894.995965:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 729 00000100:00100000:1.0:1782757894.998452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757894.998551:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677376 00000100:00100000:0.0:1782757894.998560:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677376 00000100:00100000:0.0:1782757894.998618:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 399 00000100:00100000:0.0:1782757894.998629:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196677376:12345-192.168.204.31@tcp:16:dd.60003 00000001:00080000:1.0:1782757895.076304:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000100:00100000:2.0:1782757895.076600:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196677376:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 77957us (78141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.076613:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 399 00000100:00100000:2.0:1782757895.086916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757895.087012:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677632 00000100:00100000:0.0:1782757895.087024:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677632 00000100:00100000:0.0:1782757895.087117:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:0.0:1782757895.087128:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45769:x1869355196677632:12345-192.168.204.31@tcp:35:dd.60003 00000001:00080000:0.0:1782757895.087585:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967578 00000100:00100000:0.0:1782757895.087726:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:45769:x1869355196677632:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 598us (819us total) trans 4294967579 rc 0/0 00000100:00100000:0.0:1782757895.087736:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 76 00000020:00080000:0.0:1782757895.087742:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782757895.088869:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211532672:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.088926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.088985:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211533184:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.089040:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782757895.089047:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211532800:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.089100:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211533312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.089153:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211533056:0@lo:400:kworker.0 00000100:00100000:1.0:1782757895.089178:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532672 00000100:00100000:1.0:1782757895.089187:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532672 00000100:00100000:1.0:1782757895.089228:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1782757895.089237:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211532672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757895.089298:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211532672:12345-0@lo:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757895.089305:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1782757895.089310:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211532928:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.089436:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533184 00000100:00100000:2.0:1782757895.089439:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533184 00000100:00100000:2.0:1782757895.089474:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532800 00000100:00100000:2.0:1782757895.089476:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532800 00000100:00100000:2.0:1782757895.089489:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211532928 00000100:00100000:2.0:1782757895.089491:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211532928 00000100:00100000:2.0:1782757895.089504:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1782757895.089509:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211533184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089541:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211533184:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089548:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1782757895.089560:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1782757895.089565:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211532800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089587:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211532800:12345-0@lo:400:kworker.0 Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089591:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1782757895.089601:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1782757895.089606:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211532928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089633:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211532928:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089642:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1782757895.089658:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533312 00000100:00100000:2.0:1782757895.089661:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533312 00000100:00100000:2.0:1782757895.089686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533056 00000100:00100000:2.0:1782757895.089688:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533056 00000100:00100000:2.0:1782757895.089705:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1782757895.089710:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089762:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211533312:12345-0@lo:400:kworker.0 Request processed in 52us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089769:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1782757895.089778:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1782757895.089784:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211533056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089807:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211533056:12345-0@lo:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.089812:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:2.0:1782757895.089871:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757895.089875:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757895.089878:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757895.089914:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211532928:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089924:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211533056:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089956:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211532800:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089967:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211533312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089974:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211532672:0@lo:400:kworker.0 00000100:00100000:2.0:1782757895.089983:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211533184:0@lo:400:kworker.0 00000100:00100000:0.0:1782757895.596346:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211533440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757895.596425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757895.601732:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533440 00000100:00100000:2.0:1782757895.601756:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533440 00000100:00100000:2.0:1782757895.601883:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1782757895.601896:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211533440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757895.601942:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757895.602294:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211533440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 399us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757895.602302:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1782757895.607924:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211533440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757895.726078:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757896.748165:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782757896.895507:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967579 is committed 00000001:00080000:1.0:1782757897.230339:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00010000:00010000:2.0:1782757897.772939:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757898.159614:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211533568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757898.159712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757898.160053:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533568 00000100:00100000:1.0:1782757898.160061:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533568 00000100:00100000:1.0:1782757898.160132:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1782757898.160143:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211533568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757898.160178:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782757898.160241:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211533568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757898.160249:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1782757898.160707:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211533568:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782757898.160814:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1782757898.320958:0:78679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1966724131466ns, next at 1941109567657ns, rc = 0 00000004:00080000:0.0:1782757898.321155:0:78679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1966724331673ns, next at 1960067554426ns, rc = 0 00000004:00080000:3.0:1782757898.326302:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00000004:00080000:3.0:1782757898.326331:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00010000:00010000:3.0:1782757898.798732:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757899.448981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757899.449049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757899.449088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757899.449136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757899.449185:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678016 00000100:00100000:1.0:1782757899.449200:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678016 00000100:00100000:1.0:1782757899.449281:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678144 00000100:00100000:1.0:1782757899.449285:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678144 00000100:00100000:1.0:1782757899.449321:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00100000:1.0:1782757899.449335:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196678016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757899.449444:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196678016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 112us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757899.449452:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00100000:1.0:1782757899.449493:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:1.0:1782757899.449500:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196678144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757899.449532:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196678144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757899.449538:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00080000:1.0:1782757899.449558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757899.449564:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757899.450094:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677760 00000100:00100000:3.0:1782757899.450102:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677760 00000100:00100000:3.0:1782757899.450154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1129 00000100:00100000:3.0:1782757899.450162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196677760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757899.450204:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196677760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757899.450212:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1129 00000100:00100000:0.0:1782757899.450492:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196677888 00000100:00100000:0.0:1782757899.450497:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196677888 00000100:00100000:0.0:1782757899.450555:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1376 00000100:00100000:0.0:1782757899.450569:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196677888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757899.450619:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196677888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757899.450626:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1376 00000100:00080000:2.0:1782757899.450740:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757899.821200:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757900.209576:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211533696:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.209690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.209753:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211534208:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.209783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.209816:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782757900.209844:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211533824:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.209868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.209885:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211534336:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.209909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.209939:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211533952:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.209962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.209980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757900.209985:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211534080:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.210006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757900.210041:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533696 00000100:00100000:2.0:1782757900.210050:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533696 00000100:00100000:2.0:1782757900.215129:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534208 00000100:00100000:2.0:1782757900.215153:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534208 00000100:00100000:2.0:1782757900.215226:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533824 00000100:00100000:2.0:1782757900.215230:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533824 00000100:00100000:2.0:1782757900.215253:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211533952 00000100:00100000:2.0:1782757900.215257:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211533952 00000100:00100000:2.0:1782757900.215282:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:2.0:1782757900.215295:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215431:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211534208:12345-0@lo:400:kworker.0 Request processed in 139us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215440:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:2.0:1782757900.215459:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1782757900.215465:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211533824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215497:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211533824:12345-0@lo:400:kworker.0 Request processed in 32us (5628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215503:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1782757900.215515:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1782757900.215521:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215556:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211533952:12345-0@lo:400:kworker.0 Request processed in 35us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215562:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1782757900.215588:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534336 00000100:00100000:2.0:1782757900.215593:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534336 00000100:00100000:2.0:1782757900.215625:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534080 00000100:00100000:2.0:1782757900.215629:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534080 00000100:00100000:2.0:1782757900.215664:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1782757900.215671:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211534336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215708:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211534336:12345-0@lo:400:kworker.0 Request processed in 37us (5797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215715:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1782757900.215726:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1782757900.215732:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211534080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215766:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211534080:12345-0@lo:400:kworker.0 Request processed in 35us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215772:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1782757900.215805:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1782757900.215814:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211533696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.215877:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211533696:12345-0@lo:400:kworker.0 Request processed in 65us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.215883:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:2.0:1782757900.215919:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757900.215924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757900.215927:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757900.215988:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211534080:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.216004:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211533952:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.216053:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211533824:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.216066:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:2.0:1782757900.216072:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917083551c00, transno 4294967341 00000100:00100000:2.0:1782757900.216085:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211534336:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.216096:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211533696:0@lo:400:kworker.0 00000100:00100000:2.0:1782757900.216109:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211534208:0@lo:400:kworker.0 00000100:00100000:1.0:1782757900.494552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757900.496147:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678272 00000100:00100000:3.0:1782757900.496167:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678272 00000100:00100000:3.0:1782757900.496259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 730 00000100:00100000:3.0:1782757900.496274:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678272:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757900.496434:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678272:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 163us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757900.496445:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 730 00000100:00100000:1.0:1782757900.520376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757900.520450:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678400 00000100:00100000:1.0:1782757900.520464:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678400 00000100:00100000:1.0:1782757900.520547:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 400 00000100:00100000:1.0:1782757900.520572:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45962:x1869355196678400:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757900.521301:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45962:x1869355196678400:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 740us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757900.521313:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 400 00000100:00100000:1.0:1782757900.526008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757900.526055:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678528 00000100:00100000:1.0:1782757900.526070:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678528 00000100:00100000:1.0:1782757900.526136:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 401 00000100:00100000:1.0:1782757900.526148:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45962:x1869355196678528:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757900.526683:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45962:x1869355196678528:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 534us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757900.526693:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 401 00000100:00100000:3.0:1782757900.533131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757900.533190:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678656 00000100:00100000:3.0:1782757900.533202:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678656 00000100:00100000:3.0:1782757900.533607:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:3.0:1782757900.533623:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678656:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757900.541704:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678656:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 8065us (8719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757900.541725:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:3.0:1782757900.561686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757900.561837:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678784 00000100:00100000:2.0:1782757900.561852:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678784 00000100:00100000:2.0:1782757900.561931:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:2.0:1782757900.561943:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678784:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757900.562097:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196678784:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 156us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757900.562105:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:3.0:1782757900.565523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757900.565615:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196678912 00000100:00100000:3.0:1782757900.565685:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196678912 00000100:00100000:3.0:1782757900.565742:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 402 00000100:00100000:3.0:1782757900.565752:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45962:x1869355196678912:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757900.566201:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:45962:x1869355196678912:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 449us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757900.566210:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 402 00000100:00100000:3.0:1782757900.574650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757900.574941:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679040 00000100:00100000:0.0:1782757900.574952:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679040 00000100:00100000:0.0:1782757900.575015:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 403 00000100:00100000:0.0:1782757900.575025:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45962:x1869355196679040:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757900.575415:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:45962:x1869355196679040:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 391us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757900.575424:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 403 00000100:00100000:3.0:1782757900.585288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757900.585376:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679168 00000100:00100000:0.0:1782757900.585385:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679168 00000100:00100000:0.0:1782757900.585451:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:0.0:1782757900.585474:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196679168:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757900.588581:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45962:x1869355196679168:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 3099us (3292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757900.588597:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:0.0:1782757900.713004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757900.713270:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679424 00000100:00100000:3.0:1782757900.713284:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679424 00000100:00100000:3.0:1782757900.713362:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 734 00000100:00100000:3.0:1782757900.713373:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:45966:x1869355196679424:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782757900.713453:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757900.713492:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64899 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713517:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:3.0:1782757900.713530:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757900.713558:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713574:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713600:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713616:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713624:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.713631:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.715017:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.715037:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.715050:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757900.726434:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211534464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757900.726544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757900.726729:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534464 00000100:00100000:1.0:1782757900.726740:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534464 00000100:00100000:1.0:1782757900.726808:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1782757900.726849:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211534464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757900.726898:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000040:00080000:3.0:1782757900.729755:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:3.0:1782757900.729780:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1969132957164ns, next at 1970132952811ns, rc = 0 00010000:00010000:3.0:1782757900.731225:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.731255:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.731269:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.731280:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.731288:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.731294:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732018:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782757900.732061:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732070:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732076:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732083:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757900.732088:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732101:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732119:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782757900.732122:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757900.732128:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732134:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da0b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732160:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732165:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732170:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732175:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757900.732178:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732183:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732191:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782757900.732193:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757900.732196:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732207:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da0a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757900.732218:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064e5d8d3 reply state 0000000024adf2ee transno 4294967580 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757900.732229:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782757900.732365:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:45966:x1869355196679424:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 18986us (19367us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1782757900.732377:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 734 00000100:00100000:1.0:1782757900.732409:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211534464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5558us (5861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757900.732422:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1782757900.732555:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211534464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757900.732606:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757900.732614:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732621:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757900.732625:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732631:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732650:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782757900.732652:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782757900.732655:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732660:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da0ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.732678:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757900.732680:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757900.732682:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757900.735309:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735334:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735342:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735349:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757900.735357:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735366:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735388:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff917191f75300) 00010000:00010000:1.0:1782757900.735392:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757900.735397:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757900.735406:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da0ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757900.854855:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757901.873536:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757902.899751:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757903.276412:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211534592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757903.276489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757903.276600:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534592 00000100:00100000:0.0:1782757903.276609:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534592 00000100:00100000:0.0:1782757903.276690:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1782757903.276703:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211534592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757903.276739:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000004:00080000:1.0:1782757903.276819:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1971679995635ns, next at 1972679993690ns, rc = 0 00000100:00080000:3.0:1782757903.277257:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757903.282889:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211534592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6182us (6392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757903.282919:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1782757903.292184:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211534592:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782757903.891602:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00000001:00080000:3.0:1782757903.891646:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967580 is committed 00000004:00080000:3.0:1782757903.891654:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00000100:00100000:2.0:1782757903.892784:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211534720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782757903.894727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757903.895239:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534720 00000100:00100000:1.0:1782757903.895249:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534720 00000100:00100000:1.0:1782757903.895320:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1782757903.895331:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211534720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782757903.895384:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:23 count 1 00010000:00010000:1.0:1782757903.895421:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757903.895450:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757903.895460:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1782757903.895465:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782757903.895471:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757903.895524:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757903.895543:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 5 pid: 6597 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757903.895564:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211534848:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782757903.896135:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782757903.914057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757903.914167:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211534848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782757903.914196:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757903.914224:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679552 00000100:00100000:0.0:1782757903.914242:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679552 00010000:00010000:0.0:1782757903.914331:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782757903.914345:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757903.914388:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 362 00000100:00100000:0.0:1782757903.914415:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196679552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782757903.914436:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757903.914442:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757903.914458:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757903.914489:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef5893f/0xdd99f5c4777da09e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a0 expref: 6 pid: 6597 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757903.914507:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757903.914513:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757903.914520:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757903.914531:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757903.914566:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757903.914655:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196679552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 242us (608us total) trans 0 rc 0/0 00010000:00010000:2.0:1782757903.914715:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.914728:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.914745:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.914753:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.914778:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782757903.915819:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211534720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20486us (21094us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1782757903.915853:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:2.0:1782757903.915905:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757903.915912:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.915924:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757903.915928:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.915939:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.918220:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.918240:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490c61f2/0xdd99f5c4777da0c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757903.918287:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757903.918290:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757903.918293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782757903.918358:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91719fe5e300/2, rc 0, transno 4294967343 00000100:00100000:2.0:1782757903.918369:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211534720:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782757903.919297:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 362 00010000:00010000:1.0:1782757903.924101:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782757904.081029:0:78826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1972484142758ns, next at 1972679993690ns, rc = 0 00000004:00080000:2.0:1782757904.081415:0:78826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1972484591675ns, next at 1960067554426ns, rc = 0 00000004:00080000:3.0:1782757904.086638:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00000004:00080000:3.0:1782757904.086846:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000100:00100000:1.0:1782757904.564431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757904.564485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757904.564525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757904.564574:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679936 00000100:00100000:1.0:1782757904.564588:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679936 00000100:00100000:1.0:1782757904.564671:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1031 00000100:00100000:1.0:1782757904.564694:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196679936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757904.564791:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196679936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757904.564800:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1031 00000100:00080000:1.0:1782757904.564850:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757904.565098:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679680 00000100:00100000:2.0:1782757904.565103:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679680 00000100:00100000:2.0:1782757904.565211:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1131 00000100:00100000:2.0:1782757904.565220:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196679680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757904.565262:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196679680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757904.565269:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1131 00000100:00100000:3.0:1782757904.565529:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196679808 00000100:00100000:3.0:1782757904.565535:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196679808 00000100:00100000:3.0:1782757904.565643:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1380 00000100:00100000:3.0:1782757904.565652:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196679808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757904.565696:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196679808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757904.565703:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1380 00000100:00080000:2.0:1782757904.565865:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782757904.942590:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757905.325653:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211534976:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.325740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757905.325796:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211535488:0@lo:400:kworker.0 00000100:00100000:2.0:1782757905.326121:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211535232:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.326298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757905.326306:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211535104:0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.326341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757905.326344:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211535360:0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.326366:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211535616:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.326378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757905.326513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757905.326565:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535360 00000100:00100000:2.0:1782757905.326574:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535360 00000100:00100000:2.0:1782757905.326631:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535616 00000100:00100000:2.0:1782757905.326634:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535616 00000100:00100000:1.0:1782757905.326648:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535488 00000100:00100000:1.0:1782757905.326652:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535488 00000100:00100000:2.0:1782757905.326660:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1782757905.326668:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211535360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.326680:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535104 00000100:00100000:1.0:1782757905.326682:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535104 00000100:00100000:1.0:1782757905.326701:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1782757905.326706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757905.326732:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211535360:12345-0@lo:400:kworker.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757905.326736:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211535488:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757905.326740:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1782757905.326742:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1782757905.326757:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1782757905.326758:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1782757905.326762:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211535104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757905.326763:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.326792:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211535104:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757905.326798:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:0.0:1782757905.327062:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211535360:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.327099:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211534976 00000100:00100000:0.0:1782757905.327103:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211534976 00000100:00100000:0.0:1782757905.327135:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1782757905.327142:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211534976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.327174:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211534976:12345-0@lo:400:kworker.0 Request processed in 33us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757905.327180:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1782757905.327789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757905.327992:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211535616:12345-0@lo:400:kworker.0 Request processed in 1229us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757905.328001:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00080000:2.0:1782757905.328024:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757905.328030:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757905.328033:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757905.328358:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535232 00000100:00100000:0.0:1782757905.328365:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535232 00000100:00100000:0.0:1782757905.328456:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1782757905.328464:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211535232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.328521:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211535232:12345-0@lo:400:kworker.0 Request processed in 58us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757905.328527:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1782757905.328577:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211535232:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.328613:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211535488:0@lo:400:kworker.0 00000100:00100000:0.0:1782757905.328632:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211534976:0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.329765:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211535104:0@lo:400:kworker.0 00000100:00100000:1.0:1782757905.329789:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211535616:0@lo:400:kworker.0 00000100:00080000:2.0:1782757905.331976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1782757905.380395:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000100:00100000:1.0:1782757905.836156:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757905.836181:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211535744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757905.836268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757905.836396:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535744 00000100:00100000:2.0:1782757905.836404:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535744 00000100:00100000:2.0:1782757905.836449:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1782757905.836459:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211535744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757905.836494:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757905.836558:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211535744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757905.836565:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1782757905.836859:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211535744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757905.964272:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757906.988044:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757908.018788:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757908.396297:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211535872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757908.396378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757908.396798:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211535872 00000100:00100000:1.0:1782757908.396807:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211535872 00000100:00100000:1.0:1782757908.396912:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1782757908.396923:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211535872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757908.396963:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757908.397025:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211535872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757908.397033:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00080000:2.0:1782757908.397107:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757908.397210:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1782757908.397216:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91719fe5e300, transno 4294967343 00000100:00100000:0.0:1782757908.397242:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211535872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757909.036245:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757909.687986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757909.688034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757909.688072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757909.688108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757909.688151:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680448 00000100:00100000:0.0:1782757909.688154:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680064 00000100:00100000:1.0:1782757909.688161:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680448 00000100:00100000:0.0:1782757909.688168:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680064 00000100:00100000:1.0:1782757909.688236:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680320 00000100:00100000:1.0:1782757909.688242:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680320 00000100:00100000:0.0:1782757909.688271:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1133 00000100:00100000:0.0:1782757909.688289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196680064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757909.688300:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00100000:1.0:1782757909.688317:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196680448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757909.688427:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1035 00000100:00100000:2.0:1782757909.688441:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196680320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757909.688573:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680192 00000100:00100000:3.0:1782757909.688579:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680192 00000100:00100000:3.0:1782757909.688627:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1384 00000100:00100000:3.0:1782757909.688634:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196680192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757909.688770:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196680064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 487us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757909.688780:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1133 00000100:00080000:0.0:1782757909.688875:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757909.688881:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757909.688883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757909.689255:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196680448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 936us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757909.689267:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00100000:2.0:1782757909.697169:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196680320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 8708us (9036us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757909.697206:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1035 00000100:00100000:3.0:1782757909.698635:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196680192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 9988us (10649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757909.698654:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1384 00010000:00010000:3.0:1782757910.069287:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757910.444547:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211536128:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.444664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757910.444740:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211536640:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.444773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757910.444845:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757910.444852:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211536256:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.444877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757910.444920:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536128 00000100:00100000:2.0:1782757910.444931:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536128 00000100:00100000:3.0:1782757910.445067:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211536384:0@lo:400:kworker.0 00000100:00100000:3.0:1782757910.445102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757910.445126:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782757910.445132:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211536000:0@lo:400:kworker.0 00000100:00100000:3.0:1782757910.445164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757910.445185:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211536512:0@lo:400:kworker.0 00000100:00100000:3.0:1782757910.445218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757910.445279:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536256 00000100:00100000:3.0:1782757910.445283:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536256 00000100:00100000:3.0:1782757910.445338:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536512 00000100:00100000:3.0:1782757910.445341:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536512 00000100:00100000:3.0:1782757910.445374:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1782757910.445386:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211536256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757910.445474:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211536256:12345-0@lo:400:kworker.0 Request processed in 88us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757910.445484:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1782757910.445508:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1782757910.445515:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211536512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757910.445549:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211536512:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757910.445555:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1782757910.445604:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211536512:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.445786:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1782757910.445795:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211536128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.445860:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211536128:12345-0@lo:400:kworker.0 Request processed in 67us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757910.445866:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1782757910.445890:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536640 00000100:00100000:2.0:1782757910.445894:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536640 00000100:00100000:2.0:1782757910.445924:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536384 00000100:00100000:2.0:1782757910.445927:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536384 00000100:00100000:2.0:1782757910.445952:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1782757910.446059:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211536640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.446098:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211536640:12345-0@lo:400:kworker.0 Request processed in 140us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757910.446105:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1782757910.446118:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1782757910.446123:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211536384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.446156:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211536384:12345-0@lo:400:kworker.0 Request processed in 33us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757910.446162:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1782757910.446329:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536000 00000100:00100000:0.0:1782757910.446334:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536000 00000100:00100000:0.0:1782757910.446376:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1782757910.446384:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757910.446426:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211536000:12345-0@lo:400:kworker.0 Request processed in 44us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757910.446432:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:0.0:1782757910.446479:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757910.446484:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757910.446487:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757910.448630:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211536000:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.448668:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211536384:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.448756:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211536256:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.448772:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211536128:0@lo:400:kworker.0 00000100:00100000:2.0:1782757910.448788:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211536640:0@lo:400:kworker.0 00000100:00100000:0.0:1782757910.956408:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211536768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757910.956521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757910.965000:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536768 00000100:00100000:3.0:1782757910.965023:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536768 00000100:00100000:2.0:1782757910.965331:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1782757910.965345:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211536768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757910.965396:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757910.969490:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211536768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4130us (12952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757910.969512:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1782757910.971954:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211536768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757911.085653:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757912.108059:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757913.132428:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757913.516547:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757913.516577:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211536896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757913.516659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757913.517461:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211536896 00000100:00100000:3.0:1782757913.517475:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211536896 00000100:00100000:3.0:1782757913.517569:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1782757913.517583:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211536896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757913.517641:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782757913.517782:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757913.518519:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211536896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 934us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757913.518531:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1782757913.519525:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211536896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782757914.157277:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757914.815589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757914.815652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757914.815688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757914.815734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757914.815795:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680832 00000100:00100000:1.0:1782757914.815809:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680832 00000100:00100000:3.0:1782757914.815953:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680704 00000100:00100000:3.0:1782757914.815956:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680704 00000100:00100000:0.0:1782757914.816007:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680576 00000100:00100000:0.0:1782757914.816010:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680576 00000100:00100000:0.0:1782757914.816060:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1135 00000100:00100000:0.0:1782757914.816071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196680576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757914.816158:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196680576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757914.816166:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1135 00000100:00100000:1.0:1782757914.816290:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196680960 00000100:00100000:1.0:1782757914.816295:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196680960 00000100:00100000:2.0:1782757914.816461:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:2.0:1782757914.816472:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196680832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757914.816507:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196680832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757914.816512:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:3.0:1782757914.817518:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1388 00000100:00100000:3.0:1782757914.817530:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196680704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757914.817816:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196680704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 287us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757914.817841:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1388 00000100:00100000:1.0:1782757914.818546:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1039 00000100:00100000:1.0:1782757914.818557:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196680960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757914.818627:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196680960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757914.818634:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1039 00000100:00080000:0.0:1782757914.820322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757914.820332:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757914.820336:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782757915.180228:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757915.565039:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211537024:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565199:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211537536:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565274:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757915.565282:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211537408:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565368:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211537280:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782757915.565439:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211537152:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565489:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211537664:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.565510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757915.565543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537024 00000100:00100000:0.0:1782757915.565550:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537024 00000100:00100000:0.0:1782757915.569797:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1782757915.569813:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211537024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.569938:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211537024:12345-0@lo:400:kworker.0 Request processed in 128us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.569946:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1782757915.570000:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537536 00000100:00100000:0.0:1782757915.570009:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537536 00000100:00100000:0.0:1782757915.570047:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537280 00000100:00100000:0.0:1782757915.570051:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537280 00000100:00100000:0.0:1782757915.570081:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537152 00000100:00100000:0.0:1782757915.570084:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537152 00000100:00100000:0.0:1782757915.570099:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1782757915.570106:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211537536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570141:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211537536:12345-0@lo:400:kworker.0 Request processed in 36us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.570149:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1782757915.570162:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1782757915.570167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211537280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570202:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211537280:12345-0@lo:400:kworker.0 Request processed in 35us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.570207:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1782757915.570218:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1782757915.570225:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211537152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570254:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211537152:12345-0@lo:400:kworker.0 Request processed in 30us (4789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.570259:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1782757915.570283:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537408 00000100:00100000:0.0:1782757915.570288:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537408 00000100:00100000:0.0:1782757915.570313:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537664 00000100:00100000:0.0:1782757915.570316:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537664 00000100:00100000:0.0:1782757915.570338:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1782757915.570344:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211537408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570390:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211537408:12345-0@lo:400:kworker.0 Request processed in 47us (5076us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.570397:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1782757915.570408:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1782757915.570415:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211537664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570441:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211537664:12345-0@lo:400:kworker.0 Request processed in 28us (4930us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757915.570447:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:0.0:1782757915.570471:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757915.570475:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757915.570477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757915.570525:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211537152:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570539:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211537664:0@lo:400:kworker.0 00000100:00100000:0.0:1782757915.570550:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211537280:0@lo:400:kworker.0 00000100:00100000:1.0:1782757915.572194:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211537408:0@lo:400:kworker.0 00000100:00100000:1.0:1782757915.572211:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211537024:0@lo:400:kworker.0 00000100:00100000:1.0:1782757915.572222:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211537536:0@lo:400:kworker.0 00000100:00100000:1.0:1782757916.076165:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757916.076191:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211537792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757916.076273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757916.076523:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537792 00000100:00100000:2.0:1782757916.076532:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537792 00000100:00100000:2.0:1782757916.076585:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1782757916.076593:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211537792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757916.076630:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757916.076688:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211537792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757916.076695:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1782757916.076819:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211537792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757916.204970:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757917.228192:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757918.251991:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757918.636230:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211537920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757918.636317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757918.636688:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211537920 00000100:00100000:3.0:1782757918.636697:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211537920 00000100:00100000:3.0:1782757918.636776:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1782757918.636787:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211537920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757918.636851:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757918.636921:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211537920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757918.636929:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1782757918.637024:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211537920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757918.641042:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757919.276335:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757919.930211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757919.930253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757919.930307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757919.930422:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681216 00000100:00100000:3.0:1782757919.930432:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681216 00000100:00100000:3.0:1782757919.930497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1392 00000100:00100000:3.0:1782757919.930508:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196681216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757919.930607:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196681216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757919.930615:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1392 00000100:00100000:0.0:1782757919.930903:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681088 00000100:00100000:0.0:1782757919.930908:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681088 00000100:00100000:0.0:1782757919.930947:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1137 00000100:00100000:0.0:1782757919.930956:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196681088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757919.930991:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196681088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757919.930997:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1137 00000100:00080000:2.0:1782757919.931217:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757919.931930:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681344 00000100:00100000:1.0:1782757919.931937:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681344 00000100:00100000:1.0:1782757919.932122:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1042 00000100:00100000:1.0:1782757919.932130:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196681344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757919.932185:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196681344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757919.932192:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1042 00000100:00080000:2.0:1782757919.934345:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757919.949499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757919.949612:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681472 00000100:00100000:1.0:1782757919.949622:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681472 00000100:00100000:1.0:1782757919.949706:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 405 00000100:00100000:1.0:1782757919.949716:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196681472:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1782757919.949757:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9ea6 00000100:00080000:1.0:1782757919.949766:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917081af9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782757919.949813:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967341 00000100:00100000:1.0:1782757919.950290:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196681472:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 573us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757919.950298:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 405 00010000:00010000:0.0:1782757919.950781:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782757919.951105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782757920.302211:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757920.684719:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211538432:0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.684791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757920.684874:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211538048:0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.684908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757920.684963:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538048 00000100:00100000:2.0:1782757920.684971:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538048 00000100:00100000:2.0:1782757920.685021:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1782757920.685030:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211538048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.685078:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211538176:0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.685080:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211538048:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.685086:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1782757920.685105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757920.685145:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211538688:0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.685167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757920.685184:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757920.685189:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211538304:0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.685208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757920.685235:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538432 00000100:00100000:1.0:1782757920.685239:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538432 00000100:00100000:2.0:1782757920.685929:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538176 00000100:00100000:2.0:1782757920.685935:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538176 00000100:00100000:2.0:1782757920.685973:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538304 00000100:00100000:2.0:1782757920.685976:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538304 00000100:00100000:2.0:1782757920.686004:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1782757920.686011:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211538176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686060:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211538176:12345-0@lo:400:kworker.0 Request processed in 50us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.686067:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1782757920.686080:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1782757920.686086:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211538304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686114:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211538304:12345-0@lo:400:kworker.0 Request processed in 28us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.686120:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00080000:2.0:1782757920.686142:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757920.686174:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211538048:0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686182:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211538560:0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.686197:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538688 00000100:00100000:1.0:1782757920.686201:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538688 00000100:00100000:2.0:1782757920.686204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757920.686223:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1782757920.686229:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211538432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.686278:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211538432:12345-0@lo:400:kworker.0 Request processed in 49us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757920.686284:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1782757920.686378:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538560 00000100:00100000:2.0:1782757920.686383:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538560 00000100:00100000:2.0:1782757920.686408:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1782757920.686414:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211538560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686551:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211538560:12345-0@lo:400:kworker.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.686558:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1782757920.686575:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1782757920.686582:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686583:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211538560:0@lo:400:kworker.0 00000100:00080000:2.0:1782757920.686621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757920.686625:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757920.686626:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757920.686644:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211538304:0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686655:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211538176:0@lo:400:kworker.0 00000100:00100000:2.0:1782757920.686680:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211538432:0@lo:400:kworker.0 00000100:00100000:1.0:1782757920.686792:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211538688:12345-0@lo:400:kworker.0 Request processed in 210us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757920.686802:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1782757920.686906:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211538688:0@lo:400:kworker.0 00000001:00100000:3.0:1782757920.787188:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782757920.787199:0:7507:0:(genops.c:906:class_export_put()) final put ffff917081aff000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782757920.788609:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917081aff000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:0.0:1782757920.792689:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081af9000 for lustre-OST0001 00000100:00100000:0.0:1782757920.894239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757920.894640:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681600 00000100:00100000:2.0:1782757920.894651:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681600 00000100:00100000:2.0:1782757920.895684:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 735 00000100:00100000:2.0:1782757920.895700:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196681600:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757920.895812:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196681600:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 116us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.895835:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 735 00000100:00100000:3.0:1782757920.908353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757920.908463:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681728 00000100:00100000:2.0:1782757920.908475:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681728 00000100:00100000:2.0:1782757920.908548:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 406 00000100:00100000:2.0:1782757920.908572:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46184:x1869355196681728:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757920.908972:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46184:x1869355196681728:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 413us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.908981:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 406 00000100:00100000:1.0:1782757920.917375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757920.917464:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681856 00000100:00100000:2.0:1782757920.917474:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681856 00000100:00100000:2.0:1782757920.917519:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 407 00000100:00100000:2.0:1782757920.917527:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196681856:12345-192.168.204.31@tcp:8:lfs.60003 00010000:00080000:2.0:1782757920.917561:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 1989 last 0 00000020:00000080:2.0:1782757920.917594:0:6597:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777da0c8 00002000:00100000:2.0:1782757920.917607:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917191a81000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782757920.917632:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782757920.918147:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782757920.918178:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917191a82800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782757920.918286:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196681856:12345-192.168.204.31@tcp:8:lfs.60003 Request processed in 757us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.918295:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 407 00000100:00100000:2.0:1782757920.943014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757920.943054:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196681984 00000100:00100000:2.0:1782757920.943065:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196681984 00000100:00100000:2.0:1782757920.943132:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 408 00000100:00100000:2.0:1782757920.943142:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46184:x1869355196681984:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757920.943526:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46184:x1869355196681984:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 384us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757920.943534:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 408 00000100:00080000:2.0:1782757920.943681:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757920.959467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757920.961093:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682112 00000100:00100000:3.0:1782757920.961108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682112 00000100:00100000:3.0:1782757920.961170:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:3.0:1782757920.961180:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682112:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757920.964018:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682112:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2832us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757920.964033:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:2.0:1782757920.970528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757920.971906:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682240 00000100:00100000:3.0:1782757920.971923:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682240 00000100:00100000:3.0:1782757920.971996:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 737 00000100:00100000:3.0:1782757920.972008:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682240:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757920.972123:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682240:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 117us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757920.972131:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 737 00000100:00100000:1.0:1782757920.978590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757920.978756:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682368 00000100:00100000:3.0:1782757920.978767:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682368 00000100:00100000:3.0:1782757920.978888:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 409 00000100:00100000:3.0:1782757920.978899:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46184:x1869355196682368:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757920.979311:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46184:x1869355196682368:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 412us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757920.979319:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 409 00000100:00100000:1.0:1782757920.984283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757920.984663:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682496 00000100:00100000:3.0:1782757920.984674:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682496 00000100:00100000:1.0:1782757920.984850:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 410 00000100:00100000:1.0:1782757920.984874:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46184:x1869355196682496:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757920.985378:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46184:x1869355196682496:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 517us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757920.985388:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 410 00000100:00100000:0.0:1782757921.004535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757921.005312:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682624 00000100:00100000:2.0:1782757921.005323:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682624 00000100:00100000:2.0:1782757921.005383:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 738 00000100:00100000:2.0:1782757921.005393:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682624:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00080000:0.0:1782757921.008012:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757921.008811:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46184:x1869355196682624:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 3412us (4282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757921.008844:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 738 00000100:00100000:1.0:1782757921.054327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757921.054465:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196682752 00000100:00100000:1.0:1782757921.054477:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196682752 00000100:00100000:1.0:1782757921.054544:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 739 00000100:00100000:1.0:1782757921.054555:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46185:x1869355196682752:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782757921.054577:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757921.054597:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da0cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648a7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.054668:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.054686:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.054701:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757921.055101:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1782757921.055106:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757921.055203:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.055312:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da0cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a7 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.055331:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a7 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757921.055340:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75600) 00010000:00010000:1.0:1782757921.055344:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757921.055347:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782757921.055479:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46185:x1869355196682752:12345-192.168.204.31@tcp:101:rm.0 Request processed in 925us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757921.055487:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 739 00000100:00100000:3.0:1782757921.060814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757921.060879:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683008 00000100:00100000:0.0:1782757921.060891:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683008 00000100:00100000:0.0:1782757921.060965:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 740 00000100:00100000:0.0:1782757921.060979:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46185:x1869355196683008:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757921.061004:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757921.061025:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da0dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648ae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757921.061307:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00010000:0.0:1782757921.061575:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da0dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ae expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.061592:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:0.0:1782757921.061595:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782757921.061601:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da0dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ae expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.061616:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525600, rc 0) 00000100:00100000:0.0:1782757921.061685:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46185:x1869355196683008:12345-192.168.204.31@tcp:101:rm.0 Request processed in 709us (880us total) trans 4294967581 rc 301/301 00000100:00100000:0.0:1782757921.061694:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 740 00000100:00100000:1.0:1782757921.071659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757921.071772:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683136 00000100:00100000:0.0:1782757921.071783:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683136 00000100:00100000:0.0:1782757921.071867:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:0.0:1782757921.071880:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46185:x1869355196683136:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782757921.077697:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46185:x1869355196683136:12345-192.168.204.31@tcp:37:rm.0 Request processed in 5811us (6039us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757921.077713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:0.0:1782757921.091599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757921.091651:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683392 00000100:00100000:0.0:1782757921.091660:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683392 00000100:00100000:0.0:1782757921.091706:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:0.0:1782757921.091716:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46185:x1869355196683392:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1782757921.092342:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46185:x1869355196683392:12345-192.168.204.31@tcp:35:rm.0 Request processed in 625us (748us total) trans 4294967582 rc 0/0 00000100:00100000:0.0:1782757921.092351:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:1.0:1782757921.107517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757921.108634:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683648 00000100:00100000:0.0:1782757921.108646:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683648 00000100:00100000:0.0:1782757921.108702:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 741 00000100:00100000:0.0:1782757921.108712:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46185:x1869355196683648:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782757921.108771:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782757921.108799:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da0d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648a7 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108818:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da074 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64892 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108853:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff917191f75600) 00010000:00010000:0.0:1782757921.108882:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777d9d80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf647dc expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108891:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:0.0:1782757921.108898:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757921.108931:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108943:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108954:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108967:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108974:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.108980:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.109350:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.109360:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.109368:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757921.110312:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00010000:0.0:1782757921.110336:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110345:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110351:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110356:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757921.110360:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110372:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110384:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782757921.110387:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782757921.110391:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110396:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da0f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110416:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110421:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110426:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110430:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181524c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757921.110432:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110438:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110445:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:0.0:1782757921.110447:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757921.110449:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757921.110458:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da0eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757921.110473:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000242ecc79 reply state 00000000678a4468 transno 4294967583 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757921.110482:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782757921.110587:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46185:x1869355196683648:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1873us (3081us total) trans 4294967583 rc 0/0 00000100:00100000:0.0:1782757921.110595:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 741 00010000:00010000:3.0:1782757921.113280:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113299:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113308:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113313:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757921.113318:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113326:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113344:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff91718bcfdc00) 00010000:00010000:3.0:1782757921.113348:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757921.113354:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757921.113361:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da0f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757921.204922:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757921.204946:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757921.205024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757921.205097:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538816 00000100:00100000:2.0:1782757921.205104:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538816 00000100:00100000:2.0:1782757921.205150:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1782757921.205159:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211538816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757921.205183:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757921.205227:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211538816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757921.205234:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1782757921.205295:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211538816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757921.324163:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757922.348134:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757923.371960:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757923.768062:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782757923.768086:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211538944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757923.768154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757923.768264:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211538944 00000100:00100000:0.0:1782757923.768271:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211538944 00000100:00100000:0.0:1782757923.768339:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1782757923.768351:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211538944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757923.768389:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757923.768450:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211538944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757923.768457:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1782757923.768512:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211538944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782757923.768610:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782757924.400910:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757924.610810:0:79149:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc4af0810 20000000:00000080:1.0:1782757924.610890:0:79149:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d4000 uarg=0000000000000000 00010000:00010000:1.0:1782757924.611441:0:79149:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757924.611457:0:79149:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757924.611472:0:79149:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757924.611778:0:79149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.611797:0:79149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.611805:0:79149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.612021:0:79149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.612035:0:79149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 18 pid: 5793 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757924.612051:0:79149:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79149:1869355211539072:0@lo:104: 00000100:00100000:1.0:1782757924.612116:0:79149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757924.612232:0:79149:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c45900 going to sleep for 11 seconds 00000100:00100000:2.0:1782757924.615460:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539072 00000100:00100000:2.0:1782757924.615479:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539072 00000100:00100000:2.0:1782757924.615979:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1782757924.615991:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:79149:x1869355211539072:12345-0@lo:104: 00010000:00010000:2.0:1782757924.616014:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757924.616119:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782757924.616124:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:79149:x1869355211539072:12345-0@lo:104: Request processed in 137us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757924.616132:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1782757924.616370:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782757924.616378:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.616386:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782757924.616390:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.616404:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782757924.616411:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757924.616417:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782757924.616460:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.616467:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782757924.616499:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.616508:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777d9d6b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d9d72 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.616526:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757924.616528:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757924.616530:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757924.616543:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211539200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782757924.616583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757924.617781:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539200 00000100:00100000:0.0:1782757924.617789:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539200 00010000:00010000:0.0:1782757924.617835:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757924.617871:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782757924.617880:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211539200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757924.617893:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757924.617899:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617909:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617929:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617938:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617954:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617961:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617967:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617972:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617977:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757924.617982:0:79149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777d9d72 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d9d6b expref: 19 pid: 5793 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617982:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.617991:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757924.617996:0:79149:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79149:1869355211539072:0@lo:104: 00010000:00010000:0.0:1782757924.618003:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757924.618011:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757924.618017:0:79149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.618024:0:79149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.618029:0:79149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757924.618035:0:79149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777da100 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757924.618061:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211539200:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757924.618068:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1782757924.618383:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211539200:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1782757924.848424:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967583 is committed 00000100:00100000:1.0:1782757925.044569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757925.044612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757925.044642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757925.044669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757925.044699:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684032 00000100:00100000:1.0:1782757925.044708:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684032 00000100:00100000:1.0:1782757925.044755:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684160 00000100:00100000:1.0:1782757925.044757:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684160 00000100:00100000:1.0:1782757925.044776:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1045 00000100:00100000:1.0:1782757925.044784:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196684032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757925.044870:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196684032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757925.044870:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683904 00000100:00100000:0.0:1782757925.044874:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683904 00000100:00100000:1.0:1782757925.044877:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1045 00000100:00100000:1.0:1782757925.044896:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00100000:1.0:1782757925.044902:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196684160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757925.044919:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1396 00000100:00100000:1.0:1782757925.044925:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196684160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757925.044928:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196683904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757925.044931:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00100000:0.0:1782757925.044961:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196683904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757925.044967:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1396 00000100:00100000:3.0:1782757925.045237:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196683776 00000100:00100000:3.0:1782757925.045251:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196683776 00000100:00080000:1.0:1782757925.045329:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757925.045335:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757925.045336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1139 00000100:00080000:1.0:1782757925.045337:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757925.045344:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196683776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757925.045386:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196683776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757925.045392:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1139 00010000:00010000:3.0:1782757925.420904:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757925.538314:0:79199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb685b130 20000000:00000080:1.0:1782757925.538333:0:79199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d7800 uarg=0000000000000000 00010000:00010000:1.0:1782757925.539455:0:79199:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757925.539811:0:79199:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757925.539905:0:79199:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757925.539925:0:79199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539939:0:79199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539949:0:79199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539955:0:79199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539962:0:79199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539968:0:79199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539974:0:79199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757925.539978:0:79199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539985:0:79199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.539996:0:79199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.540003:0:79199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757925.540013:0:79199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777da107 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757925.810405:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211539456:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810542:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211539968:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810605:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782757925.810611:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211539328:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810658:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211539840:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810716:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211539584:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810759:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757925.810765:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211539712:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.810786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757925.810817:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539456 00000100:00100000:2.0:1782757925.810850:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539456 00000100:00100000:2.0:1782757925.810893:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539840 00000100:00100000:2.0:1782757925.810896:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539840 00000100:00100000:2.0:1782757925.810922:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539584 00000100:00100000:2.0:1782757925.810925:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539584 00000100:00100000:2.0:1782757925.810941:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1782757925.810948:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211539456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.811006:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211539456:12345-0@lo:400:kworker.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.811012:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1782757925.811029:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1782757925.811035:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211539840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.811074:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211539840:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.811081:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1782757925.811093:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1782757925.811098:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211539584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.811125:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211539584:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.811130:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1782757925.811158:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539968 00000100:00100000:2.0:1782757925.811162:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539968 00000100:00100000:2.0:1782757925.811187:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539712 00000100:00100000:2.0:1782757925.811190:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539712 00000100:00100000:2.0:1782757925.811214:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1782757925.811222:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211539968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.811254:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211539968:12345-0@lo:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.811260:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1782757925.811271:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1782757925.811278:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.811309:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211539712:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.811318:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:3.0:1782757925.812434:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757925.812442:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757925.812445:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757925.817182:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211539328 00000100:00100000:2.0:1782757925.817196:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211539328 00000100:00100000:2.0:1782757925.817386:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1782757925.817398:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.817504:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211539328:12345-0@lo:400:kworker.0 Request processed in 108us (6865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757925.817511:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1782757925.819457:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211539328:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.819478:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211539840:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.819491:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211539456:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.819503:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211539968:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.819558:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211539712:0@lo:400:kworker.0 00000100:00100000:2.0:1782757925.819588:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211539584:0@lo:400:kworker.0 00000001:00100000:0.0:1782757925.865174:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:3.0:1782757926.316102:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211540096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757926.316196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757926.316748:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540096 00000100:00100000:2.0:1782757926.316759:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540096 00000100:00100000:2.0:1782757926.316810:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1782757926.316819:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211540096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757926.317543:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757926.317627:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211540096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 807us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757926.317635:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1782757926.317755:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211540096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757926.452599:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757926.573788:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757926.573796:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757926.573802:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757926.573887:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757926.573900:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757926.573923:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757926.573950:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211540224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757926.574021:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757926.574069:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782757926.575167:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540224 00000100:00100000:0.0:1782757926.575182:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540224 00000100:00100000:0.0:1782757926.575258:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1782757926.575270:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211540224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757926.575290:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757926.575317:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da10e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757926.575351:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757926.575367:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757926.575381:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757926.575462:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211540224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757926.575469:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1782757926.575528:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211540224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782757926.575547:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757926.575556:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782757926.575576:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782757926.575581:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757926.575589:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757927.468886:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757928.494758:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757928.879641:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211540352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757928.879720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757928.879934:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540352 00000100:00100000:3.0:1782757928.879944:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540352 00000100:00100000:3.0:1782757928.880013:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1782757928.880023:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211540352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757928.880059:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757928.880117:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211540352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757928.880124:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1782757928.880168:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211540352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757928.881499:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757929.207496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757929.207744:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684288 00000100:00100000:2.0:1782757929.207755:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684288 00000100:00100000:2.0:1782757929.207872:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 742 00000100:00100000:2.0:1782757929.207883:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46298:x1869355196684288:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757929.207904:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757929.207928:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648b5 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.207987:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.208000:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.208013:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757929.208241:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782757929.208246:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757929.208322:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.208347:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648b5 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.208365:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648b5 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757929.208372:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782757929.208375:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757929.208377:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00080000:1.0:1782757929.208729:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757929.214664:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46298:x1869355196684288:12345-192.168.204.31@tcp:101:rm.0 Request processed in 6766us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757929.214679:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 742 00000100:00100000:0.0:1782757929.217233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757929.218277:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684416 00000100:00100000:3.0:1782757929.218294:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684416 00000100:00100000:3.0:1782757929.218411:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 743 00000100:00100000:3.0:1782757929.218423:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46298:x1869355196684416:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757929.218445:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757929.218469:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da12a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218538:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218555:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218566:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218584:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218591:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218598:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218905:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218915:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218921:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218927:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757929.218931:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218939:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218953:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:3.0:1782757929.218956:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757929.218960:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218966:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218980:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218986:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218991:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.218996:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757929.218999:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219004:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219010:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75900) 00010000:00010000:3.0:1782757929.219013:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757929.219016:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219022:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219054:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da12a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648bc expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219063:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:3.0:1782757929.219065:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757929.219069:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da12a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648bc expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.219077:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782757929.219166:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46298:x1869355196684416:12345-192.168.204.31@tcp:101:rm.0 Request processed in 744us (1942us total) trans 0 rc 301/301 00000100:00100000:3.0:1782757929.219173:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 743 00000100:00100000:2.0:1782757929.292999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757929.293125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757929.293232:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684544 00000100:00100000:0.0:1782757929.293244:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684544 00000100:00100000:0.0:1782757929.293315:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684800 00000100:00100000:0.0:1782757929.293318:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684800 00000100:00100000:0.0:1782757929.293350:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 744 00000100:00100000:0.0:1782757929.293361:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196684544:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782757929.293415:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782757929.293513:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196684544:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 153us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757929.293521:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 744 00000100:00100000:0.0:1782757929.293541:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 745 00000100:00100000:0.0:1782757929.293547:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46302:x1869355196684800:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782757929.293586:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757929.293616:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648b5 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.293646:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:0.0:1782757929.293658:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757929.295026:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.295048:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.295061:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.295074:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.295094:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757929.295101:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757929.299201:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 512 00010000:00010000:1.0:1782757929.299226:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299237:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299245:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299253:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757929.299258:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299266:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299289:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdf00) 00010000:00010000:1.0:1782757929.299292:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757929.299298:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.299308:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da13f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757929.299334:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f1e125 reply state 000000000c34caaa transno 4294967584 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757929.299346:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782757929.299474:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46302:x1869355196684800:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 5922us (6343us total) trans 4294967584 rc 0/0 00000100:00100000:1.0:1782757929.304769:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 745 00010000:00010000:3.0:1782757929.307549:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307568:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307577:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307583:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757929.307588:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307595:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307614:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff91718bcfd700) 00010000:00010000:3.0:1782757929.307617:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757929.307622:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.307628:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da146 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757929.391145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757929.391243:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196684928 00000100:00100000:3.0:1782757929.391254:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196684928 00000100:00100000:3.0:1782757929.391308:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 746 00000100:00100000:3.0:1782757929.391318:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46306:x1869355196684928:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782757929.391342:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757929.391365:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648c3 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391443:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391462:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391473:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757929.391539:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782757929.391543:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757929.391569:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391592:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648c3 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391610:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648c3 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.391619:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782757929.391622:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757929.391625:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782757929.391695:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46306:x1869355196684928:12345-192.168.204.31@tcp:101:chown.0 Request processed in 378us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757929.391702:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 746 00000100:00100000:2.0:1782757929.395920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757929.396133:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685056 00000100:00100000:1.0:1782757929.396144:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685056 00000100:00100000:1.0:1782757929.396200:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 747 00000100:00100000:1.0:1782757929.396210:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46306:x1869355196685056:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782757929.396230:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757929.396249:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da15b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648ca expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396305:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396319:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396331:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396345:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396353:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396360:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396481:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396489:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396497:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757929.396536:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 512 00000004:00200000:1.0:1782757929.396540:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757929.396563:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396576:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396582:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396588:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396593:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757929.396597:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396605:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396617:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782757929.396620:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757929.396624:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396630:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396641:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396646:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396651:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396655:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757929.396658:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396663:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396668:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9171a0e3af00) 00010000:00010000:1.0:1782757929.396670:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757929.396672:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396681:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da169 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396706:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ca expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396731:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ca expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.396738:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757929.396740:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757929.396743:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782757929.396985:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46306:x1869355196685056:12345-192.168.204.31@tcp:101:chown.0 Request processed in 775us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757929.396993:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 747 00000100:00100000:0.0:1782757929.401899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757929.402170:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685312 00000100:00100000:1.0:1782757929.402180:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685312 00000100:00100000:1.0:1782757929.402238:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 748 00000100:00100000:1.0:1782757929.402248:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46306:x1869355196685312:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782757929.402298:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757929.402326:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ca expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.402343:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782757929.402354:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757929.402380:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.402393:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757929.402403:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757929.439766:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ed45544 reply state 0000000090e53244 transno 4294967585 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757929.439796:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757929.440001:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:0.0:1782757929.440121:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46306:x1869355196685312:12345-192.168.204.31@tcp:36:chown.0 Request processed in 37870us (38229us total) trans 4294967585 rc 0/0 00000100:00100000:0.0:1782757929.440132:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 748 00010000:00010000:3.0:1782757929.443861:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443881:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443889:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443896:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757929.443901:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443911:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443930:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782757929.443933:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782757929.443938:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757929.443944:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da177 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782757929.446020:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967585 is committed 00010000:00010000:1.0:1782757929.517378:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757930.165112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757930.165182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757930.165206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757930.165223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757930.165257:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685696 00000100:00100000:0.0:1782757930.165277:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685696 00000100:00100000:0.0:1782757930.165331:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685824 00000100:00100000:0.0:1782757930.165334:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685824 00000100:00100000:0.0:1782757930.165358:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:0.0:1782757930.165372:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196685696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757930.165454:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196685696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.165462:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:0.0:1782757930.165482:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1050 00000100:00100000:0.0:1782757930.165489:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196685824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757930.165511:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196685824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.165517:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1050 00000100:00100000:2.0:1782757930.165796:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685440 00000100:00100000:2.0:1782757930.165803:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685440 00000100:00100000:2.0:1782757930.165861:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1142 00000100:00100000:2.0:1782757930.165869:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196685440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757930.165898:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196685440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757930.165905:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1142 00000100:00100000:2.0:1782757930.165939:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685568 00000100:00100000:2.0:1782757930.165942:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685568 00000100:00100000:2.0:1782757930.165967:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1400 00000100:00100000:2.0:1782757930.165973:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196685568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757930.166002:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196685568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757930.166009:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1400 00000100:00080000:1.0:1782757930.166443:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757930.166449:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782757930.268456:0:79396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa72e5c10 20000000:00000080:0.0:1782757930.268477:0:79396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e7800 uarg=0000000000000000 00010000:00010000:0.0:1782757930.269000:0:79396:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782757930.269036:0:79396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782757930.269039:0:79396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757930.269052:0:79396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648c3 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.271315:0:79396:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782757930.271364:0:79396:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757930.271383:0:79396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.271400:0:79396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.271408:0:79396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.271453:0:79396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.271468:0:79396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 18 pid: 5793 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757930.271483:0:79396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79396:1869355211540480:0@lo:104: 00000100:00100000:0.0:1782757930.271554:0:79396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.271715:0:79396:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782757930.272158:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782757930.272174:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540480 00000100:00100000:0.0:1782757930.272180:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540480 00000100:00100000:0.0:1782757930.272236:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1782757930.272245:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:79396:x1869355211540480:12345-0@lo:104: 00010000:00010000:0.0:1782757930.272260:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757930.272338:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757930.272345:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:79396:x1869355211540480:12345-0@lo:104: Request processed in 101us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.272352:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1782757930.272503:0:79396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79396:1869355211540480:0@lo:104: 00010000:00010000:2.0:1782757930.272615:0:79396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272665:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757930.272672:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272679:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782757930.272685:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272694:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782757930.272701:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757930.272707:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782757930.272746:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272753:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782757930.272786:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272794:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777da10e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da115 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.272809:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757930.272811:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757930.272812:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757930.272875:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757930.272889:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211540608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757930.272924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757930.273081:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540608 00000100:00100000:3.0:1782757930.273086:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540608 00010000:00010000:3.0:1782757930.273108:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757930.273139:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1782757930.273145:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211540608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757930.273157:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757930.273163:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273174:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273187:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525a00/0xdd99f5c4777da115 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da10e expref: 19 pid: 5793 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273200:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273208:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273221:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273228:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273235:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273241:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273246:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757930.273251:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273259:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273278:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757930.273287:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757930.273321:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211540608:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757930.273328:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1782757930.273355:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211540608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782757930.273418:0:79396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757930.273425:0:79396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757930.273430:0:79396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525c00/0xdd99f5c4777da17e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757930.539965:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757930.925071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211540864:0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.925074:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211540736:0@lo:400:kworker.0 00000100:00100000:3.0:1782757930.926689:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211541120:0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.928488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.928750:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540864 00000100:00100000:0.0:1782757930.928759:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540864 00000100:00100000:0.0:1782757930.928806:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1782757930.928814:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.928973:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211540864:12345-0@lo:400:kworker.0 Request processed in 158us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.928981:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1782757930.929158:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211540864:0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.929170:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211541376:0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.929204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.929243:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757930.929543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757930.929586:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211541248:0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.929613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.929763:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541376 00000100:00100000:0.0:1782757930.929769:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541376 00000100:00100000:0.0:1782757930.929841:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1782757930.929849:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211541376:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782757930.930005:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757930.930157:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211541376:12345-0@lo:400:kworker.0 Request processed in 308us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.930165:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1782757930.930188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.930193:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540736 00000100:00100000:0.0:1782757930.930197:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540736 00000100:00100000:0.0:1782757930.930227:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1782757930.930234:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.930282:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211540736:12345-0@lo:400:kworker.0 Request processed in 49us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.930290:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1782757930.930296:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541120 00000100:00100000:2.0:1782757930.930302:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541120 00000100:00100000:0.0:1782757930.930322:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541248 00000100:00100000:0.0:1782757930.930326:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541248 00000100:00100000:2.0:1782757930.930352:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1782757930.930363:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1782757930.930372:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211541248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.930375:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211541120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.930421:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211541120:12345-0@lo:400:kworker.0 Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757930.930427:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1782757930.930481:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211541248:12345-0@lo:400:kworker.0 Request processed in 110us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757930.930488:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1782757930.930516:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211540992:0@lo:400:kworker.0 00000100:00100000:3.0:1782757930.930548:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211540736:0@lo:400:kworker.0 00000100:00100000:3.0:1782757930.930575:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211541248:0@lo:400:kworker.0 00000100:00100000:3.0:1782757930.930608:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211541120:0@lo:400:kworker.0 00000100:00100000:0.0:1782757930.930672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757930.930706:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211541376:0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.930721:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211540992 00000100:00100000:2.0:1782757930.930726:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211540992 00000100:00100000:2.0:1782757930.930763:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:2.0:1782757930.930771:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211540992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757930.930850:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211540992:12345-0@lo:400:kworker.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757930.930857:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1782757930.931000:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211540992:0@lo:400:kworker.0 00000100:00080000:2.0:1782757930.931136:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757930.931141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782757931.162693:0:79445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaac12b80 20000000:00000080:0.0:1782757931.162716:0:79445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e5400 uarg=0000000000000000 00010000:00010000:0.0:1782757931.163308:0:79445:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782757931.163325:0:79445:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782757931.163339:0:79445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782757931.163672:0:79445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163695:0:79445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163707:0:79445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163713:0:79445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163725:0:79445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163732:0:79445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163739:0:79445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757931.163744:0:79445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163750:0:79445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163764:0:79445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163772:0:79445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757931.163778:0:79445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181525400/0xdd99f5c4777da185 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757931.438067:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757931.438093:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211541504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757931.438174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757931.438290:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541504 00000100:00100000:2.0:1782757931.438299:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541504 00000100:00100000:2.0:1782757931.438355:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1782757931.438365:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211541504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757931.438404:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757931.438454:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211541504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757931.438462:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1782757931.438550:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211541504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757931.564068:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782757932.013690:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782757932.013697:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782757932.013702:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782757932.013749:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757932.013762:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757932.013778:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757932.013806:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211541632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782757932.013908:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757932.013962:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198b499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782757932.016625:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541632 00000100:00100000:3.0:1782757932.016642:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541632 00000100:00100000:3.0:1782757932.016715:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1782757932.016725:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211541632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757932.016743:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757932.016763:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da18c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757932.016791:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757932.016809:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757932.016817:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782757932.016936:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211541632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757932.016942:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1782757932.017003:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211541632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782757932.017034:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757932.017046:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782757932.017077:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782757932.017084:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757932.017092:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757932.589110:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757933.615748:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757933.997208:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211541760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757933.997288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757933.997997:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541760 00000100:00100000:3.0:1782757933.998008:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541760 00000100:00100000:3.0:1782757933.998074:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1782757933.998085:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211541760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757933.998125:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757933.998183:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211541760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757933.998191:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1782757933.998282:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211541760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757933.998467:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757934.367593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757934.367753:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196685952 00000100:00100000:1.0:1782757934.367766:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196685952 00000100:00100000:1.0:1782757934.367933:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:1.0:1782757934.367944:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196685952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757934.367962:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757934.367965:0:7497:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777da154) 00010000:00010000:1.0:1782757934.367967:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757934.368036:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196685952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (454us total) trans 0 rc 116/116 00000100:00100000:1.0:1782757934.368043:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00080000:2.0:1782757934.370631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782757934.637131:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757935.288112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757935.288157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757935.288182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757935.288202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757935.288226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757935.288258:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686336 00000100:00100000:0.0:1782757935.288269:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686336 00000100:00100000:0.0:1782757935.288323:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686464 00000100:00100000:0.0:1782757935.288326:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686464 00000100:00100000:0.0:1782757935.288347:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:0.0:1782757935.288357:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196686336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757935.288429:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196686336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757935.288494:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:0.0:1782757935.288514:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1054 00000100:00100000:0.0:1782757935.288522:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196686464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757935.288547:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196686464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757935.288553:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1054 00000100:00100000:0.0:1782757935.288572:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686208 00000100:00100000:0.0:1782757935.288575:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686208 00000100:00100000:0.0:1782757935.288599:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686592 00000100:00100000:0.0:1782757935.288602:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686592 00000100:00100000:0.0:1782757935.288619:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00100000:0.0:1782757935.288625:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196686208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757935.288652:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196686208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757935.288658:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00100000:0.0:1782757935.288670:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 749 00000100:00100000:0.0:1782757935.288676:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46411:x1869355196686592:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782757935.288686:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757935.288708:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da19a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648d1 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.288767:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.288781:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.288794:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757935.289050:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782757935.289055:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757935.289140:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.289169:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da19a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.289185:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d1 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757935.289194:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782757935.289197:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757935.289200:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181524c00, rc 0) 00000100:00100000:0.0:1782757935.289225:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46411:x1869355196686592:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 549us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757935.289231:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 749 00000100:00100000:3.0:1782757935.289786:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686080 00000100:00100000:3.0:1782757935.289794:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686080 00000100:00100000:3.0:1782757935.289870:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1145 00000100:00100000:3.0:1782757935.289879:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196686080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757935.289917:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196686080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757935.289923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1145 00000100:00080000:3.0:1782757935.289951:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757935.289957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757935.297576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757935.297661:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686720 00000100:00100000:2.0:1782757935.297671:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686720 00000100:00100000:2.0:1782757935.297734:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 750 00000100:00100000:2.0:1782757935.297745:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46411:x1869355196686720:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782757935.297768:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757935.297794:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da1a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648d8 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297894:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297910:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297922:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297937:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297949:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.297956:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.298934:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.298947:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.298957:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757935.299076:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1782757935.299081:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757935.299165:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299179:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299186:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299194:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299201:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.299206:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299214:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299229:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782757935.299232:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757935.299237:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299242:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299256:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299262:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299268:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299624:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.299631:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299640:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299649:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1c00) 00010000:00010000:2.0:1782757935.299651:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757935.299655:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299665:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299706:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d8 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299737:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d8 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.299744:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:2.0:1782757935.299747:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782757935.299750:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782757935.299863:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46411:x1869355196686720:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2118us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757935.299872:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 750 00000100:00100000:3.0:1782757935.309162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757935.309247:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196686976 00000100:00100000:1.0:1782757935.309258:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196686976 00000100:00100000:1.0:1782757935.309327:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 751 00000100:00100000:1.0:1782757935.309337:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46411:x1869355196686976:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782757935.309392:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757935.309421:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da1bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d8 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.309440:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:1.0:1782757935.309452:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757935.309477:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.309491:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.309501:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782757935.390741:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967586 is committed 00000004:00010000:1.0:1782757935.391516:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011562672 reply state 00000000beea0a08 transno 4294967586 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757935.391532:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757935.391687:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00080000:1.0:1782757935.391782:0:5801:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782757935.391804:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46411:x1869355196686976:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 82464us (82649us total) trans 4294967586 rc 0/0 00000100:00100000:1.0:1782757935.391813:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 751 00010000:00010000:2.0:1782757935.391931:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.391941:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.391948:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.391954:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.391968:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.391976:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.391991:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782757935.391994:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757935.391998:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.392005:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da1c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757935.456773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757935.458717:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196687104 00000100:00100000:3.0:1782757935.458732:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196687104 00000100:00100000:3.0:1782757935.458906:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 752 00000100:00100000:3.0:1782757935.458917:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46415:x1869355196687104:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757935.458944:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757935.458975:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da1cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648df expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459055:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459071:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459084:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459099:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459106:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.459113:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460700:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460717:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460731:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757935.460839:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1782757935.460844:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757935.460927:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460941:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460947:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460955:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460973:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.460976:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460984:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.460998:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782757935.461001:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757935.461006:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461012:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da1d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461029:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461035:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461040:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461045:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.461047:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461053:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461059:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75900) 00010000:00010000:3.0:1782757935.461061:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757935.461064:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461069:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da1d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461106:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da1cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648df expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461120:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648df expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.461132:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757935.461134:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757935.461137:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782757935.461206:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46415:x1869355196687104:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2290us (4446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757935.461214:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 752 00000100:00100000:0.0:1782757935.474399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757935.474481:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196687360 00000100:00100000:2.0:1782757935.474491:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196687360 00000100:00100000:2.0:1782757935.474552:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 753 00000100:00100000:2.0:1782757935.474563:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46415:x1869355196687360:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782757935.474584:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757935.474602:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da1e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648e6 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.474989:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.475006:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.475017:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.475031:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.475038:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.475050:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782757935.476137:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:2.0:1782757935.476492:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da1fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476506:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476516:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476554:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476560:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476567:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476573:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.476578:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476585:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476597:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782757935.476600:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757935.476605:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476611:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da1ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757935.476626:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebe29b3e reply state 00000000ef9d045b transno 4294967587 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757935.476635:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782757935.476667:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da1e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648e6 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476681:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648e6 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.476687:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782757935.476689:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782757935.476692:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782757935.476760:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46415:x1869355196687360:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2200us (2373us total) trans 4294967587 rc 0/0 00000100:00100000:2.0:1782757935.476768:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 753 00010000:00010000:2.0:1782757935.478763:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478779:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478788:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478799:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.478804:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478811:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478886:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917182dd1c00) 00010000:00010000:2.0:1782757935.478889:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757935.478894:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.478900:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da1f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757935.481629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757935.481701:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196687616 00000100:00100000:1.0:1782757935.481710:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196687616 00000100:00100000:1.0:1782757935.481761:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 754 00000100:00100000:1.0:1782757935.481771:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46415:x1869355196687616:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782757935.481855:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757935.481879:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da1fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648e6 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.481899:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782757935.481908:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757935.481951:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.481975:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.481985:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757935.482113:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ea67079 reply state 000000007f0c2ede transno 4294967588 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757935.482123:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782757935.482205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46415:x1869355196687616:12345-192.168.204.31@tcp:36:touch.0 Request processed in 434us (584us total) trans 4294967588 rc 0/0 00000100:00100000:1.0:1782757935.482213:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 754 00010000:00010000:1.0:1782757935.485121:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485140:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485148:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485154:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757935.485160:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485169:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485186:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782757935.485191:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757935.485196:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757935.485202:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da20a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757935.491466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757935.491747:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196687744 00000100:00100000:3.0:1782757935.491756:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196687744 00000100:00100000:3.0:1782757935.491817:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 755 00000100:00100000:3.0:1782757935.491848:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46415:x1869355196687744:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757935.491872:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757935.491896:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da211 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648ed expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.491966:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da211 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ed expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.491983:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da211 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ed expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.492002:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782757935.492005:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782757935.492009:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782757935.492071:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46415:x1869355196687744:12345-192.168.204.31@tcp:101:touch.0 Request processed in 225us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757935.492082:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 755 00000100:00100000:0.0:1782757935.511356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757935.511461:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196687872 00000100:00100000:2.0:1782757935.511472:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196687872 00000100:00100000:2.0:1782757935.511530:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 411 00000100:00100000:2.0:1782757935.511541:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196687872:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:2.0:1782757935.512051:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196687872:12345-192.168.204.31@tcp:2:touch.0 Request processed in 510us (704us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1782757935.512060:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 411 00000100:00100000:1.0:1782757935.517675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757935.517765:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196688128 00000100:00100000:3.0:1782757935.517775:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196688128 00000100:00100000:3.0:1782757935.517876:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:3.0:1782757935.517887:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46415:x1869355196688128:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782757935.518250:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46415:x1869355196688128:12345-192.168.204.31@tcp:35:touch.0 Request processed in 364us (582us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1782757935.518258:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:0.0:1782757935.607678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757935.607759:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196688256 00000100:00100000:3.0:1782757935.607770:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196688256 00000100:00100000:3.0:1782757935.607931:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 756 00000100:00100000:3.0:1782757935.607943:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46419:x1869355196688256:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782757935.607976:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757935.607997:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608064:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608080:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608103:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608120:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608132:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608137:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608240:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608249:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608256:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757935.608409:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 0 00000004:00200000:3.0:1782757935.608414:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757935.608435:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608447:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608455:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608461:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608468:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608479:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.608483:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608491:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608502:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757935.608506:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757935.608511:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608517:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da21f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608532:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608537:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608543:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608549:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.608552:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608558:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608570:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917191f75700) 00010000:00010000:3.0:1782757935.608572:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757935.608575:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608580:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608610:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648f4 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608624:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648f4 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.608631:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782757935.608632:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757935.608635:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757935.609492:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46419:x1869355196688256:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1546us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757935.609503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 756 00000100:00100000:0.0:1782757935.612092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757935.612649:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196688384 00000100:00100000:2.0:1782757935.612660:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196688384 00000100:00100000:2.0:1782757935.612757:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 412 00000100:00100000:2.0:1782757935.612768:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196688384:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782757935.612791:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757935.612815:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf648fb expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782757935.612872:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x6a42ba2e, atime: 0x6a42ba2e, ctime: 0x6a42ba2e, blocks: 0x1 00010000:00010000:2.0:1782757935.612893:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=2004s v=(0 0) 00010000:00010000:2.0:1782757935.612898:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757935.612907:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.612928:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.612943:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782757935.613013:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196688384:12345-192.168.204.31@tcp:101:rm.0 Request processed in 246us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757935.613020:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 412 00000100:00100000:1.0:1782757935.615931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757935.616035:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196688640 00000100:00100000:3.0:1782757935.616044:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196688640 00000100:00100000:3.0:1782757935.616093:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 757 00000100:00100000:3.0:1782757935.616103:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46419:x1869355196688640:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782757935.616155:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757935.616184:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da22d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648f4 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616211:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da211 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648ed expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616222:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782757935.616233:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757935.616254:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616267:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616291:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616305:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616312:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616319:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616432:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616440:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.616448:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782757935.617004:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:3.0:1782757935.617015:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2004020191965ns, next at 2005020189625ns, rc = 0 00010000:00010000:3.0:1782757935.617072:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617082:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617090:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617099:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617106:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617112:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617133:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782757935.617154:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617161:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617167:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617173:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.617179:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617186:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617196:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782757935.617199:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757935.617202:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617208:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da249 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617225:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617230:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617235:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617240:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757935.617242:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617248:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617255:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782757935.617258:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757935.617261:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617267:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da23b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757935.617275:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb10851d reply state 000000008ed51597 transno 4294967590 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757935.617284:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782757935.617369:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46419:x1869355196688640:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1265us (1445us total) trans 4294967590 rc 0/0 00000100:00100000:3.0:1782757935.617378:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 757 00010000:00010000:3.0:1782757935.617408:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757935.617413:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617419:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757935.617422:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617429:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617438:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782757935.617440:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782757935.617443:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617448:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da250 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757935.617464:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757935.617466:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757935.617467:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757935.628593:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628612:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628621:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628627:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757935.628631:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628642:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628659:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917191f75b00) 00010000:00010000:2.0:1782757935.628662:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757935.628665:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.628670:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757935.660084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757936.049812:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211541888:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.049923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.049986:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211542400:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.050040:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782757936.050046:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211542272:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.050101:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211542016:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.050142:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211542528:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.050181:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757936.050186:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211542144:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.050241:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542400 00000100:00100000:0.0:1782757936.050248:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542400 00000100:00100000:0.0:1782757936.050294:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542016 00000100:00100000:0.0:1782757936.050297:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542016 00000100:00100000:0.0:1782757936.050317:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542144 00000100:00100000:0.0:1782757936.050319:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542144 00000100:00100000:0.0:1782757936.050335:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1782757936.050342:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211542400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050392:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211542400:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.050399:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1782757936.050419:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782757936.050425:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211542016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050455:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211542016:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.050460:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782757936.050471:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1782757936.050477:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211542144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050501:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211542144:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.050506:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1782757936.050524:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542272 00000100:00100000:0.0:1782757936.050528:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542272 00000100:00100000:0.0:1782757936.050551:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542528 00000100:00100000:0.0:1782757936.050553:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542528 00000100:00100000:0.0:1782757936.050574:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1782757936.050579:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211542272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050612:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211542272:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.050619:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1782757936.050629:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1782757936.050636:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211542528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050661:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211542528:12345-0@lo:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.050667:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1782757936.050718:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211542144:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050730:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211542016:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050738:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211542528:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050764:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211542272:0@lo:400:kworker.0 00000100:00100000:0.0:1782757936.050774:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211542400:0@lo:400:kworker.0 00000100:00080000:2.0:1782757936.057920:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782757936.057928:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757936.057932:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757936.057970:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211541888 00000100:00100000:2.0:1782757936.057982:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211541888 00000100:00100000:2.0:1782757936.058043:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1782757936.058053:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211541888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757936.058163:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211541888:12345-0@lo:400:kworker.0 Request processed in 112us (8240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757936.058171:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1782757936.062214:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211541888:0@lo:400:kworker.0 00000001:00080000:3.0:1782757936.123770:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000100:00100000:1.0:1782757936.557557:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757936.557582:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211542656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757936.557658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757936.557764:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542656 00000100:00100000:2.0:1782757936.557774:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542656 00000100:00100000:2.0:1782757936.557845:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1782757936.557854:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211542656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757936.557892:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757936.557965:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211542656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757936.557972:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1782757936.558020:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211542656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782757936.687181:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757936.759960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757936.760085:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196688768 00000100:00100000:0.0:1782757936.760096:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196688768 00000100:00100000:0.0:1782757936.760178:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 758 00000100:00100000:0.0:1782757936.760190:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46434:x1869355196688768:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782757936.760215:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757936.760257:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64902 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782757936.760316:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782757936.760321:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.760335:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.760346:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757936.760407:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:0.0:1782757936.760411:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757936.760436:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.760463:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64902 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.760481:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64902 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.760490:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:0.0:1782757936.760493:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757936.760497:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757936.760565:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46434:x1869355196688768:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 377us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.760574:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 758 00000100:00100000:3.0:1782757936.771731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757936.771965:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689024 00000100:00100000:0.0:1782757936.771976:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689024 00000100:00100000:0.0:1782757936.772043:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 759 00000100:00100000:0.0:1782757936.772054:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46434:x1869355196689024:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757936.772109:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757936.772144:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da25e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64902 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.772167:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da1e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648df expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.772179:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75800) 00010000:00010000:0.0:1782757936.772190:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757936.772215:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.772227:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.772237:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757936.844664:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef9045f0 reply state 00000000e791facc transno 4294967591 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.844682:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757936.844845:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:0.0:1782757936.844963:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46434:x1869355196689024:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 72906us (73235us total) trans 4294967591 rc 0/0 00000100:00100000:0.0:1782757936.844972:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 759 00000001:00080000:0.0:1782757936.845019:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967591 is committed 00000004:00080000:0.0:1782757936.845037:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00010000:00010000:0.0:1782757936.845060:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845068:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845085:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845091:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757936.845096:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845103:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845117:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782757936.845120:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757936.845124:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845129:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da265 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.845241:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211542784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782757936.845460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757936.845536:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211542784 00000100:00100000:0.0:1782757936.845543:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211542784 00000100:00100000:0.0:1782757936.845581:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1782757936.845590:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211542784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757936.845614:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00010000:00010000:0.0:1782757936.845635:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845653:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845661:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782757936.845665:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757936.845669:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845693:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.845706:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 5 pid: 6597 timeout: 2105 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.845718:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211542912:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757936.845757:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198c80e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782757936.860640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757936.860789:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211542912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782757936.860853:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757936.860887:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689152 00000100:00100000:1.0:1782757936.860894:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689152 00010000:00010000:1.0:1782757936.860949:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 6 pid: 6597 timeout: 2105 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757936.860988:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 365 00000100:00100000:1.0:1782757936.860998:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196689152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757936.861013:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757936.861019:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 6 pid: 6597 timeout: 2105 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.861031:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 6 pid: 6597 timeout: 2105 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.861056:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777da234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648fb expref: 6 pid: 6597 timeout: 2105 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.861071:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757936.861075:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782757936.861081:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.861090:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.861120:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757936.861163:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757936.861169:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196689152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 172us (539us total) trans 0 rc 0/0 00010000:00010000:0.0:1782757936.861173:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757936.861177:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 365 00010000:00010000:0.0:1782757936.861183:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.861190:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.861224:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782757936.861867:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211542784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16275us (16404us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1782757936.861875:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000004:00080000:3.0:1782757936.861876:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171bbac0a80/2, rc 0, transno 4294967343 00000100:00100000:3.0:1782757936.861882:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211542784:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782757936.861994:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782757936.862001:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.862011:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782757936.862016:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.862025:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.862046:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.862054:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aae561ec/0xdd99f5c4777da26c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757936.862084:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757936.862088:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782757936.862090:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757936.906680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757936.909528:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689280 00000100:00100000:0.0:1782757936.909543:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689280 00000100:00100000:0.0:1782757936.909616:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 760 00000100:00100000:0.0:1782757936.909628:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46438:x1869355196689280:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782757936.909655:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757936.909675:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64909 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909736:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909752:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909763:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909777:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909784:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.909790:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910257:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910267:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910678:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757936.910776:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:0.0:1782757936.910780:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757936.910893:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910906:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910917:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910923:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910937:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757936.910942:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910949:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910962:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782757936.910965:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757936.910970:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910986:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da27a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.910998:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911004:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911009:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911014:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757936.911017:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911023:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911030:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff91718bcfda00) 00010000:00010000:0.0:1782757936.911032:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757936.911035:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911040:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911074:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64909 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911086:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64909 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.911093:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782757936.911095:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782757936.911097:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525a00, rc 0) 00000100:00100000:0.0:1782757936.911171:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46438:x1869355196689280:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1545us (4500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.911180:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 760 00000100:00100000:1.0:1782757936.929569:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757936.932089:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689536 00000100:00100000:3.0:1782757936.932107:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689536 00000100:00100000:3.0:1782757936.932176:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 761 00000100:00100000:3.0:1782757936.932186:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46438:x1869355196689536:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782757936.932209:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757936.932229:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da28f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64910 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932607:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932623:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932634:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932647:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932659:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.932666:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782757936.933510:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:3.0:1782757936.933805:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da2a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933849:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933860:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933899:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933906:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933914:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933920:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757936.933924:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933950:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933967:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:3.0:1782757936.933970:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757936.933975:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.933980:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757936.933993:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f947742 reply state 000000001e89dc5f transno 4294967592 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757936.934002:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757936.934039:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da28f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64910 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.934053:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64910 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757936.934060:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782757936.934063:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757936.934065:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782757936.934154:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46438:x1869355196689536:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1968us (4596us total) trans 4294967592 rc 0/0 00000100:00100000:3.0:1782757936.934163:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 761 00000100:00100000:0.0:1782757936.944570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782757936.944601:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944619:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944627:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944634:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757936.944639:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944647:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944664:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917191f75100) 00010000:00010000:0.0:1782757936.944667:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757936.944672:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944678:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da29d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.944714:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689792 00000100:00100000:0.0:1782757936.944724:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689792 00000100:00100000:0.0:1782757936.944776:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 762 00000100:00100000:0.0:1782757936.944787:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46438:x1869355196689792:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782757936.944872:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757936.944889:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da2a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64910 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944904:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:0.0:1782757936.944910:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757936.944961:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944974:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.944983:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757936.945135:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a9cb8dd reply state 0000000090b367d4 transno 4294967593 ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.945144:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782757936.945253:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46438:x1869355196689792:12345-192.168.204.31@tcp:36:touch.0 Request processed in 468us (693us total) trans 4294967593 rc 0/0 00000100:00100000:0.0:1782757936.945260:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 762 00000100:00100000:3.0:1782757936.956734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782757936.957876:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957890:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957897:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957903:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757936.957908:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957916:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957941:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782757936.957945:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757936.957950:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.957955:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757936.958018:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196689920 00000100:00100000:0.0:1782757936.958029:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196689920 00000100:00100000:0.0:1782757936.958088:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 763 00000100:00100000:0.0:1782757936.958097:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46438:x1869355196689920:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782757936.958127:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757936.958150:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da2b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64917 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.958213:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64917 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.958227:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64917 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757936.958245:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782757936.958260:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782757936.958263:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525c00, rc 0) 00000100:00100000:0.0:1782757936.958331:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46438:x1869355196689920:12345-192.168.204.31@tcp:101:touch.0 Request processed in 233us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757936.958339:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 763 00000100:00100000:0.0:1782757936.974880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757936.975217:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690048 00000100:00100000:3.0:1782757936.975228:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690048 00000100:00100000:3.0:1782757936.975298:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 414 00000100:00100000:3.0:1782757936.975311:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196690048:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:3.0:1782757936.975687:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196690048:12345-192.168.204.31@tcp:2:touch.0 Request processed in 378us (816us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1782757936.975695:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 414 00000100:00100000:3.0:1782757936.986853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757936.987987:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690304 00000100:00100000:1.0:1782757936.987999:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690304 00000100:00100000:1.0:1782757936.988232:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:1.0:1782757936.988245:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46438:x1869355196690304:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782757936.988715:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46438:x1869355196690304:12345-192.168.204.31@tcp:35:touch.0 Request processed in 470us (1899us total) trans 4294967594 rc 0/0 00000100:00100000:1.0:1782757936.988725:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:3.0:1782757937.075078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757937.076048:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690432 00000100:00100000:0.0:1782757937.076061:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690432 00000100:00100000:0.0:1782757937.076196:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 764 00000100:00100000:0.0:1782757937.076208:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46442:x1869355196690432:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757937.076314:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757937.076341:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6491e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076414:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076429:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076441:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076462:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076470:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076477:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076672:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076681:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076688:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757937.076722:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3f:0x0]: returning size 0 00000004:00200000:0.0:1782757937.076727:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757937.076747:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076759:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076768:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076773:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076779:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076785:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757937.076789:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076796:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076808:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782757937.076811:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757937.076816:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076846:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525600/0xdd99f5c4777da2c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076861:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076867:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076872:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076877:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181525e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757937.076879:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076884:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076890:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfda00) 00010000:00010000:0.0:1782757937.076893:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757937.076895:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.076900:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525e00/0xdd99f5c4777da2ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.077010:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525400/0xdd99f5c4777da2c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6491e expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.077025:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6491e expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.077032:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782757937.077034:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757937.077036:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181525200, rc 0) 00000100:00100000:0.0:1782757937.077180:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46442:x1869355196690432:12345-192.168.204.31@tcp:101:rm.0 Request processed in 972us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757937.077188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 764 00000100:00100000:3.0:1782757937.081540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757937.082050:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690560 00000100:00100000:0.0:1782757937.082061:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690560 00000100:00100000:0.0:1782757937.082156:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 415 00000100:00100000:0.0:1782757937.082167:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196690560:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757937.082187:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757937.082228:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64925 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782757937.082266:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x6a42ba30, atime: 0x6a42ba30, ctime: 0x6a42ba30, blocks: 0x1 00010000:00010000:0.0:1782757937.082285:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=2005s v=(0 0) 00010000:00010000:0.0:1782757937.082289:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757937.082298:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.082317:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.082337:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782757937.082397:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196690560:12345-192.168.204.31@tcp:101:rm.0 Request processed in 232us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757937.082405:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 415 00000100:00080000:2.0:1782757937.083087:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757937.086019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757937.086259:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690816 00000100:00100000:0.0:1782757937.086269:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690816 00000100:00100000:0.0:1782757937.086345:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 765 00000100:00100000:0.0:1782757937.086357:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46442:x1869355196690816:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782757937.086417:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757937.086448:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525200/0xdd99f5c4777da2d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6491e expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086471:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525c00/0xdd99f5c4777da2b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64917 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086482:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782757937.086497:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757937.086523:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086538:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086547:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086561:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086698:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086706:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086872:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086881:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.086889:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782757937.088267:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:0.0:1782757937.088280:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2005491456857ns, next at 2006491454083ns, rc = 0 00010000:00010000:0.0:1782757937.088344:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088357:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088367:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088376:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088382:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088393:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088486:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782757937.088513:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088519:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088526:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088532:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757937.088536:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088545:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088556:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782757937.088559:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782757937.088573:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088580:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da2f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088597:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088616:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088622:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088627:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757937.088630:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088636:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088645:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782757937.088647:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757937.088649:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757937.088654:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da2e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757937.088665:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af28b1d3 reply state 000000006f581be8 transno 4294967595 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757937.088674:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782757937.088787:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46442:x1869355196690816:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2428us (2774us total) trans 4294967595 rc 0/0 00000100:00100000:0.0:1782757937.088796:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 765 00010000:00010000:2.0:1782757937.089808:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757937.089819:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.089838:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757937.089842:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.089849:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.089863:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:2.0:1782757937.089866:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782757937.089870:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.089875:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da2f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.089894:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757937.089895:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757937.089897:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757937.093129:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093147:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093155:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093161:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757937.093165:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093174:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093191:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfda00) 00010000:00010000:2.0:1782757937.093194:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757937.093199:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757937.093206:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da2ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757937.709012:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757938.094692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757938.094800:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196690944 00000100:00100000:1.0:1782757938.094810:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196690944 00000100:00100000:1.0:1782757938.094919:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 766 00000100:00100000:1.0:1782757938.094931:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46456:x1869355196690944:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782757938.094955:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782757938.094975:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6492c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095043:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095057:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095070:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757938.095140:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:1.0:1782757938.095145:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782757938.095169:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095195:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6492c expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095215:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6492c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757938.095224:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:1.0:1782757938.095227:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782757938.095231:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782757938.095289:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46456:x1869355196690944:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 361us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757938.095296:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 766 00000100:00080000:2.0:1782757938.095395:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757938.101236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.101309:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691200 00000100:00100000:3.0:1782757938.101319:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691200 00000100:00100000:3.0:1782757938.101384:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 767 00000100:00100000:3.0:1782757938.101395:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46456:x1869355196691200:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757938.101453:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757938.101485:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6492c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.101509:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181525a00/0xdd99f5c4777da288 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64909 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.101522:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:3.0:1782757938.101536:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757938.101563:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.101574:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.101589:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757938.101883:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d5d40a9 reply state 000000008cc7a309 transno 4294967596 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757938.101893:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757938.101917:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:3.0:1782757938.102010:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46456:x1869355196691200:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 617us (800us total) trans 4294967596 rc 0/0 00000100:00100000:3.0:1782757938.102017:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 767 00010000:00010000:0.0:1782757938.104466:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104486:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104493:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104499:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757938.104504:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104512:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104537:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782757938.104540:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782757938.104545:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757938.104551:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da30d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757938.272363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757938.272630:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691328 00000100:00100000:2.0:1782757938.272641:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691328 00000100:00100000:2.0:1782757938.272703:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 768 00000100:00100000:2.0:1782757938.272714:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691328:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757938.272819:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691328:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 107us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757938.273362:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 768 00000100:00100000:3.0:1782757938.275678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757938.279414:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691456 00000100:00100000:0.0:1782757938.279433:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691456 00000100:00100000:0.0:1782757938.279530:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 416 00000100:00100000:0.0:1782757938.279541:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46469:x1869355196691456:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757938.280063:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46469:x1869355196691456:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 522us (4392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757938.280072:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 416 00000100:00100000:3.0:1782757938.285476:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757938.285621:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691584 00000100:00100000:0.0:1782757938.285631:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691584 00000100:00080000:2.0:1782757938.285702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757938.285707:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 417 00000100:00100000:0.0:1782757938.285717:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46469:x1869355196691584:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757938.286197:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46469:x1869355196691584:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 477us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757938.286205:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 417 00000100:00100000:3.0:1782757938.287740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757938.287809:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691712 00000100:00100000:2.0:1782757938.287842:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691712 00000100:00100000:2.0:1782757938.287914:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 769 00000100:00100000:2.0:1782757938.287924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691712:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757938.288636:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691712:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 710us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757938.288645:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 769 00000100:00100000:3.0:1782757938.290940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757938.291094:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691840 00000100:00100000:0.0:1782757938.291102:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691840 00000100:00100000:0.0:1782757938.291156:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 770 00000100:00100000:0.0:1782757938.291168:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691840:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757938.291306:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196691840:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 139us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757938.291315:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 770 00000100:00100000:0.0:1782757938.295807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.296167:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196691968 00000100:00100000:3.0:1782757938.296177:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196691968 00000100:00100000:3.0:1782757938.296245:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 418 00000100:00100000:3.0:1782757938.296255:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46469:x1869355196691968:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757938.297102:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46469:x1869355196691968:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 844us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757938.297113:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 418 00000100:00100000:3.0:1782757938.299778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757938.299861:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692096 00000100:00100000:0.0:1782757938.299874:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692096 00000100:00100000:0.0:1782757938.300130:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 419 00000100:00100000:0.0:1782757938.300143:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46469:x1869355196692096:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757938.300566:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46469:x1869355196692096:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 425us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757938.300574:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 419 00000100:00100000:3.0:1782757938.303028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757938.303404:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692224 00000100:00100000:1.0:1782757938.303416:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692224 00000100:00100000:1.0:1782757938.303530:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 771 00000100:00100000:1.0:1782757938.303541:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196692224:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757938.304056:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46469:x1869355196692224:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 515us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757938.304064:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 771 00000100:00100000:3.0:1782757938.369261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757938.369416:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692352 00000100:00100000:2.0:1782757938.369427:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692352 00000100:00100000:2.0:1782757938.369492:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 772 00000100:00100000:2.0:1782757938.369503:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46473:x1869355196692352:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782757938.369525:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757938.369545:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64933 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369601:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369615:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369625:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369638:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369644:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.369650:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370278:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370293:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370301:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757938.370341:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1782757938.370345:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757938.370377:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370393:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370400:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370408:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370415:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757938.370420:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370428:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370440:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782757938.370443:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757938.370449:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370455:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da31b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370470:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370476:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370482:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370486:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757938.370488:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370494:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370501:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1600) 00010000:00010000:2.0:1782757938.370503:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757938.370506:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370510:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370543:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64933 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370562:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64933 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.370569:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782757938.370572:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757938.370574:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782757938.370659:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46473:x1869355196692352:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1157us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757938.370667:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 772 00000100:00100000:0.0:1782757938.374790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757938.375163:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692608 00000100:00100000:2.0:1782757938.375176:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692608 00000100:00100000:2.0:1782757938.375245:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 773 00000100:00100000:2.0:1782757938.375257:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46473:x1869355196692608:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782757938.375289:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757938.375315:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777da330 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6493a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375478:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375495:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375507:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375522:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375530:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.375537:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782757938.377480:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:3.0:1782757938.377709:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.377998:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378014:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378058:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378066:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378072:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378077:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757938.378081:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378088:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378100:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782757938.378104:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757938.378108:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378114:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da337 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757938.378129:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d80ba607 reply state 00000000e81532d6 transno 4294967597 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757938.378142:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757938.378184:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777da330 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6493a expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378201:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6493a expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.378209:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782757938.378212:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757938.378345:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782757938.378487:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+15:46473:x1869355196692608:12345-192.168.204.31@tcp:101:dd.0 Request processed in 3232us (3707us total) trans 4294967597 rc 0/0 00000100:00100000:3.0:1782757938.378498:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 773 00000100:00100000:0.0:1782757938.384867:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.385475:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692736 00000100:00100000:3.0:1782757938.385488:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692736 00000100:00100000:3.0:1782757938.385546:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 420 00000100:00100000:3.0:1782757938.385557:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46473:x1869355196692736:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782757938.385575:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757938.385596:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64941 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782757938.385621:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782757938.385640:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=2006s v=(0 0) 00010000:00010000:3.0:1782757938.385644:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757938.385654:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.385678:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.385690:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757938.385763:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46473:x1869355196692736:12345-192.168.204.31@tcp:101:dd.0 Request processed in 208us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757938.385770:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 420 00010000:00010000:2.0:1782757938.385916:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385926:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385933:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385939:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757938.385944:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385952:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385967:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917182dd1400) 00010000:00010000:2.0:1782757938.385970:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757938.385975:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.385981:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da33e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757938.402609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.402709:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692864 00000100:00100000:3.0:1782757938.402730:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692864 00002000:00100000:3.0:1782757938.402782:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff917187968e00 x1869355196692864/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:609/0 lens 488/0 e 0 to 0 dl 1782757949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782757938.402793:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917187968e00 with x1869355196692864 ext(0->1048575) 00002000:00010000:3.0:1782757938.402800:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917187968e00 00000100:00100000:3.0:1782757938.402869:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:3.0:1782757938.402880:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196692864:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:1.0:1782757938.421724:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196692864:12345-192.168.204.31@tcp:4:dd.0 Request processed in 18835us (19114us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1782757938.421739:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00002000:00100000:1.0:1782757938.421753:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff917187968e00 x1869355196692864/t4294967344(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:609/0 lens 488/448 e 0 to 0 dl 1782757949 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782757938.421764:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917187968e00 with x1869355196692864 ext(0->1048575) 00002000:00010000:1.0:1782757938.421771:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917187968e00 00000100:00100000:0.0:1782757938.424735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757938.424857:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196692992 00000100:00100000:1.0:1782757938.424868:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196692992 00000100:00100000:1.0:1782757938.424976:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 774 00000100:00100000:1.0:1782757938.424987:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+14:46473:x1869355196692992:12345-192.168.204.31@tcp:44:dd.0 00000001:00080000:0.0:1782757938.494688:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967595 is committed 00000004:00080000:0.0:1782757938.494703:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00000001:00080000:0.0:1782757938.494739:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967597 is committed 00000100:00100000:2.0:1782757938.494991:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46473:x1869355196692992:12345-192.168.204.31@tcp:44:dd.0 Request processed in 70000us (70260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757938.495004:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 774 00000100:00100000:3.0:1782757938.495700:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757938.495720:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211543040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757938.495793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757938.495986:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543040 00000100:00100000:2.0:1782757938.495993:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543040 00000100:00100000:2.0:1782757938.496059:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1782757938.496069:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211543040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782757938.496096:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:2.0:1782757938.496120:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.496142:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.496151:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782757938.496156:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757938.496160:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.496187:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757938.496201:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 6 pid: 6599 timeout: 2106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757938.496214:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211543168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782757938.496280:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171896439c0 going to sleep for 11 seconds 00000100:00080000:3.0:1782757938.496346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757938.497592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.497664:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693120 00000100:00100000:3.0:1782757938.497672:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693120 00000100:00100000:3.0:1782757938.497714:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 422 00000100:00100000:3.0:1782757938.497722:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196693120:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:0.0:1782757938.502515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757938.504079:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211543168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782757938.504113:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757938.507424:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693248 00000100:00100000:3.0:1782757938.507440:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693248 00010000:00010000:3.0:1782757938.507487:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 2106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757938.507534:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 366 00000100:00100000:3.0:1782757938.507545:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196693248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782757938.507560:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757938.507565:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 2106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507579:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 2106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507603:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777da2dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64925 expref: 7 pid: 6599 timeout: 2106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507617:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757938.507621:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757938.507626:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507636:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507664:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782757938.507722:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196693248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 178us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757938.507730:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 366 00010000:00010000:3.0:1782757938.507893:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507915:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507925:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507933:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.507951:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782757938.508560:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211543040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12491us (12766us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1782757938.508569:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00010000:00010000:3.0:1782757938.508596:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757938.508602:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.508612:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757938.508617:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.508626:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.508641:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.508648:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022265a26/0xdd99f5c4777da35a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757938.508674:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757938.508676:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757938.508678:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757938.508719:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b77c6d80/2, rc 0, transno 4294967345 00000100:00100000:3.0:1782757938.508726:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211543040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757938.561251:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196693120:12345-192.168.204.31@tcp:16:dd.0 Request processed in 63515us (63651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757938.561265:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 422 00000001:00080000:3.0:1782757938.561304:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000001:00080000:3.0:1782757938.561316:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000100:00100000:0.0:1782757938.564156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757938.564300:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693504 00000100:00100000:3.0:1782757938.564310:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693504 00000100:00100000:3.0:1782757938.564373:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:3.0:1782757938.564384:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46473:x1869355196693504:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:3.0:1782757938.565226:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46473:x1869355196693504:12345-192.168.204.31@tcp:35:dd.0 Request processed in 828us (1068us total) trans 4294967598 rc 0/0 00000100:00100000:3.0:1782757938.565235:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00010000:00010000:2.0:1782757938.732398:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757939.116853:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211543296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757939.116941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757939.117136:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543296 00000100:00100000:1.0:1782757939.117144:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543296 00000100:00100000:1.0:1782757939.117203:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1782757939.117213:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211543296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757939.117250:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757939.117312:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211543296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757939.117320:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1782757939.117412:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211543296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782757939.756203:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782757939.965314:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967598 is committed 00000100:00100000:0.0:1782757940.405650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757940.405702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757940.405737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757940.405788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757940.405876:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693888 00000100:00100000:0.0:1782757940.405887:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693888 00000100:00100000:0.0:1782757940.405945:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694016 00000100:00100000:0.0:1782757940.405948:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694016 00000100:00100000:0.0:1782757940.405969:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:0.0:1782757940.405979:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196693888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757940.406051:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196693888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757940.406059:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:0.0:1782757940.406075:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:0.0:1782757940.406081:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196694016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757940.406104:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196694016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757940.406110:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00080000:0.0:1782757940.406125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757940.406129:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757940.406298:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693632 00000100:00100000:1.0:1782757940.406303:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693632 00000100:00100000:1.0:1782757940.406338:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00100000:1.0:1782757940.406345:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196693632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757940.406375:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196693632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757940.406382:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00100000:2.0:1782757940.406469:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196693760 00000100:00100000:2.0:1782757940.406473:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196693760 00000100:00100000:2.0:1782757940.406516:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000100:00100000:2.0:1782757940.406522:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196693760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757940.406555:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196693760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757940.406561:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000100:00080000:1.0:1782757940.406644:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782757940.781049:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782757941.158474:0:79834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2009561647890ns, next at 2006491454083ns, rc = 0 00000004:00080000:0.0:1782757941.158649:0:79834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2009561825660ns, next at 2005020189625ns, rc = 0 00000004:00080000:3.0:1782757941.162146:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000004:00080000:3.0:1782757941.162294:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000100:00100000:0.0:1782757941.168615:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211543424:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.168695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.168748:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211543936:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.168774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.168801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757941.168808:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211543808:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.168868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.168895:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211543552:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.168919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.168937:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211544064:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.168957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.168972:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782757941.168977:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211543680:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757941.169046:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543424 00000100:00100000:0.0:1782757941.169053:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543424 00000100:00100000:0.0:1782757941.169100:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1782757941.169108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211543424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169311:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211543424:12345-0@lo:400:kworker.0 Request processed in 51us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169320:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1782757941.169364:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543936 00000100:00100000:0.0:1782757941.169368:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543936 00000100:00100000:0.0:1782757941.169402:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543552 00000100:00100000:0.0:1782757941.169405:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543552 00000100:00100000:0.0:1782757941.169421:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543680 00000100:00100000:0.0:1782757941.169424:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543680 00000100:00100000:0.0:1782757941.169437:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1782757941.169443:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211543936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169476:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211543936:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169482:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1782757941.169494:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1782757941.169500:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211543552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169531:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211543552:12345-0@lo:400:kworker.0 Request processed in 32us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169536:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1782757941.169547:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1782757941.169553:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211543680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169576:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211543680:12345-0@lo:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169581:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1782757941.169597:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211543808 00000100:00100000:0.0:1782757941.169599:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211543808 00000100:00100000:0.0:1782757941.169621:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544064 00000100:00100000:0.0:1782757941.169623:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544064 00000100:00100000:0.0:1782757941.169638:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1782757941.169644:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211543808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169670:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211543808:12345-0@lo:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169675:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1782757941.169683:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1782757941.169689:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211544064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169709:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211544064:12345-0@lo:400:kworker.0 Request processed in 20us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757941.169714:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:0.0:1782757941.169739:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757941.169742:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757941.169745:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757941.169782:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211543680:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169791:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211543552:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.169798:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1782757941.169803:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171bbac0a80, transno 4294967343 00000100:00100000:0.0:1782757941.169813:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211544064:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.170339:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211543808:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.170351:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211543424:0@lo:400:kworker.0 00000100:00100000:0.0:1782757941.170362:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211543936:0@lo:400:kworker.0 00000001:00080000:1.0:1782757941.243324:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000001:00080000:1.0:1782757941.243338:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000100:00100000:1.0:1782757941.677996:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757941.678020:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211544192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757941.678104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757941.678276:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544192 00000100:00100000:3.0:1782757941.678286:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544192 00000100:00100000:3.0:1782757941.678353:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1782757941.678363:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211544192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757941.678403:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782757941.678458:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211544192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757941.678467:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1782757941.678628:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211544192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757941.804948:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757942.575307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757942.575394:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694144 00000100:00100000:3.0:1782757942.575405:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694144 00000100:00100000:3.0:1782757942.575481:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 775 00000100:00100000:3.0:1782757942.575492:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694144:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757942.575581:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694144:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757942.575588:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 775 00000100:00080000:0.0:1782757942.575685:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757942.584596:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757942.584699:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694272 00000100:00100000:3.0:1782757942.584710:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694272 00000100:00100000:3.0:1782757942.584788:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 423 00000100:00100000:3.0:1782757942.584798:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46666:x1869355196694272:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757942.585209:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46666:x1869355196694272:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 412us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757942.585217:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 423 00000100:00080000:1.0:1782757942.585717:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757942.588360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757942.589855:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694400 00000100:00100000:1.0:1782757942.589870:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694400 00000100:00100000:1.0:1782757942.589948:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 424 00000100:00100000:1.0:1782757942.589960:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46666:x1869355196694400:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782757942.590370:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46666:x1869355196694400:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 411us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757942.590378:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 424 00000100:00080000:0.0:1782757942.590576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757942.597494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757942.597625:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694528 00000100:00100000:2.0:1782757942.597635:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694528 00000100:00100000:2.0:1782757942.597699:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 776 00000100:00100000:2.0:1782757942.597710:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694528:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757942.598272:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694528:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 563us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757942.598280:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 776 00000100:00100000:2.0:1782757942.605997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757942.606071:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694656 00000100:00100000:1.0:1782757942.606081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694656 00000100:00100000:1.0:1782757942.606151:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 777 00000100:00100000:1.0:1782757942.606162:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694656:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782757942.606258:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196694656:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757942.606266:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 777 00000100:00100000:1.0:1782757942.609369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757942.609441:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694784 00000100:00100000:3.0:1782757942.609450:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694784 00000100:00100000:3.0:1782757942.609506:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 425 00000100:00100000:3.0:1782757942.609516:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46666:x1869355196694784:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782757942.609918:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46666:x1869355196694784:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 401us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757942.609926:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 425 00000100:00100000:1.0:1782757942.612449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757942.612525:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196694912 00000100:00100000:2.0:1782757942.612536:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196694912 00000100:00100000:2.0:1782757942.612586:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 426 00000100:00100000:2.0:1782757942.612595:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46666:x1869355196694912:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757942.612993:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46666:x1869355196694912:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 397us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757942.613001:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 426 00000100:00100000:2.0:1782757942.617582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757942.617658:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695040 00000100:00100000:0.0:1782757942.617669:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695040 00000100:00100000:0.0:1782757942.617739:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 778 00000100:00100000:0.0:1782757942.617750:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196695040:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757942.619234:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46666:x1869355196695040:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1479us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757942.619250:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 778 00000100:00100000:1.0:1782757942.688030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757942.690515:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695296 00000100:00100000:0.0:1782757942.690530:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695296 00000100:00100000:0.0:1782757942.690630:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 779 00000100:00100000:0.0:1782757942.690641:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46670:x1869355196695296:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782757942.690694:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757942.690726:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6493a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690744:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff917191f75700) 00010000:00010000:0.0:1782757942.690759:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757942.690782:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690796:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690805:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690842:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690851:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.690857:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.691299:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.691309:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.691317:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782757942.692181:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:0.0:1782757942.692192:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2011095368730ns, next at 2012095366750ns, rc = 0 00010000:00010000:0.0:1782757942.692286:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692298:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692308:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692461:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692469:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692475:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692497:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782757942.692521:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692527:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692534:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692539:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757942.692543:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692550:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692561:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782757942.692565:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782757942.692569:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692575:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da36f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692591:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692598:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692604:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692610:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757942.692612:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692615:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757942.692622:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692622:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692628:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782757942.692630:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782757942.692632:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692633:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757942.692636:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692639:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.692642:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777da361 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692647:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:3.0:1782757942.692649:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:0.0:1782757942.692651:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c4d7707 reply state 000000005269d030 transno 4294967599 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692652:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757942.692657:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da376 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757942.692661:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757942.692670:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757942.692672:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757942.692673:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757942.692796:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46670:x1869355196695296:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2152us (4781us total) trans 4294967599 rc 0/0 00000100:00100000:0.0:1782757942.692805:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 779 00010000:00010000:0.0:1782757942.696779:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.696793:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.696799:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.696803:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757942.696806:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.696857:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.698352:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfdc00) 00010000:00010000:0.0:1782757942.698356:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757942.698362:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757942.698370:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da368 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757942.829644:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757943.856085:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757944.236981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782757944.237008:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211544320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757944.237092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757944.237159:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544320 00000100:00100000:3.0:1782757944.237169:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544320 00000100:00100000:3.0:1782757944.237243:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1782757944.237254:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211544320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757944.237296:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757944.237347:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211544320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757944.237355:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00080000:1.0:1782757944.237370:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757944.237396:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:3.0:1782757944.237402:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b77c6d80, transno 4294967345 00000100:00100000:3.0:1782757944.237428:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211544320:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782757944.861338:0:79980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2013264513054ns, next at 2006491454083ns, rc = 0 00000004:00080000:0.0:1782757944.861457:0:79980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2013264634019ns, next at 2012095366750ns, rc = 0 00010000:00010000:0.0:1782757944.876928:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782757944.920292:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000004:00080000:3.0:1782757944.920321:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00000001:00080000:3.0:1782757944.920340:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967599 is committed 00000004:00080000:3.0:1782757944.920344:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000100:00100000:3.0:1782757944.921318:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211544448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782757944.921392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757944.921623:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544448 00000100:00100000:0.0:1782757944.921632:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544448 00000100:00100000:0.0:1782757944.921716:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1782757944.921726:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211544448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782757944.921754:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00010000:00010000:0.0:1782757944.921791:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757944.921811:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757944.921820:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1782757944.921842:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757944.921847:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757944.921878:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757944.921892:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 5 pid: 6597 timeout: 2113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757944.921904:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211544576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757944.921963:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9fd80 going to sleep for 11 seconds 00000100:00080000:1.0:1782757944.922267:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757944.939484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757944.940872:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695424 00000100:00100000:1.0:1782757944.940884:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695424 00010000:00010000:1.0:1782757944.940946:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 6 pid: 6597 timeout: 2113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757944.941002:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00100000:1.0:1782757944.941013:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196695424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782757944.941030:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782757944.941036:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 6 pid: 6597 timeout: 2113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.941051:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 6 pid: 6597 timeout: 2113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.941079:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782757944.941093:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782757944.941100:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.941110:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.941133:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782757944.941198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196695424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 187us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757944.941206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00080000:0.0:1782757944.941997:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782757944.943678:0:9120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777da353 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64941 expref: 5 pid: 6597 timeout: 2113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757944.943703:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211544576:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782757944.943741:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.943906:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.943915:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.943926:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.943934:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757944.943960:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782757944.944894:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211544448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23166us (23497us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1782757944.944909:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1782757944.945032:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757944.945041:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757944.945054:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757944.945059:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757944.945070:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757944.945192:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757944.945201:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057554fd1/0xdd99f5c4777da37d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757944.945221:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757944.945223:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757944.945236:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782757944.950011:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91708365b800/2, rc 0, transno 4294967345 00000100:00100000:0.0:1782757944.955724:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211544448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782757945.531002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757945.531061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757945.531099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757945.531100:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695552 00000100:00100000:2.0:1782757945.531110:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695552 00000100:00100000:0.0:1782757945.531122:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695808 00000100:00100000:0.0:1782757945.531125:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695808 00000100:00100000:2.0:1782757945.531158:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1149 00000100:00100000:0.0:1782757945.531158:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1061 00000100:00100000:2.0:1782757945.531168:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196695552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757945.531170:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196695808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757945.531247:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196695808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757945.531255:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1061 00000100:00080000:0.0:1782757945.531277:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757945.533373:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695680 00000100:00100000:1.0:1782757945.533387:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695680 00000100:00100000:1.0:1782757945.533461:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1412 00000100:00100000:1.0:1782757945.533471:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196695680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757945.535354:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196695552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4176us (4281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757945.535370:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1149 00000100:00080000:3.0:1782757945.536140:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757945.539224:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196695680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5744us (8223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757945.539240:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1412 00010000:00010000:0.0:1782757945.906376:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757946.285907:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211544960:0@lo:400:kworker.0 00000100:00100000:3.0:1782757946.285978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757946.286030:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757946.286036:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545088:0@lo:400:kworker.0 00000100:00100000:3.0:1782757946.286059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757946.286089:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544960 00000100:00100000:3.0:1782757946.286097:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544960 00000100:00100000:3.0:1782757946.286152:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1782757946.286161:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211544960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286286:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211544704:0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757946.286339:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211545216:0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757946.286371:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782757946.286375:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211544832:0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757946.286403:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211545344:0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757946.286442:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545088 00000100:00100000:1.0:1782757946.286445:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545088 00000100:00100000:1.0:1782757946.286468:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545344 00000100:00100000:1.0:1782757946.286470:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545344 00000100:00100000:1.0:1782757946.286484:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1782757946.286490:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286535:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211545088:12345-0@lo:400:kworker.0 Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757946.286542:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1782757946.286561:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1782757946.286566:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211545344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286595:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211545344:12345-0@lo:400:kworker.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757946.286601:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1782757946.286637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211545344:0@lo:400:kworker.0 00000100:00100000:1.0:1782757946.286681:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545088:0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.286853:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544704 00000100:00100000:0.0:1782757946.286858:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544704 00000100:00100000:0.0:1782757946.286896:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1782757946.286903:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.286948:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211544704:12345-0@lo:400:kworker.0 Request processed in 45us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757946.286954:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1782757946.286981:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545216 00000100:00100000:0.0:1782757946.286984:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545216 00000100:00100000:0.0:1782757946.287005:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211544832 00000100:00100000:0.0:1782757946.287007:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211544832 00000100:00100000:0.0:1782757946.287018:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1782757946.287023:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211545216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.287050:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211545216:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757946.287055:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1782757946.287066:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1782757946.287073:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.287099:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211544832:12345-0@lo:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757946.287105:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1782757946.287140:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211544832:0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.287148:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211544704:0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.287157:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211545216:0@lo:400:kworker.0 00000100:00100000:3.0:1782757946.287331:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211544960:12345-0@lo:400:kworker.0 Request processed in 1171us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757946.287338:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:3.0:1782757946.287361:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757946.287365:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757946.287367:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757946.287759:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211544960:0@lo:400:kworker.0 00000100:00100000:0.0:1782757946.797859:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757946.797962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757946.798210:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545472 00000100:00100000:2.0:1782757946.798218:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545472 00000100:00100000:2.0:1782757946.798289:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1782757946.798299:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211545472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757946.798342:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782757946.798407:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211545472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757946.798414:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1782757946.798891:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757946.925546:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782757947.865859:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00010000:00010000:3.0:1782757947.949938:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757948.972060:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757949.356322:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757949.356350:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757949.356431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757949.356815:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545600 00000100:00100000:3.0:1782757949.356854:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545600 00000100:00100000:3.0:1782757949.356922:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1782757949.356932:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211545600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757949.356984:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757949.357045:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211545600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757949.357053:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1782757949.357116:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211545600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757949.357137:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782757950.001009:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757950.645217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757950.645262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757950.645287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757950.645312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757950.645346:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196695936 00000100:00100000:3.0:1782757950.645352:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696320 00000100:00100000:3.0:1782757950.645356:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696320 00000100:00100000:0.0:1782757950.645356:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196695936 00000100:00100000:3.0:1782757950.645399:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696192 00000100:00100000:3.0:1782757950.645402:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696192 00000100:00100000:0.0:1782757950.645403:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00100000:0.0:1782757950.645411:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196695936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757950.645420:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00100000:3.0:1782757950.645426:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196696320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757950.645478:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196696320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757950.645486:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00100000:3.0:1782757950.645501:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1065 00000100:00100000:3.0:1782757950.645506:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196696192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757950.645517:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696064 00000100:00100000:1.0:1782757950.645521:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696064 00000100:00100000:1.0:1782757950.648439:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1416 00000100:00100000:1.0:1782757950.648460:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196696064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757950.649762:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196695936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4344us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757950.650711:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00080000:0.0:1782757950.652285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757950.652294:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757950.652297:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757950.653315:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196696064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4861us (8106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757950.653330:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1416 00000100:00100000:3.0:1782757950.653893:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196696192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 7671us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757950.653908:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1065 00010000:00010000:3.0:1782757951.020153:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757951.405097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757951.410947:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211545856:0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.411047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757951.411139:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211545728:0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.411176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757951.411445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545728 00000100:00100000:0.0:1782757951.411455:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545728 00000100:00100000:0.0:1782757951.411519:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1782757951.411529:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757951.411602:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211545728:12345-0@lo:400:kworker.0 Request processed in 74us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757951.411613:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1782757951.411682:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211545728:0@lo:400:kworker.0 00000100:00100000:3.0:1782757951.411767:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545856 00000100:00100000:3.0:1782757951.411772:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545856 00000100:00100000:3.0:1782757951.411848:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1782757951.411856:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757951.411900:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211545856:12345-0@lo:400:kworker.0 Request processed in 46us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757951.411907:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1782757951.411999:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211545856:0@lo:400:kworker.0 00000100:00100000:2.0:1782757951.412401:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211545984:0@lo:400:kworker.0 00000100:00100000:2.0:1782757951.412437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757951.412484:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757951.412491:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546112:0@lo:400:kworker.0 00000100:00100000:2.0:1782757951.412516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757951.412614:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211546240:0@lo:400:kworker.0 00000100:00100000:3.0:1782757951.412643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757951.412677:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782757951.412683:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211546368:0@lo:400:kworker.0 00000100:00100000:3.0:1782757951.412706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757951.412793:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546112 00000100:00100000:0.0:1782757951.412798:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546112 00000100:00100000:0.0:1782757951.412858:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546368 00000100:00100000:0.0:1782757951.412862:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546368 00000100:00100000:0.0:1782757951.412881:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1782757951.412888:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757951.412931:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546112:12345-0@lo:400:kworker.0 Request processed in 44us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757951.412938:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1782757951.412952:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1782757951.412969:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211546368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757951.413001:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211546368:12345-0@lo:400:kworker.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757951.413007:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1782757951.413040:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546112:0@lo:400:kworker.0 00000100:00080000:3.0:1782757951.413250:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757951.413255:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757951.413276:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:3.0:1782757951.413282:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91708365b800, transno 4294967345 00000100:00100000:3.0:1782757951.413301:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211546368:0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.413467:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211545984 00000100:00100000:1.0:1782757951.413472:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211545984 00000100:00100000:1.0:1782757951.413515:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546240 00000100:00100000:1.0:1782757951.413518:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546240 00000100:00100000:1.0:1782757951.413540:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1782757951.413547:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.413592:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211545984:12345-0@lo:400:kworker.0 Request processed in 45us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757951.413598:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1782757951.413614:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1782757951.413620:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211546240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.413662:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211546240:12345-0@lo:400:kworker.0 Request processed in 42us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757951.413668:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1782757951.413701:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211545984:0@lo:400:kworker.0 00000100:00100000:1.0:1782757951.413729:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211546240:0@lo:400:kworker.0 00000100:00080000:3.0:1782757951.413798:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757951.916174:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757951.916270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757951.916544:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546496 00000100:00100000:3.0:1782757951.916553:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546496 00000100:00100000:3.0:1782757951.916606:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1782757951.916616:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757951.916681:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757951.916748:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757951.916756:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1782757951.916870:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782757952.044853:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757953.069749:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757954.092393:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757954.476263:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757954.477204:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757954.477366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757954.477674:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546624 00000100:00100000:3.0:1782757954.477685:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546624 00000100:00100000:3.0:1782757954.477809:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1782757954.477842:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757954.477883:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782757954.479156:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757954.480787:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211546624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757954.481806:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211546624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3982us (4435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757954.481819:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00010000:00010000:0.0:1782757955.116187:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757955.765663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757955.765735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757955.765775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757955.765810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757955.765883:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696704 00000100:00100000:0.0:1782757955.765904:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696704 00000100:00100000:0.0:1782757955.765965:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696832 00000100:00100000:0.0:1782757955.765968:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696832 00000100:00100000:0.0:1782757955.765994:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1068 00000100:00100000:0.0:1782757955.766006:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196696704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757955.766090:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196696704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757955.766098:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1068 00000100:00100000:0.0:1782757955.766119:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1069 00000100:00100000:0.0:1782757955.766125:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196696832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757955.766152:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196696832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757955.766158:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1069 00000100:00080000:0.0:1782757955.766176:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757955.766179:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757955.766771:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696448 00000100:00100000:2.0:1782757955.766779:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696448 00000100:00100000:2.0:1782757955.766853:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1153 00000100:00100000:2.0:1782757955.766861:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196696448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757955.767030:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196696448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 169us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757955.767322:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1153 00000100:00100000:3.0:1782757955.767573:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696576 00000100:00100000:3.0:1782757955.767579:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696576 00000100:00100000:3.0:1782757955.767638:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1420 00000100:00100000:3.0:1782757955.767647:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196696576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757955.767794:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196696576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 148us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757955.767802:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1420 00000100:00080000:2.0:1782757955.768492:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757956.140335:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757956.524115:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211547136:0@lo:400:kworker.0 00000100:00100000:2.0:1782757956.524203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757956.524322:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211547008:0@lo:400:kworker.0 00000100:00100000:1.0:1782757956.526424:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211546752:0@lo:400:kworker.0 00000100:00100000:0.0:1782757956.526618:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211546880:0@lo:400:kworker.0 00000100:00100000:2.0:1782757956.526883:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547136 00000100:00100000:2.0:1782757956.526893:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547136 00000100:00100000:2.0:1782757956.526956:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1782757956.526966:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211547136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757956.528645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782757956.528859:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757956.529018:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547008 00000100:00100000:3.0:1782757956.529026:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547008 00000100:00100000:3.0:1782757956.529074:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1782757956.529084:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211547008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757956.529144:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211547008:12345-0@lo:400:kworker.0 Request processed in 61us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757956.529151:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00080000:3.0:1782757956.529368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757956.529402:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211547008:0@lo:400:kworker.0 00000100:00100000:1.0:1782757956.529427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757956.529473:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211547264:0@lo:400:kworker.0 00000100:00100000:3.0:1782757956.529478:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546752 00000100:00100000:3.0:1782757956.529483:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546752 00000100:00100000:1.0:1782757956.529516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757956.529561:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547264 00000100:00100000:1.0:1782757956.529566:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547264 00000100:00100000:3.0:1782757956.529600:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1782757956.529600:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1782757956.529614:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211547264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757956.529618:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211546752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757956.529670:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211547264:12345-0@lo:400:kworker.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757956.529677:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1782757956.529714:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211547264:0@lo:400:kworker.0 00000100:00100000:3.0:1782757956.529728:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211546752:12345-0@lo:400:kworker.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757956.529737:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1782757956.529749:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211546752:0@lo:400:kworker.0 00000100:00080000:3.0:1782757956.529768:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757956.538315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757956.538380:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211547392:0@lo:400:kworker.0 00000100:00100000:0.0:1782757956.538425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757956.538471:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211546880 00000100:00100000:3.0:1782757956.538481:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211546880 00000100:00100000:3.0:1782757956.538566:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1782757956.538578:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211546880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757956.538592:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547392 00000100:00100000:1.0:1782757956.538599:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547392 00000100:00100000:3.0:1782757956.538641:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211546880:12345-0@lo:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757956.538649:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1782757956.539103:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1782757956.539111:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211547392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757956.539158:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211547392:12345-0@lo:400:kworker.0 Request processed in 48us (732us total) trans 0 rc 0/0 00000100:00080000:3.0:1782757956.539159:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757956.539168:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1782757956.539280:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211546880:0@lo:400:kworker.0 00000100:00100000:0.0:1782757956.544817:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211547136:0@lo:400:kworker.0 00000100:00100000:2.0:1782757956.546813:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211547136:12345-0@lo:400:kworker.0 Request processed in 19841us (22603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757956.546946:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1782757956.547078:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211547392:0@lo:400:kworker.0 00000100:00100000:0.0:1782757957.036154:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757957.036178:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211547520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757957.036256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757957.036397:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547520 00000100:00100000:2.0:1782757957.036404:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547520 00000100:00100000:2.0:1782757957.036457:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1782757957.036465:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211547520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757957.036500:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757957.036666:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211547520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757957.036673:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1782757957.036861:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211547520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757957.164372:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757958.189298:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757959.212460:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757959.596280:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757959.596307:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211547648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757959.596385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757959.596864:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547648 00000100:00100000:3.0:1782757959.596881:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547648 00000100:00100000:3.0:1782757959.596951:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1782757959.596961:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211547648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757959.596995:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757959.597050:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211547648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757959.597056:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1782757959.597105:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211547648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757959.597234:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782757960.236255:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757960.885975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757960.886019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757960.886068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757960.886109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757960.886145:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697344 00000100:00100000:0.0:1782757960.886155:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697344 00000100:00100000:0.0:1782757960.886220:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697216 00000100:00100000:0.0:1782757960.886223:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697216 00000100:00100000:0.0:1782757960.886249:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:0.0:1782757960.886259:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196697344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757960.886337:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196697344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757960.886345:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:0.0:1782757960.886365:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1073 00000100:00100000:0.0:1782757960.886372:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196697216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757960.886642:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196696960 00000100:00100000:2.0:1782757960.886647:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196696960 00000100:00100000:2.0:1782757960.886679:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1155 00000100:00100000:2.0:1782757960.886687:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196696960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1782757960.886787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782757960.886791:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757960.886958:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697088 00000100:00100000:3.0:1782757960.886963:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697088 00000100:00100000:3.0:1782757960.887004:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1424 00000100:00100000:3.0:1782757960.887011:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196697088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757960.887079:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196697216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 706us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757960.887086:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1073 00000100:00080000:0.0:1782757960.887127:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757960.888629:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196696960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1935us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757960.888641:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1155 00000100:00100000:3.0:1782757960.899304:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196697088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 12263us (13311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757960.899323:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1424 00010000:00010000:0.0:1782757961.261218:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757961.644200:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211548160:0@lo:400:kworker.0 00000100:00100000:0.0:1782757961.644279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757961.644353:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782757961.644359:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211548032:0@lo:400:kworker.0 00000100:00100000:0.0:1782757961.644389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757961.644427:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548032 00000100:00100000:0.0:1782757961.644434:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548032 00000100:00100000:0.0:1782757961.644501:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1782757961.644515:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757961.644569:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211548032:12345-0@lo:400:kworker.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757961.644577:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:0.0:1782757961.644599:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757961.644610:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548160 00000100:00100000:0.0:1782757961.644614:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548160 00000100:00100000:0.0:1782757961.644644:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1782757961.644650:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211548160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757961.644682:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211548160:12345-0@lo:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757961.644688:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00080000:0.0:1782757961.644706:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757961.644734:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211548032:0@lo:400:kworker.0 00000100:00100000:0.0:1782757961.644744:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211548160:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645321:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211547904:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757961.645392:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211548416:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757961.645443:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782757961.645460:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211547776:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757961.645511:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211548288:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757961.645561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547776 00000100:00100000:2.0:1782757961.645566:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547776 00000100:00100000:2.0:1782757961.645599:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1782757961.645606:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211547776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645647:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211547776:12345-0@lo:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757961.645653:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1782757961.645681:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211547904 00000100:00100000:2.0:1782757961.645685:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211547904 00000100:00100000:2.0:1782757961.645703:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548288 00000100:00100000:2.0:1782757961.645706:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548288 00000100:00100000:2.0:1782757961.645730:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1782757961.645735:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211547904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645765:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211547904:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757961.645771:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1782757961.645782:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1782757961.645787:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211548288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645809:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211548288:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757961.645815:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:2.0:1782757961.645851:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757961.645871:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211547776:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645881:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211548288:0@lo:400:kworker.0 00000100:00100000:2.0:1782757961.645890:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211547904:0@lo:400:kworker.0 00000100:00100000:3.0:1782757961.646141:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548416 00000100:00100000:3.0:1782757961.646146:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548416 00000100:00100000:3.0:1782757961.646192:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1782757961.646200:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211548416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757961.646247:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211548416:12345-0@lo:400:kworker.0 Request processed in 48us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757961.646253:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1782757961.646280:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211548416:0@lo:400:kworker.0 00000100:00080000:2.0:1782757961.647488:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757962.157002:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211548544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757962.157085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757962.157250:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548544 00000100:00100000:2.0:1782757962.157258:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548544 00000100:00100000:2.0:1782757962.157319:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1782757962.157329:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211548544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757962.157370:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757962.157431:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211548544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757962.157448:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1782757962.157542:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211548544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757962.284510:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757963.080677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757963.081030:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697472 00000100:00100000:3.0:1782757963.081041:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697472 00000100:00100000:3.0:1782757963.081121:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 780 00000100:00100000:3.0:1782757963.081131:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697472:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782757963.081248:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697472:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 118us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757963.081256:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 780 00000100:00080000:2.0:1782757963.082028:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757963.083173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757963.083252:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697600 00000100:00100000:0.0:1782757963.083261:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697600 00000100:00100000:0.0:1782757963.083333:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 428 00000100:00100000:0.0:1782757963.083342:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196697600:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757963.083775:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196697600:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 432us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757963.083787:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 428 00000100:00080000:2.0:1782757963.084125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757963.095446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757963.095531:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697728 00000100:00100000:3.0:1782757963.095545:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697728 00000100:00080000:2.0:1782757963.095694:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782757963.095946:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00100000:3.0:1782757963.095958:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196697728:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782757963.098514:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196697728:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2547us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757963.098527:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00100000:3.0:1782757963.101047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757963.101193:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697856 00000100:00100000:2.0:1782757963.101203:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697856 00000100:00100000:2.0:1782757963.101262:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 781 00000100:00100000:2.0:1782757963.101272:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697856:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757963.101732:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697856:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 461us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757963.102053:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 781 00000100:00100000:1.0:1782757963.106757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757963.107037:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196697984 00000100:00100000:2.0:1782757963.107046:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196697984 00000100:00100000:2.0:1782757963.107105:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 782 00000100:00100000:2.0:1782757963.107115:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697984:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782757963.107214:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196697984:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 99us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757963.107222:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 782 00000100:00100000:0.0:1782757963.130189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757963.130244:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698112 00000100:00100000:0.0:1782757963.130253:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698112 00000100:00100000:0.0:1782757963.130302:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 430 00000100:00100000:0.0:1782757963.130311:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196698112:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757963.130696:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196698112:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 384us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757963.130704:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 430 00000100:00100000:1.0:1782757963.140763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757963.140870:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698240 00000100:00100000:0.0:1782757963.140881:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698240 00000100:00100000:0.0:1782757963.140939:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 431 00000100:00100000:0.0:1782757963.140950:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196698240:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782757963.141391:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46929:x1869355196698240:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 442us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757963.141400:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 431 00000100:00100000:1.0:1782757963.147123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757963.147208:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698368 00000100:00100000:0.0:1782757963.147217:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698368 00000100:00100000:0.0:1782757963.147276:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 783 00000100:00100000:0.0:1782757963.147286:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196698368:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782757963.147711:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46929:x1869355196698368:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 426us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757963.147720:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 783 00010000:00010000:2.0:1782757963.311537:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757964.336669:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757964.716692:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757964.716719:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211548672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757964.716794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757964.716912:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548672 00000100:00100000:3.0:1782757964.716920:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548672 00000100:00100000:3.0:1782757964.716980:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1782757964.716990:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211548672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757964.717026:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757964.717085:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211548672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757964.717093:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00080000:3.0:1782757964.717113:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757964.717146:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211548672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757964.718403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757964.718802:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698496 00000100:00100000:3.0:1782757964.718811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698496 00000100:00100000:3.0:1782757964.718892:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 784 00000100:00100000:3.0:1782757964.718903:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46943:x1869355196698496:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782757964.718925:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757964.718945:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64948 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719035:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719051:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719065:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757964.719300:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1782757964.719306:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757964.719398:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719428:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64948 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719446:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64948 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.719455:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782757964.719457:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757964.719461:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782757964.719534:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46943:x1869355196698496:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 632us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757964.719544:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 784 00000100:00100000:3.0:1782757964.723687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757964.724174:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698752 00000100:00100000:0.0:1782757964.724194:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698752 00000100:00100000:0.0:1782757964.724269:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 785 00000100:00100000:0.0:1782757964.724281:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46943:x1869355196698752:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782757964.724344:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782757964.724376:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da38b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64948 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.724411:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da329 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64933 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.724423:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:0.0:1782757964.724435:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757964.724464:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.724477:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.724487:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782757964.782650:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967600 is committed 00000004:00010000:0.0:1782757964.782955:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a560246 reply state 00000000e75a226e transno 4294967600 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757964.782968:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782757964.783265:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00080000:0.0:1782757964.783433:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782757964.783455:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46943:x1869355196698752:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 59173us (59779us total) trans 4294967600 rc 0/0 00000100:00100000:0.0:1782757964.783465:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 785 00010000:00010000:3.0:1782757964.785945:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.785964:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.785973:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.785980:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757964.785986:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.785995:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.786016:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:3.0:1782757964.786019:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782757964.786024:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.786031:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757964.884219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757964.884473:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196698880 00000100:00100000:2.0:1782757964.884484:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196698880 00000100:00100000:2.0:1782757964.884547:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 786 00000100:00100000:2.0:1782757964.884557:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46947:x1869355196698880:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757964.884581:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757964.884602:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6494f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884676:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884691:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884852:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884869:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884876:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.884881:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885459:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885469:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885481:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757964.885556:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1782757964.885561:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757964.885642:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885655:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885661:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885668:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885674:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757964.885678:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.885685:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886461:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782757964.886468:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757964.886476:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886484:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da3a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886506:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886513:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886519:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886525:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757964.886530:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886536:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886546:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1600) 00010000:00010000:2.0:1782757964.886548:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757964.886551:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886556:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da3a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886597:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6494f expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886611:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6494f expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.886623:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782757964.886625:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757964.886627:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782757964.886800:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46947:x1869355196698880:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2242us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757964.886809:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 786 00000100:00100000:1.0:1782757964.891230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757964.891307:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196699136 00000100:00100000:0.0:1782757964.891319:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196699136 00000100:00100000:0.0:1782757964.891418:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 787 00000100:00100000:0.0:1782757964.891429:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46947:x1869355196699136:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782757964.891453:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757964.891475:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da3b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64956 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891876:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891893:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891905:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891918:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891925:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.891933:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782757964.892810:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:3.0:1782757964.897331:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897357:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897370:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897436:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897445:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897452:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897459:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757964.897464:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897472:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897486:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:3.0:1782757964.897489:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757964.897494:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.897501:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da3bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757964.897518:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082a0c6e2 reply state 00000000ac0ed5fd transno 4294967601 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757964.897527:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782757964.899015:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da3b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64956 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.899052:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64956 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.899130:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782757964.899133:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782757964.899136:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:2.0:1782757964.902278:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46947:x1869355196699136:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 10836us (11047us total) trans 4294967601 rc 0/0 00000100:00100000:2.0:1782757964.902291:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 787 00010000:00010000:3.0:1782757964.908495:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908568:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908577:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908584:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757964.908590:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908598:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908618:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfd900) 00010000:00010000:3.0:1782757964.908621:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757964.908626:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757964.908633:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777da3c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757964.914284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757964.914369:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196699392 00000100:00100000:0.0:1782757964.914392:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196699392 00000100:00100000:0.0:1782757964.914460:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 788 00000100:00100000:0.0:1782757964.914472:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46947:x1869355196699392:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:0.0:1782757964.914539:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757964.914572:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64956 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.914591:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917191f75d00) 00010000:00010000:0.0:1782757964.914602:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782757964.914653:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.914667:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.914677:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757964.914848:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea468148 reply state 000000003dbd256b transno 4294967602 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757964.914857:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782757964.914963:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46947:x1869355196699392:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 493us (916us total) trans 4294967602 rc 0/0 00000100:00100000:0.0:1782757964.914970:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 788 00010000:00010000:0.0:1782757964.920319:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920340:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920349:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920361:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757964.920366:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920375:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920404:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782757964.920408:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757964.920413:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757964.920419:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757964.927756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757964.927878:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196699520 00000100:00100000:2.0:1782757964.927888:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196699520 00000100:00100000:2.0:1782757964.927951:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 789 00000100:00100000:2.0:1782757964.927963:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:46947:x1869355196699520:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782757964.927988:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757964.928015:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da3df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6495d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.928077:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da3df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6495d expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.928092:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da3df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6495d expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757964.928112:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782757964.928116:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782757964.928120:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782757964.928181:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46947:x1869355196699520:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 221us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757964.928188:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 789 00000100:00100000:2.0:1782757964.939697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757964.939939:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196699648 00000100:00100000:0.0:1782757964.939950:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196699648 00000100:00100000:0.0:1782757964.940017:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 432 00000100:00100000:0.0:1782757964.940027:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196699648:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:0.0:1782757964.940398:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196699648:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 370us (710us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1782757964.940406:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 432 00000100:00100000:3.0:1782757964.949704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757964.951479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196699904 00000100:00100000:1.0:1782757964.951493:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196699904 00000100:00100000:1.0:1782757964.951565:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:1.0:1782757964.951575:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:46947:x1869355196699904:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:1.0:1782757964.951985:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46947:x1869355196699904:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 410us (2291us total) trans 4294967603 rc 0/0 00000100:00100000:1.0:1782757964.951993:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:2.0:1782757965.023479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757965.023703:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700032 00000100:00100000:0.0:1782757965.023716:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700032 00000100:00100000:0.0:1782757965.023811:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 790 00000100:00100000:0.0:1782757965.023860:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46951:x1869355196700032:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:0.0:1782757965.023887:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757965.023908:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64964 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.023978:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.023994:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024008:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024024:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024031:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024038:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024145:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024153:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024160:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757965.024197:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x41:0x0]: returning size 0 00000004:00200000:0.0:1782757965.024201:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757965.024222:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024234:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024243:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024249:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024255:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024261:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757965.024266:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024273:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024287:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:0.0:1782757965.024291:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757965.024296:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024301:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da3ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024317:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024322:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024328:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024333:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757965.024335:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024340:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024346:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfd700) 00010000:00010000:0.0:1782757965.024348:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757965.024351:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024356:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da3f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024395:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da3e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64964 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024409:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64964 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.024417:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917182dd1600) 00010000:00010000:0.0:1782757965.024419:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757965.024422:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782757965.024502:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46951:x1869355196700032:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 681us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757965.024513:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 790 00000100:00080000:3.0:1782757965.024775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757965.033087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757965.033719:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700160 00000100:00100000:0.0:1782757965.033729:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700160 00000100:00100000:0.0:1782757965.033868:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 433 00000100:00100000:0.0:1782757965.034227:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196700160:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:0.0:1782757965.034249:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757965.034270:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6496b expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782757965.034314:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x6a42ba4c, atime: 0x6a42ba4c, ctime: 0x6a42ba4c, blocks: 0x1 00010000:00010000:0.0:1782757965.034336:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1782757965.034342:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757965.034352:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.034372:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757965.034668:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00080000:3.0:1782757965.034855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757965.035176:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196700160:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 1295us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757965.035186:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 433 00000100:00100000:3.0:1782757965.046271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757965.051681:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700416 00000100:00100000:2.0:1782757965.051699:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700416 00000100:00100000:2.0:1782757965.051867:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 791 00000100:00100000:2.0:1782757965.051889:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46951:x1869355196700416:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782757965.051943:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782757965.051970:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64964 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.051996:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da3df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6495d expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052006:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782757965.052019:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757965.052044:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052058:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052068:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052087:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052093:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052100:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052219:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052228:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.052236:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782757965.056239:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:2.0:1782757965.056259:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2033459436245ns, next at 2034459432762ns, rc = 0 00010000:00010000:2.0:1782757965.058119:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058143:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058154:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058163:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058174:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058181:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058213:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757965.058240:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058248:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058255:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058261:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757965.058267:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.058275:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062182:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757965.062199:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062211:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757965.062216:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062228:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062248:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:3.0:1782757965.062251:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782757965.062257:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062263:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da41e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.062499:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757965.062501:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757965.062504:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757965.062611:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782757965.062614:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782757965.062618:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062625:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da417 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062664:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062673:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062680:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062686:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757965.062690:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062696:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062704:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782757965.062706:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757965.062709:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.062716:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da409 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782757965.062726:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097f02c55 reply state 0000000010c149e4 transno 4294967604 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757965.062736:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782757965.063484:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46951:x1869355196700416:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 11602us (17218us total) trans 4294967604 rc 0/0 00000100:00100000:2.0:1782757965.063496:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 791 00010000:00010000:3.0:1782757965.072359:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072388:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072397:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072403:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757965.072408:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072416:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072433:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917182dd1500) 00010000:00010000:3.0:1782757965.072437:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757965.072441:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757965.072448:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757965.364134:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757966.004385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757966.004435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757966.004470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757966.004506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757966.004531:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700672 00000100:00100000:3.0:1782757966.004536:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700928 00000100:00100000:3.0:1782757966.004545:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700928 00000100:00100000:2.0:1782757966.004545:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700672 00000100:00100000:3.0:1782757966.004598:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700800 00000100:00100000:3.0:1782757966.004602:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700800 00000100:00100000:2.0:1782757966.004612:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00100000:2.0:1782757966.004624:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:2364:x1869355196700672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757966.004723:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:2364:x1869355196700672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757966.004732:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00100000:3.0:1782757966.005100:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1076 00000100:00100000:3.0:1782757966.005108:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196700928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757966.005143:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196700928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.005150:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1076 00000100:00100000:3.0:1782757966.005163:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00100000:3.0:1782757966.005169:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196700800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757966.005193:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196700800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.005198:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00080000:3.0:1782757966.005218:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757966.005358:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196700544 00000100:00100000:1.0:1782757966.005376:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196700544 00000100:00100000:1.0:1782757966.005419:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1157 00000100:00100000:1.0:1782757966.005426:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196700544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757966.005455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196700544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757966.005462:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1157 00000100:00100000:2.0:1782757966.288213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757966.288298:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701056 00000100:00100000:3.0:1782757966.288308:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701056 00000100:00100000:3.0:1782757966.288376:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 792 00000100:00100000:3.0:1782757966.288386:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:46966:x1869355196701056:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782757966.288409:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757966.288427:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64972 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288495:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288509:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288523:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757966.288581:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1782757966.288586:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757966.288608:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288632:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64972 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288648:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64972 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.288657:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:3.0:1782757966.288660:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782757966.288663:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782757966.288729:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46966:x1869355196701056:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 345us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.288736:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 792 00000100:00100000:3.0:1782757966.315132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757966.315278:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701312 00000100:00100000:1.0:1782757966.315287:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701312 00000100:00100000:1.0:1782757966.315341:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 793 00000100:00100000:1.0:1782757966.315350:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:46966:x1869355196701312:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782757966.315425:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782757966.315455:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da42c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64972 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.315478:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da3ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6494f expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.315487:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1000) 00010000:00010000:1.0:1782757966.315498:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757966.315521:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.315532:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.315540:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.380619:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782757966.393399:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967602 is committed 00000001:00080000:3.0:1782757966.393427:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967605 is committed 00000004:00080000:3.0:1782757966.393440:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000004:00010000:1.0:1782757966.393618:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f14baf09 reply state 000000000e82936f transno 4294967605 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757966.393633:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782757966.393816:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:3.0:1782757966.393995:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782757966.394016:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211548800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782757966.394096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.394256:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211548800 00000100:00100000:0.0:1782757966.394266:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211548800 00000100:00100000:0.0:1782757966.394331:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1782757966.394344:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211548800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782757966.394382:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00010000:00010000:0.0:1782757966.394405:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757966.394437:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757966.394447:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782757966.394451:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782757966.394456:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757966.394486:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757966.394500:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 6 pid: 9120 timeout: 2134 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757966.394512:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211548928:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782757966.394586:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0f84b40 going to sleep for 11 seconds 00010000:00080000:0.0:1782757966.394611:0:5803:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782757966.394631:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46966:x1869355196701312:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 79281us (79509us total) trans 4294967605 rc 0/0 00000100:00100000:0.0:1782757966.394639:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 793 00010000:00010000:1.0:1782757966.395012:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395023:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395030:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395035:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757966.395040:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395047:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395064:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782757966.395068:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782757966.395072:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.395079:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da433 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782757966.395346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757966.401184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757966.401735:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701440 00000100:00100000:2.0:1782757966.401746:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701440 00010000:00010000:2.0:1782757966.401800:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 7 pid: 9120 timeout: 2134 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757966.401861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 368 00000100:00100000:2.0:1782757966.401873:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196701440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782757966.401901:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757966.401908:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 7 pid: 9120 timeout: 2134 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.401924:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 7 pid: 9120 timeout: 2134 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.401950:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757966.401954:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782757966.401960:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.401975:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.401996:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757966.402048:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196701440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 178us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757966.402057:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 368 00010000:00010000:1.0:1782757966.402154:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060dd62a6/0xdd99f5c4777da402 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6496b expref: 6 pid: 9120 timeout: 2134 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757966.402168:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211548928:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782757966.402201:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.402213:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.402220:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.402232:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.402245:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757966.402268:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782757966.403000:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211548800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8658us (8901us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1782757966.403008:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000004:00080000:3.0:1782757966.403222:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917083658a80/2, rc 0, transno 4294967347 00000100:00100000:3.0:1782757966.403229:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211548800:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782757966.404408:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757966.404419:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.404432:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757966.404437:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.404448:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.404468:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.404475:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031a19c1f/0xdd99f5c4777da43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757966.404509:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757966.404512:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757966.404513:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757966.467577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757966.471021:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701568 00000100:00100000:3.0:1782757966.471039:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701568 00000100:00100000:3.0:1782757966.471102:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 794 00000100:00100000:3.0:1782757966.471112:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46970:x1869355196701568:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782757966.471140:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757966.471161:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64979 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471237:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471251:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471261:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471285:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471292:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471298:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471749:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471758:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.471766:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782757966.471873:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1782757966.471878:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782757966.478454:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478478:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478486:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478493:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478499:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757966.478505:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478512:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478529:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782757966.478532:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757966.478537:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478543:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478556:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478562:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478573:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478578:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757966.478580:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478586:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478593:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917191f75a00) 00010000:00010000:3.0:1782757966.478596:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757966.478599:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478604:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da44f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478644:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64979 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478657:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64979 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757966.478664:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782757966.478666:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782757966.478668:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782757966.478747:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46970:x1869355196701568:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 7635us (11179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.478760:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 794 00000100:00100000:0.0:1782757966.770963:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211549440:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.771056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.771131:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782757966.771137:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211549056:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.771166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.771191:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211549568:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.771216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.771241:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211549312:0@lo:400:kworker.0 00000100:00100000:2.0:1782757966.773696:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549440 00000100:00100000:2.0:1782757966.773716:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549440 00000100:00100000:2.0:1782757966.773800:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1782757966.773811:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211549440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757966.773930:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211549440:12345-0@lo:400:kworker.0 Request processed in 121us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757966.773947:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1782757966.774569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.774616:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782757966.774628:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211549184:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.774655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.774675:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211549696:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.774697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757966.774730:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549056 00000100:00100000:0.0:1782757966.774736:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549056 00000100:00100000:0.0:1782757966.774772:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1782757966.774779:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211549056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.774813:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211549056:12345-0@lo:400:kworker.0 Request processed in 35us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757966.774842:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1782757966.774873:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549568 00000100:00100000:0.0:1782757966.774877:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549568 00000100:00100000:0.0:1782757966.774903:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549312 00000100:00100000:0.0:1782757966.774906:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549312 00000100:00100000:0.0:1782757966.774923:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549184 00000100:00100000:0.0:1782757966.774925:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549184 00000100:00100000:3.0:1782757966.775157:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549696 00000100:00100000:3.0:1782757966.775164:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549696 00000100:00100000:3.0:1782757966.775193:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1782757966.775199:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757966.775242:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211549696:12345-0@lo:400:kworker.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.775260:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:3.0:1782757966.775278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757966.775282:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757966.775365:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1782757966.775385:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211549568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.775437:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211549568:12345-0@lo:400:kworker.0 Request processed in 64us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.783207:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1782757966.783559:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1782757966.783602:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1782757966.783617:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211549184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.783717:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211549184:12345-0@lo:400:kworker.0 Request processed in 107us (9060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757966.783724:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1782757966.783776:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211549056:0@lo:400:kworker.0 00000100:00100000:1.0:1782757966.784261:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211549184:0@lo:400:kworker.0 00000100:00100000:3.0:1782757966.785058:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211549312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757966.785124:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211549312:12345-0@lo:400:kworker.0 Request processed in 1904us (10556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757966.785132:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1782757966.787831:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211549568:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.788208:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211549440:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.788299:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211549696:0@lo:400:kworker.0 00000100:00100000:0.0:1782757966.788314:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211549312:0@lo:400:kworker.0 00000100:00100000:0.0:1782757967.277609:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211549824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757967.277678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757967.277751:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549824 00000100:00100000:0.0:1782757967.277759:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549824 00000100:00100000:0.0:1782757967.277801:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1782757967.277809:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211549824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782757967.277870:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757967.277915:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211549824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757967.277926:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1782757967.277967:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211549824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782757967.407937:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757967.622908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757967.622998:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701696 00000100:00100000:0.0:1782757967.623009:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701696 00000100:00100000:0.0:1782757967.623087:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 795 00000100:00100000:0.0:1782757967.623098:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46984:x1869355196701696:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782757967.623120:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757967.623143:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64980 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623205:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623219:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623232:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757967.623452:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:0.0:1782757967.623456:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757967.623531:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623559:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64980 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623576:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64980 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.623592:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75300) 00010000:00010000:0.0:1782757967.623595:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757967.623599:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782757967.623669:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46984:x1869355196701696:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 573us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757967.623677:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 795 00000100:00080000:3.0:1782757967.624161:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757967.637167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.637235:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196701952 00000100:00100000:3.0:1782757967.637245:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196701952 00000100:00100000:3.0:1782757967.637308:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 796 00000100:00100000:3.0:1782757967.637319:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46984:x1869355196701952:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782757967.637381:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782757967.637411:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64980 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.637435:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64979 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.637445:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782757967.637454:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757967.637479:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.637492:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.637502:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757967.638230:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022f0b084 reply state 0000000002b9f1db transno 4294967606 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757967.638244:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782757967.638310:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:3.0:1782757967.638432:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:46984:x1869355196701952:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 1113us (1270us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1782757967.638441:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 796 00010000:00010000:2.0:1782757967.651386:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651404:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651412:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651419:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757967.651425:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651433:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651453:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917191f75a00) 00010000:00010000:2.0:1782757967.651456:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782757967.651460:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.651471:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da46b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757967.785609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.785687:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702080 00000100:00100000:3.0:1782757967.785698:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702080 00000100:00100000:3.0:1782757967.785774:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 797 00000100:00100000:3.0:1782757967.785784:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702080:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757967.785933:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702080:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757967.785945:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 797 00000100:00100000:1.0:1782757967.788308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757967.788396:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702208 00000100:00100000:2.0:1782757967.788407:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702208 00000100:00100000:2.0:1782757967.788504:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 435 00000100:00100000:2.0:1782757967.788514:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46996:x1869355196702208:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:3.0:1782757967.788669:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757967.789016:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46996:x1869355196702208:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 502us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757967.789025:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 435 00000100:00100000:0.0:1782757967.793870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.793924:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702336 00000100:00100000:3.0:1782757967.793935:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702336 00000100:00100000:3.0:1782757967.793996:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 436 00000100:00100000:3.0:1782757967.794007:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46996:x1869355196702336:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757967.794414:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46996:x1869355196702336:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 408us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757967.794422:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 436 00000100:00100000:0.0:1782757967.807967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757967.808148:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702464 00000100:00100000:2.0:1782757967.808158:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702464 00000100:00100000:2.0:1782757967.808270:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 798 00000100:00100000:2.0:1782757967.808281:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702464:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782757967.808775:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702464:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 494us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757967.808784:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 798 00000100:00100000:1.0:1782757967.819000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.821913:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702592 00000100:00100000:3.0:1782757967.821928:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702592 00000100:00100000:3.0:1782757967.822000:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 799 00000100:00100000:3.0:1782757967.822011:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702592:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757967.822124:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702592:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 115us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757967.822131:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 799 00000100:00100000:0.0:1782757967.824931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757967.825382:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702720 00000100:00100000:2.0:1782757967.825391:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702720 00000100:00100000:2.0:1782757967.825452:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 437 00000100:00100000:2.0:1782757967.825462:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46996:x1869355196702720:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782757967.825914:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:46996:x1869355196702720:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 452us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757967.825923:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 437 00000100:00100000:0.0:1782757967.827618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757967.829243:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702848 00000100:00100000:1.0:1782757967.829255:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702848 00000100:00100000:1.0:1782757967.829336:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 438 00000100:00100000:1.0:1782757967.829348:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46996:x1869355196702848:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757967.829723:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:46996:x1869355196702848:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 376us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757967.829732:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 438 00000100:00100000:1.0:1782757967.831600:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757967.831850:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196702976 00000100:00100000:0.0:1782757967.831860:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196702976 00000100:00100000:0.0:1782757967.831922:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 800 00000100:00100000:0.0:1782757967.831932:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702976:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757967.833292:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:46996:x1869355196702976:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1353us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757967.833306:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 800 00000100:00100000:0.0:1782757967.881111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757967.881269:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703104 00000100:00100000:2.0:1782757967.881280:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703104 00000100:00100000:2.0:1782757967.881351:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 801 00000100:00100000:2.0:1782757967.881363:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47000:x1869355196703104:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782757967.881384:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782757967.881405:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64987 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881467:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881482:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881493:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881507:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881514:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.881521:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882183:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882195:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882203:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782757967.882279:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1782757967.882284:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782757967.882372:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882387:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882394:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882400:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882406:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757967.882410:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882417:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882431:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782757967.882435:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757967.882440:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882447:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882460:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882472:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882477:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882482:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757967.882486:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882492:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882499:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff917182dd1600) 00010000:00010000:2.0:1782757967.882501:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757967.882504:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882511:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882542:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64987 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882555:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64987 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757967.882562:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782757967.882564:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782757967.882567:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782757967.882698:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47000:x1869355196703104:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1337us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757967.882707:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 801 00000100:00100000:2.0:1782757967.887259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.887450:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703360 00000100:00100000:3.0:1782757967.887461:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703360 00000100:00100000:3.0:1782757967.887526:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 802 00000100:00100000:3.0:1782757967.887537:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47000:x1869355196703360:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782757967.887560:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757967.887582:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da48e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6498e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888273:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888291:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888302:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888321:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888338:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.888346:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782757967.889174:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:0.0:1782757967.889434:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da4a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889447:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889456:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889492:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889501:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889508:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889515:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757967.889519:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889532:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889545:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782757967.889548:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757967.889554:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889561:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777da495 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782757967.889576:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d148c315 reply state 000000005ae6148b transno 4294967607 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757967.889586:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782757967.889623:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da48e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6498e expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889640:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6498e expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.889649:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782757967.889651:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782757967.889654:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782757967.889924:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:47000:x1869355196703360:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 2387us (2673us total) trans 4294967607 rc 0/0 00000100:00100000:0.0:1782757967.889934:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 802 00000100:00100000:1.0:1782757967.898904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782757967.899003:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899017:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899024:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899030:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782757967.899035:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899043:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899059:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff91718bcfd100) 00010000:00010000:0.0:1782757967.899062:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782757967.899065:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757967.899072:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da49c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757967.899320:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703488 00000100:00100000:3.0:1782757967.899339:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703488 00000100:00100000:3.0:1782757967.899398:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 439 00000100:00100000:3.0:1782757967.899407:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47000:x1869355196703488:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782757967.899426:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757967.899444:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64995 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782757967.899469:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782757967.899490:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=2036s v=(0 0) 00010000:00010000:3.0:1782757967.899494:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782757967.899503:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.899520:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757967.899531:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782757967.899591:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:47000:x1869355196703488:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 185us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757967.899598:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 439 00000100:00100000:2.0:1782757967.917941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757967.918030:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703616 00000100:00100000:0.0:1782757967.918039:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703616 00002000:00100000:0.0:1782757967.918094:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff917084c41f80 x1869355196703616/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:638/0 lens 488/0 e 0 to 0 dl 1782757978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1782757967.918106:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917084c41f80 with x1869355196703616 ext(0->1048575) 00002000:00010000:0.0:1782757967.918112:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917084c41f80 00000100:00100000:0.0:1782757967.918147:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1782757967.918157:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196703616:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:0.0:1782757967.932892:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196703616:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 14726us (14950us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1782757967.932907:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00002000:00100000:0.0:1782757967.932920:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff917084c41f80 x1869355196703616/t4294967346(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:638/0 lens 488/448 e 0 to 0 dl 1782757978 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1782757967.932931:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917084c41f80 with x1869355196703616 ext(0->1048575) 00002000:00010000:0.0:1782757967.932938:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917084c41f80 00000100:00100000:2.0:1782757967.936607:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757967.936813:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703744 00000100:00100000:0.0:1782757967.936845:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703744 00000100:00100000:0.0:1782757967.936951:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 803 00000100:00100000:0.0:1782757967.936962:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:47000:x1869355196703744:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:3.0:1782757967.972210:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967607 is committed 00000100:00100000:1.0:1782757967.972416:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47000:x1869355196703744:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 35449us (35813us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757967.972428:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 803 00000100:00100000:2.0:1782757967.974602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757967.974696:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196703872 00000100:00100000:3.0:1782757967.974710:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196703872 00000100:00100000:3.0:1782757967.974771:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 440 00000100:00100000:3.0:1782757967.974782:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196703872:12345-192.168.204.31@tcp:16:dd.60003 00000001:00080000:2.0:1782757968.023292:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000100:00100000:1.0:1782757968.023500:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196703872:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 48713us (48901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757968.023512:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 440 00000100:00100000:3.0:1782757968.028589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757968.028790:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704128 00000100:00100000:1.0:1782757968.028800:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704128 00000100:00100000:1.0:1782757968.028866:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:1.0:1782757968.028875:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47000:x1869355196704128:12345-192.168.204.31@tcp:35:dd.60003 00000001:00080000:1.0:1782757968.029265:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967608 00000100:00100000:1.0:1782757968.029386:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:47000:x1869355196704128:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 510us (804us total) trans 4294967609 rc 0/0 00000100:00100000:1.0:1782757968.029393:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 83 00000020:00080000:1.0:1782757968.029398:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1782757968.342257:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:2.0:1782757968.342280:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00010000:00010000:2.0:1782757968.428012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782757969.300392:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967609 is committed 00010000:00010000:2.0:1782757969.453061:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757969.836057:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211549952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782757969.836141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757969.843777:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211549952 00000100:00100000:3.0:1782757969.843794:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211549952 00000100:00100000:3.0:1782757969.843892:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1782757969.843903:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211549952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782757969.843941:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757969.844032:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211549952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (7891us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757969.844039:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1782757969.844104:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:3.0:1782757969.844110:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917083658a80, transno 4294967347 00000100:00100000:3.0:1782757969.844127:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211549952:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782757969.844314:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782757970.478023:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757970.572372:0:80443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2038975545956ns, next at 2034459432762ns, rc = 0 00000004:00080000:1.0:1782757970.572482:0:80443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2038975658339ns, next at 2012095366750ns, rc = 0 00000004:00080000:3.0:1782757970.618480:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00000004:00080000:3.0:1782757970.618497:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000100:00100000:2.0:1782757971.132594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757971.132645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757971.132678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757971.132714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757971.132758:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704512 00000100:00100000:2.0:1782757971.132768:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704512 00000100:00100000:2.0:1782757971.132845:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704640 00000100:00100000:2.0:1782757971.132848:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704640 00000100:00100000:2.0:1782757971.132874:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1080 00000100:00100000:2.0:1782757971.132883:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196704512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757971.132958:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196704512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757971.132978:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1080 00000100:00100000:2.0:1782757971.132995:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:2.0:1782757971.133001:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196704640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757971.133140:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704384 00000100:00100000:1.0:1782757971.133145:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704384 00000100:00100000:1.0:1782757971.133189:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00100000:1.0:1782757971.133196:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196704384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757971.133230:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196704384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757971.133236:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00080000:1.0:1782757971.133287:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782757971.133292:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782757971.133294:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757971.135255:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196704640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2244us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757971.135279:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:0.0:1782757971.135691:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704256 00000100:00100000:0.0:1782757971.135700:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704256 00000100:00100000:0.0:1782757971.135982:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1159 00000100:00100000:0.0:1782757971.135994:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196704256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757971.136033:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196704256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.136040:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1159 00010000:00010000:2.0:1782757971.500114:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757971.888183:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211550464:0@lo:400:kworker.0 00000100:00100000:3.0:1782757971.888280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757971.888343:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782757971.888349:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211550080:0@lo:400:kworker.0 00000100:00100000:3.0:1782757971.888378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757971.888399:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211550592:0@lo:400:kworker.0 00000100:00100000:3.0:1782757971.888422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757971.888492:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211550208:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.888520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757971.888550:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211550720:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.888581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757971.888600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757971.888605:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211550336:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.888623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757971.888654:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550080 00000100:00100000:0.0:1782757971.888662:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550080 00000100:00100000:0.0:1782757971.888710:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1782757971.888717:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211550080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.888766:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211550080:12345-0@lo:400:kworker.0 Request processed in 48us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.888772:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1782757971.888805:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550464 00000100:00100000:0.0:1782757971.888808:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550464 00000100:00100000:0.0:1782757971.888870:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550720 00000100:00100000:0.0:1782757971.888874:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550720 00000100:00100000:0.0:1782757971.888897:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1782757971.888910:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211550464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.888946:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211550464:12345-0@lo:400:kworker.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.888952:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1782757971.888963:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1782757971.888969:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211550720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889000:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211550720:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.889005:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1782757971.889021:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550592 00000100:00100000:0.0:1782757971.889024:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550592 00000100:00100000:0.0:1782757971.889046:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550208 00000100:00100000:0.0:1782757971.889049:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550208 00000100:00100000:0.0:1782757971.889063:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550336 00000100:00100000:0.0:1782757971.889065:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550336 00000100:00100000:0.0:1782757971.889079:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1782757971.889086:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211550592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211550592:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.889119:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1782757971.889131:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782757971.889136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211550208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889159:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211550208:12345-0@lo:400:kworker.0 Request processed in 23us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.889164:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782757971.889173:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1782757971.889178:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211550336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889200:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211550336:12345-0@lo:400:kworker.0 Request processed in 22us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757971.889205:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00080000:0.0:1782757971.889223:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782757971.889227:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757971.889229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757971.889282:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211550336:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889295:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211550208:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889305:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211550720:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889338:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211550080:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889350:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211550592:0@lo:400:kworker.0 00000100:00100000:0.0:1782757971.889359:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211550464:0@lo:400:kworker.0 00000100:00100000:3.0:1782757972.222312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757972.222400:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704768 00000100:00100000:0.0:1782757972.222411:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704768 00000100:00100000:0.0:1782757972.222473:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 804 00000100:00100000:0.0:1782757972.222484:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196704768:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782757972.222605:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196704768:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 122us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757972.222614:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 804 00000100:00100000:3.0:1782757972.226092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757972.226144:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196704896 00000100:00100000:0.0:1782757972.226153:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196704896 00000100:00100000:0.0:1782757972.226210:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 441 00000100:00100000:0.0:1782757972.226222:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47193:x1869355196704896:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757972.227150:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47193:x1869355196704896:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 927us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757972.227160:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 441 00000100:00100000:3.0:1782757972.231932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757972.232284:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705024 00000100:00100000:0.0:1782757972.232295:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705024 00000100:00100000:0.0:1782757972.232399:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 442 00000100:00100000:0.0:1782757972.232410:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:47193:x1869355196705024:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757972.232809:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:47193:x1869355196705024:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 400us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757972.232818:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 442 00000100:00100000:3.0:1782757972.242871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757972.246461:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705152 00000100:00100000:3.0:1782757972.246478:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705152 00000100:00100000:3.0:1782757972.246558:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 805 00000100:00100000:3.0:1782757972.246571:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705152:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757972.247003:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705152:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 434us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757972.247013:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 805 00000100:00100000:0.0:1782757972.252907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757972.253112:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705280 00000100:00100000:3.0:1782757972.253122:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705280 00000100:00100000:3.0:1782757972.253172:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 806 00000100:00100000:3.0:1782757972.253183:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705280:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757972.253305:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705280:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757972.253312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 806 00000100:00100000:0.0:1782757972.261837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757972.262140:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705408 00000100:00100000:1.0:1782757972.262151:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705408 00000100:00100000:1.0:1782757972.262200:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 443 00000100:00100000:1.0:1782757972.262211:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47193:x1869355196705408:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782757972.262999:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47193:x1869355196705408:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 786us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757972.263009:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 443 00000100:00100000:3.0:1782757972.276374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757972.276776:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705536 00000100:00100000:0.0:1782757972.276787:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705536 00000100:00100000:0.0:1782757972.277056:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 444 00000100:00100000:0.0:1782757972.277068:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:47193:x1869355196705536:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757972.277476:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:47193:x1869355196705536:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 409us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757972.277485:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 444 00000100:00100000:0.0:1782757972.288967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757972.290670:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705664 00000100:00100000:1.0:1782757972.290685:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705664 00000100:00100000:1.0:1782757972.290762:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 807 00000100:00100000:1.0:1782757972.290772:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705664:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757972.293732:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47193:x1869355196705664:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2946us (4761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757972.293748:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 807 00000100:00100000:0.0:1782757972.396180:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782757972.396209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211550848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757972.396298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757972.397057:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550848 00000100:00100000:3.0:1782757972.397067:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550848 00000100:00100000:3.0:1782757972.397128:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1782757972.397138:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211550848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757972.397183:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782757972.397269:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211550848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757972.397277:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1782757972.397391:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211550848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757972.421256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757972.421338:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196705920 00000100:00100000:3.0:1782757972.421355:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196705920 00000100:00100000:3.0:1782757972.421451:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 808 00000100:00100000:3.0:1782757972.421464:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47197:x1869355196705920:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782757972.421537:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782757972.421575:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777da4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6498e expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421596:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:3.0:1782757972.421609:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782757972.421633:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421648:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421658:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421674:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421681:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.421688:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.422412:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.422423:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.422430:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782757972.426553:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00000004:00080000:3.0:1782757972.426577:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2040829753467ns, next at 2041829749814ns, rc = 0 00010000:00010000:3.0:1782757972.426731:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.426754:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.426768:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.426789:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.426796:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.426802:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427156:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782757972.427192:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427200:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427206:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427212:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757972.427218:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427230:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427254:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782757972.427256:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782757972.427262:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427267:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da4c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427286:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427292:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427298:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427303:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782757972.427306:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427311:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427318:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782757972.427320:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782757972.427323:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757972.427333:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da4b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782757972.427342:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004187449b reply state 00000000f50b174d transno 4294967610 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757972.427352:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782757972.427467:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47197:x1869355196705920:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 6003us (6230us total) trans 4294967610 rc 0/0 00000100:00100000:3.0:1782757972.427477:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 808 00010000:00010000:2.0:1782757972.427882:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757972.427890:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.427897:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757972.427901:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.427908:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.427929:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff917191f75b00) 00010000:00010000:2.0:1782757972.427931:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782757972.427934:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.427949:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da4cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.427967:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757972.427969:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757972.427970:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757972.430535:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430553:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430560:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430566:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782757972.430571:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430578:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430592:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff917191f75100) 00010000:00010000:2.0:1782757972.430595:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782757972.430599:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.430605:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da4bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757972.524078:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757973.550952:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757974.578101:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782757974.931886:0:80589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2043335059197ns, next at 2034459432762ns, rc = 0 00000004:00080000:1.0:1782757974.932005:0:80589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2043335182329ns, next at 2041829749814ns, rc = 0 00000100:00100000:2.0:1782757974.956091:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782757974.956332:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211550976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757974.956415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757974.962152:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211550976 00000100:00100000:3.0:1782757974.962167:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211550976 00000100:00100000:3.0:1782757974.962636:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1782757974.962647:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211550976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757974.962768:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782757974.962800:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757974.964867:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211550976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2208us (8439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757974.964884:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1782757974.969263:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211550976:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782757974.998211:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00000004:00080000:3.0:1782757974.998275:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000001:00080000:3.0:1782757974.998308:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967610 is committed 00000004:00080000:3.0:1782757974.998314:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00000100:00100000:2.0:1782757974.998550:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211551104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782757974.998627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757974.998796:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551104 00000100:00100000:1.0:1782757974.998814:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551104 00000100:00100000:1.0:1782757974.998904:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1782757974.998914:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211551104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782757974.998943:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00010000:00010000:1.0:1782757974.998968:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757974.998989:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757974.999004:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782757974.999008:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782757974.999013:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757974.999041:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757974.999055:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 5 pid: 9120 timeout: 2143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757974.999066:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211551232:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782757974.999126:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26180 going to sleep for 11 seconds 00000100:00080000:1.0:1782757974.999143:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757975.011273:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211551232:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782757975.011304:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757975.011659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757975.013165:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706048 00000100:00100000:1.0:1782757975.013178:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706048 00010000:00010000:0.0:1782757975.015593:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 2143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757975.015652:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 369 00000100:00100000:0.0:1782757975.015667:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196706048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782757975.015699:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757975.015707:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 2143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757975.015721:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 2143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757975.015748:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b5e1ee/0xdd99f5c4777da4b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64995 expref: 6 pid: 9120 timeout: 2143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757975.015773:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757975.015777:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782757975.015783:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757975.015792:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757975.016112:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782757975.016170:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196706048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 508us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757975.016177:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 369 00010000:00010000:3.0:1782757975.016490:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757975.016503:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757975.016516:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757975.016525:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757975.016550:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782757975.017129:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757975.017139:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757975.017150:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757975.017156:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757975.017167:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757975.017196:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757975.017204:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777da4d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757975.017230:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757975.017232:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757975.017233:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757975.019230:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211551104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20307us (20594us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1782757975.019245:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:1.0:1782757975.020302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782757975.020475:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082d61c00/2, rc 0, transno 4294967347 00000100:00100000:0.0:1782757975.020546:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211551104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782757975.599937:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757976.244083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757976.244124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757976.244158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757976.244195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757976.244222:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706176 00000100:00100000:0.0:1782757976.244233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706176 00000100:00100000:0.0:1782757976.244284:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1161 00000100:00100000:0.0:1782757976.244294:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196706176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757976.244374:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196706176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757976.244386:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1161 00000100:00100000:0.0:1782757976.244423:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706560 00000100:00100000:0.0:1782757976.244427:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706560 00000100:00100000:0.0:1782757976.244453:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706432 00000100:00100000:0.0:1782757976.244456:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706432 00000100:00100000:0.0:1782757976.244486:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1084 00000100:00100000:0.0:1782757976.244494:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757976.244522:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757976.244529:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1084 00000100:00100000:0.0:1782757976.244542:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00100000:0.0:1782757976.244548:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757976.244572:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757976.244578:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00080000:0.0:1782757976.244729:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757976.245505:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706304 00000100:00100000:1.0:1782757976.245514:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706304 00000100:00100000:1.0:1782757976.245620:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1436 00000100:00100000:1.0:1782757976.245629:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196706304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757976.245689:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196706304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757976.245697:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1436 00000100:00080000:0.0:1782757976.251193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782757976.620060:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757977.005232:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211551616:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.005311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757977.005383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757977.005389:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211551744:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.005416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757977.005449:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551616 00000100:00100000:2.0:1782757977.005456:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551616 00000100:00100000:2.0:1782757977.005508:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1782757977.005518:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211551616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.005569:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211551616:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757977.005577:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1782757977.005618:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211551616:0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.005715:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211551360:0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.005751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757977.005785:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211551872:0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.005808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757977.005851:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782757977.005857:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211551488:0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.005877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757977.005900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551872 00000100:00100000:1.0:1782757977.005904:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551872 00000100:00100000:1.0:1782757977.005926:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551488 00000100:00100000:1.0:1782757977.005929:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551488 00000100:00100000:1.0:1782757977.005944:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1782757977.005950:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211551872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.005983:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211551872:12345-0@lo:400:kworker.0 Request processed in 32us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757977.005989:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1782757977.006004:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1782757977.006010:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211551488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.006035:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211551488:12345-0@lo:400:kworker.0 Request processed in 25us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757977.006041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1782757977.006064:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211551488:0@lo:400:kworker.0 00000100:00100000:1.0:1782757977.006074:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211551872:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.006226:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551360 00000100:00100000:2.0:1782757977.006231:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551360 00000100:00100000:2.0:1782757977.006255:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1782757977.006261:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211551360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.006297:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211551360:12345-0@lo:400:kworker.0 Request processed in 35us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757977.006304:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1782757977.006336:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211551360:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.006475:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782757977.006483:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211552000:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.006510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757977.006700:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211551744 00000100:00100000:0.0:1782757977.006705:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211551744 00000100:00100000:0.0:1782757977.006740:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552000 00000100:00100000:0.0:1782757977.006743:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552000 00000100:00100000:0.0:1782757977.006766:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1782757977.006776:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211551744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757977.006817:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211551744:12345-0@lo:400:kworker.0 Request processed in 44us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757977.006844:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1782757977.006859:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1782757977.006865:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211552000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757977.006897:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211552000:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757977.006904:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:0.0:1782757977.006918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757977.006922:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757977.006924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757977.006948:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211551744:0@lo:400:kworker.0 00000100:00100000:0.0:1782757977.006969:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211552000:0@lo:400:kworker.0 00000100:00100000:2.0:1782757977.531090:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211552128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757977.531196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757977.531281:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552128 00000100:00100000:2.0:1782757977.531289:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552128 00000100:00100000:2.0:1782757977.531335:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1782757977.531343:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211552128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757977.531385:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782757977.531432:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211552128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757977.531439:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1782757977.531494:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211552128:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1782757977.614701:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00010000:00010000:2.0:1782757977.644107:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757978.668056:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757979.695261:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757980.080228:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211552256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757980.080305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757980.080671:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552256 00000100:00100000:0.0:1782757980.080679:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552256 00000100:00100000:0.0:1782757980.080778:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1782757980.080789:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211552256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757980.080976:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757980.081037:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211552256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 249us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757980.081045:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1782757980.081189:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211552256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782757980.081240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782757980.716015:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757981.364110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757981.364157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757981.364202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757981.364210:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707072 00000100:00100000:1.0:1782757981.364222:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707072 00000100:00100000:0.0:1782757981.364228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757981.364250:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706688 00000100:00100000:0.0:1782757981.364253:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706688 00000100:00100000:1.0:1782757981.364290:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706944 00000100:00100000:1.0:1782757981.364293:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706944 00000100:00100000:0.0:1782757981.364295:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000100:00100000:0.0:1782757981.364305:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196706688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757981.364314:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1088 00000100:00100000:1.0:1782757981.364320:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196707072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757981.364387:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196706816 00000100:00100000:3.0:1782757981.364394:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196706816 00000100:00100000:3.0:1782757981.364446:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1440 00000100:00100000:3.0:1782757981.364455:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196706816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757981.364529:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196707072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 207us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757981.364926:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1088 00000100:00100000:1.0:1782757981.364954:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1089 00000100:00100000:1.0:1782757981.364962:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782757981.367745:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757981.367761:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757981.367764:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757981.368261:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196706688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 3944us (4045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757981.368277:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000100:00100000:1.0:1782757981.370082:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196706944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5099us (5831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757981.370090:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196706816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5635us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757981.370099:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1089 00000100:00100000:3.0:1782757981.370102:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1440 00010000:00010000:2.0:1782757981.740740:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757982.124079:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211552384:0@lo:400:kworker.0 00000100:00100000:0.0:1782757982.124176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757982.124352:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552384 00000100:00100000:2.0:1782757982.124354:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211552512:0@lo:400:kworker.0 00000100:00100000:1.0:1782757982.124362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552384 00000100:00100000:2.0:1782757982.124397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757982.124427:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1782757982.124438:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211552384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.124449:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552512 00000100:00100000:2.0:1782757982.124454:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552512 00000100:00100000:2.0:1782757982.124493:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1782757982.124500:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211552512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.124562:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211552512:12345-0@lo:400:kworker.0 Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.124570:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1782757982.124618:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211552512:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.133538:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211552640:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.133622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757982.133688:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552640 00000100:00100000:2.0:1782757982.133695:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552640 00000100:00100000:2.0:1782757982.133748:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1782757982.133758:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211552640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.133815:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211552640:12345-0@lo:400:kworker.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.133841:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00080000:2.0:1782757982.133867:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757982.133903:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211552640:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.133939:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211552768:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.133963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757982.133987:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552768 00000100:00100000:2.0:1782757982.133990:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552768 00000100:00100000:2.0:1782757982.134021:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1782757982.134027:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211552768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134070:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211552768:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.134076:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00080000:2.0:1782757982.134091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782757982.134106:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211552768:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134453:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782757982.134462:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211552896:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757982.134520:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211552896 00000100:00100000:2.0:1782757982.134524:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211552896 00000100:00100000:2.0:1782757982.134554:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1782757982.134561:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211552896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134812:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211552896:12345-0@lo:400:kworker.0 Request processed in 249us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.134819:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00080000:2.0:1782757982.134860:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782757982.134884:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211552896:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134915:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211553024:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.134940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757982.134966:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553024 00000100:00100000:2.0:1782757982.134970:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553024 00000100:00100000:2.0:1782757982.135002:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1782757982.135008:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211553024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.135043:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211553024:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.135060:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00080000:2.0:1782757982.135078:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782757982.135091:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1782757982.135096:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082d61c00, transno 4294967347 00000100:00100000:2.0:1782757982.135107:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211553024:0@lo:400:kworker.0 00000100:00100000:1.0:1782757982.135574:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211552384:12345-0@lo:400:kworker.0 Request processed in 11136us (11397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757982.135584:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1782757982.137100:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211552384:0@lo:400:kworker.0 00000100:00100000:2.0:1782757982.636986:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211553152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782757982.637107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757982.637218:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553152 00000100:00100000:2.0:1782757982.637230:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553152 00000100:00100000:2.0:1782757982.637294:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1782757982.637305:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211553152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757982.637361:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757982.637416:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211553152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757982.637424:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1782757982.637480:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211553152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757982.772001:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757983.788085:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757984.813340:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757985.204317:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211553280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782757985.204434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757985.209063:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553280 00000100:00100000:3.0:1782757985.209083:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553280 00000100:00100000:3.0:1782757985.209179:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1782757985.209192:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211553280:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782757985.209280:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782757985.209313:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757985.209447:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211553280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757985.209456:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1782757985.209709:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211553280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757985.836520:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757986.484819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757986.484929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757986.484979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757986.485014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757986.485057:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707328 00000100:00100000:3.0:1782757986.485072:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707328 00000100:00100000:1.0:1782757986.485077:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707200 00000100:00100000:1.0:1782757986.485096:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707200 00000100:00100000:1.0:1782757986.485182:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1165 00000100:00100000:3.0:1782757986.485184:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1444 00000100:00100000:1.0:1782757986.485206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196707200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782757986.485208:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196707328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757986.485323:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196707200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 125us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757986.485332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1165 00000100:00100000:2.0:1782757986.485345:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707456 00000100:00100000:2.0:1782757986.485349:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707456 00000100:00100000:2.0:1782757986.485384:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707584 00000100:00100000:2.0:1782757986.485386:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707584 00000100:00100000:2.0:1782757986.485407:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1092 00000100:00100000:2.0:1782757986.485415:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196707456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782757986.485505:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782757986.485512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757986.485516:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782757986.485684:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196707328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 484us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757986.485693:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1444 00000100:00100000:2.0:1782757986.486420:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196707456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 874us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757986.494713:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:1.0:1782757986.494743:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196707584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757986.494867:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196707584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 139us (9850us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757986.494886:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:2.0:1782757986.500946:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1092 00010000:00010000:2.0:1782757986.860039:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757987.245192:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211553664:0@lo:400:kworker.0 00000100:00100000:1.0:1782757987.245298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757987.245423:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211553536:0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.245457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757987.245647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211553408:0@lo:400:kworker.0 00000100:00100000:0.0:1782757987.245693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757987.246040:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553664 00000100:00100000:0.0:1782757987.246050:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553664 00000100:00100000:1.0:1782757987.247157:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782757987.247177:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211553792:0@lo:400:kworker.0 00000100:00100000:1.0:1782757987.247416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757987.249180:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553536 00000100:00100000:0.0:1782757987.249196:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553536 00000100:00100000:0.0:1782757987.249270:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1782757987.249284:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211553664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.249405:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553408 00000100:00100000:2.0:1782757987.249411:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553408 00000100:00100000:2.0:1782757987.251520:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1782757987.251557:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211553408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.251789:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211553408:12345-0@lo:400:kworker.0 Request processed in 243us (6082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757987.251800:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1782757987.252676:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1782757987.252700:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211553536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757987.252792:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211553536:12345-0@lo:400:kworker.0 Request processed in 103us (7333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757987.252799:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1782757987.252897:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211553536:0@lo:400:kworker.0 00000100:00100000:1.0:1782757987.252959:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553792 00000100:00100000:1.0:1782757987.252966:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553792 00000100:00100000:3.0:1782757987.253278:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211553920:0@lo:400:kworker.0 00000100:00100000:3.0:1782757987.253333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757987.253382:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211553408:0@lo:400:kworker.0 00000100:00100000:3.0:1782757987.253397:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782757987.253402:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211554048:0@lo:400:kworker.0 00000100:00100000:3.0:1782757987.253434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757987.253469:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211553920 00000100:00100000:3.0:1782757987.253473:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211553920 00000100:00100000:3.0:1782757987.253517:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782757987.253522:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554048 00000100:00100000:3.0:1782757987.253526:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211553920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.253547:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554048 00000100:00100000:3.0:1782757987.253578:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211553920:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757987.253585:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782757987.253615:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1782757987.253617:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211553920:0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.253643:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211553792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757987.253657:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1782757987.253666:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211554048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757987.253710:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211554048:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757987.253717:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1782757987.253767:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211554048:0@lo:400:kworker.0 00000100:00080000:3.0:1782757987.256112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757987.256124:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782757987.256129:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757987.257071:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211553664:12345-0@lo:400:kworker.0 Request processed in 7780us (11763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757987.257091:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1782757987.257264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211553664:0@lo:400:kworker.0 00000100:00100000:2.0:1782757987.258553:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211553792:12345-0@lo:400:kworker.0 Request processed in 4894us (11117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757987.258578:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1782757987.259425:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211553792:0@lo:400:kworker.0 00000100:00100000:0.0:1782757987.756125:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782757987.756158:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782757987.757366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757987.757476:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554176 00000100:00100000:1.0:1782757987.757490:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554176 00000100:00100000:1.0:1782757987.757925:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1782757987.757950:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782757987.758003:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757987.758102:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757987.758110:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1782757987.758217:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757987.884103:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757988.909666:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757989.932115:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757990.316246:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782757990.316325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757990.316379:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554304 00000100:00100000:0.0:1782757990.316387:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554304 00000100:00080000:2.0:1782757990.316451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757990.316463:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1782757990.316476:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782757990.316512:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782757990.316572:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757990.316580:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1782757990.316807:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782757990.956333:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757991.605956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757991.606005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757991.606048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757991.606074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757991.606105:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708096 00000100:00100000:3.0:1782757991.606114:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708096 00000100:00100000:3.0:1782757991.606187:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707968 00000100:00100000:3.0:1782757991.606191:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707968 00000100:00100000:3.0:1782757991.606214:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000100:00100000:3.0:1782757991.606228:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196708096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757991.606280:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1097 00000100:00100000:1.0:1782757991.606289:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196707968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757991.606316:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196707968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757991.606319:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196708096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757991.606324:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1097 00000100:00100000:3.0:1782757991.606327:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000100:00100000:1.0:1782757991.606347:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707712 00000100:00100000:1.0:1782757991.606350:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707712 00000100:00100000:1.0:1782757991.606374:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1167 00000100:00100000:1.0:1782757991.606381:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196707712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782757991.606404:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196707712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757991.606410:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1167 00000100:00100000:0.0:1782757991.606497:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196707840 00000100:00100000:0.0:1782757991.606502:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196707840 00000100:00100000:0.0:1782757991.606548:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1448 00000100:00100000:0.0:1782757991.606559:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196707840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782757991.606583:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757991.606587:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196707840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00080000:2.0:1782757991.606588:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782757991.606590:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782757991.606594:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1448 00010000:00010000:2.0:1782757991.982451:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782757992.364883:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211554432:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.364970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757992.365055:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211554944:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757992.365106:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782757992.365113:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211554560:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757992.365150:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211555072:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757992.365211:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555072 00000100:00100000:0.0:1782757992.365219:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555072 00000100:00100000:0.0:1782757992.365272:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1782757992.365283:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211555072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365340:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211555072:12345-0@lo:400:kworker.0 Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757992.365347:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1782757992.365388:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211555072:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365427:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554816:0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.365449:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211554688:0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.365451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757992.365484:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554432 00000100:00100000:0.0:1782757992.365487:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554432 00000100:00100000:1.0:1782757992.365495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757992.365531:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554944 00000100:00100000:1.0:1782757992.365535:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554944 00000100:00100000:1.0:1782757992.365562:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554560 00000100:00100000:1.0:1782757992.365567:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554560 00000100:00100000:1.0:1782757992.365581:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554688 00000100:00100000:1.0:1782757992.365583:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554688 00000100:00100000:1.0:1782757992.365598:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1782757992.365604:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211554944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.365656:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211554944:12345-0@lo:400:kworker.0 Request processed in 50us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757992.365664:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1782757992.365681:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:1.0:1782757992.365688:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211554560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.365727:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211554560:12345-0@lo:400:kworker.0 Request processed in 41us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757992.365736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00080000:2.0:1782757992.365738:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782757992.365748:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757992.365753:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1782757992.365763:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211554688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.365797:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211554688:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757992.365805:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1782757992.365870:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211554816 00000100:00100000:2.0:1782757992.365880:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211554816 00000100:00100000:1.0:1782757992.365888:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211554688:0@lo:400:kworker.0 00000100:00100000:2.0:1782757992.365954:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1782757992.365963:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211554560:0@lo:400:kworker.0 00000100:00100000:2.0:1782757992.365966:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.365998:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211554944:0@lo:400:kworker.0 00000100:00100000:2.0:1782757992.366073:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211554816:12345-0@lo:400:kworker.0 Request processed in 109us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757992.366082:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1782757992.366100:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211554816:0@lo:400:kworker.0 00000100:00080000:2.0:1782757992.366113:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782757992.366275:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1782757992.366283:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211554432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782757992.366338:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211554432:12345-0@lo:400:kworker.0 Request processed in 56us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757992.366344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782757992.366443:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211554432:0@lo:400:kworker.0 00000100:00100000:1.0:1782757992.876689:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782757992.876714:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211555200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782757992.876794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757992.876989:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555200 00000100:00100000:2.0:1782757992.876997:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555200 00000100:00100000:2.0:1782757992.877052:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782757992.877062:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211555200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782757992.877097:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782757992.877161:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211555200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757992.877168:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782757992.877214:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211555200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757993.004739:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782757993.122742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757993.122785:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708224 00000100:00100000:1.0:1782757993.122794:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708224 00000100:00100000:1.0:1782757993.122880:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 809 00000100:00100000:1.0:1782757993.123094:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708224:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00080000:2.0:1782757993.123454:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782757993.123490:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708224:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 600us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757993.123498:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 809 00000100:00100000:3.0:1782757993.139018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757993.139180:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708352 00000100:00100000:1.0:1782757993.139189:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708352 00000100:00100000:1.0:1782757993.139397:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 446 00000100:00100000:1.0:1782757993.139408:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708352:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:2.0:1782757993.140038:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757993.142781:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708352:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 3365us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757993.142795:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 446 00000100:00100000:3.0:1782757993.153173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757993.153434:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708480 00000100:00100000:1.0:1782757993.153444:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708480 00000100:00100000:1.0:1782757993.153533:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 447 00000100:00100000:1.0:1782757993.153555:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708480:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:3.0:1782757993.153703:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757993.163922:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708480:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 10357us (10746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757993.163939:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 447 00000100:00100000:1.0:1782757993.190314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757993.190356:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708608 00000100:00100000:1.0:1782757993.190366:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708608 00000100:00100000:1.0:1782757993.190416:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 810 00000100:00100000:1.0:1782757993.190426:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708608:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757993.190954:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708608:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 527us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757993.190964:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 810 00000100:00100000:1.0:1782757993.208158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757993.213044:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708736 00000100:00100000:3.0:1782757993.213062:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708736 00000100:00100000:3.0:1782757993.213132:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 811 00000100:00100000:3.0:1782757993.213143:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708736:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782757993.216861:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196708736:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 3682us (8676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757993.216877:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 811 00000100:00100000:0.0:1782757993.229455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757993.231126:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708864 00000100:00100000:3.0:1782757993.231140:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708864 00000100:00100000:3.0:1782757993.231200:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 448 00000100:00100000:3.0:1782757993.231221:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708864:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782757993.231686:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708864:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 476us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757993.231695:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 448 00000100:00100000:3.0:1782757993.238718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757993.238801:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196708992 00000100:00100000:0.0:1782757993.238811:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196708992 00000100:00100000:0.0:1782757993.238903:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 449 00000100:00100000:0.0:1782757993.238914:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708992:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782757993.242045:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:47457:x1869355196708992:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 3120us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757993.242059:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 449 00000100:00100000:3.0:1782757993.244564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757993.246440:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196709120 00000100:00100000:0.0:1782757993.246457:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196709120 00000100:00100000:0.0:1782757993.246544:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 812 00000100:00100000:0.0:1782757993.246556:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196709120:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782757993.254458:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47457:x1869355196709120:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 7894us (9891us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757993.254485:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 812 00000100:00100000:0.0:1782757993.297324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757993.297365:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196709248 00000100:00100000:0.0:1782757993.297374:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196709248 00000100:00100000:0.0:1782757993.297429:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 813 00000100:00100000:0.0:1782757993.297439:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:47458:x1869355196709248:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757993.297458:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757993.297489:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6499c expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.297566:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.297581:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.297593:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757993.297802:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:0.0:1782757993.297807:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782757993.298080:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.298109:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6499c expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.298127:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6499c expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.298142:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782757993.298145:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782757993.298149:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782757993.298207:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47458:x1869355196709248:12345-192.168.204.31@tcp:101:rm.0 Request processed in 770us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757993.298215:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 813 00000100:00100000:1.0:1782757993.315029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757993.317966:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196709504 00000100:00100000:0.0:1782757993.317982:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196709504 00000100:00100000:0.0:1782757993.318100:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 814 00000100:00100000:0.0:1782757993.318113:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:47458:x1869355196709504:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782757993.318143:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782757993.318166:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da4e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649a3 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782757993.322165:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00010000:0.0:1782757993.325229:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da4e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649a3 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.325253:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782757993.325257:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782757993.325263:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da4e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649a3 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757993.325277:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782757993.325366:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47458:x1869355196709504:12345-192.168.204.31@tcp:101:rm.0 Request processed in 7255us (10346us total) trans 4294967611 rc 301/301 00000100:00100000:0.0:1782757993.325379:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 814 00000100:00100000:3.0:1782757993.348405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782757993.348555:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196709632 00000100:00100000:2.0:1782757993.348565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196709632 00000100:00100000:2.0:1782757993.349092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:2.0:1782757993.349106:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47458:x1869355196709632:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782757993.364817:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47458:x1869355196709632:12345-192.168.204.31@tcp:37:rm.0 Request processed in 15698us (16404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757993.364866:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:3.0:1782757993.369935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757993.369977:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196709888 00000100:00100000:3.0:1782757993.369987:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196709888 00000100:00100000:3.0:1782757993.370049:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:3.0:1782757993.370060:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47458:x1869355196709888:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:3.0:1782757993.372191:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:47458:x1869355196709888:12345-192.168.204.31@tcp:35:rm.0 Request processed in 2124us (2255us total) trans 4294967612 rc 0/0 00000100:00100000:3.0:1782757993.372206:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:1.0:1782757993.376003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782757993.376046:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710144 00000100:00100000:1.0:1782757993.376057:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710144 00000100:00100000:1.0:1782757993.376125:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 815 00000100:00100000:1.0:1782757993.376141:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:47458:x1869355196710144:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:1.0:1782757993.376208:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782757993.376243:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da4e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6499c expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376266:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64987 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376282:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782757993.376304:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181524c00/0xdd99f5c4777da1a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf648d1 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376326:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782757993.376337:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782757993.376363:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376387:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376397:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376410:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376418:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.376434:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.377157:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.377168:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.377176:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782757993.384302:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00010000:1.0:1782757993.384347:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.384359:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.384366:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385645:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757993.385654:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385665:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385683:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782757993.385686:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782757993.385692:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385699:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da505 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385730:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385737:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385748:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385758:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757993.385763:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385776:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385788:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782757993.385792:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757993.385795:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.385801:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da4f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782757993.385818:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000075f7cfb reply state 00000000166f2b47 transno 4294967613 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757993.386067:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782757993.386172:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:47458:x1869355196710144:12345-192.168.204.31@tcp:36:rm.0 Request processed in 10032us (10178us total) trans 4294967613 rc 0/0 00000100:00100000:1.0:1782757993.386182:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 815 00010000:00010000:1.0:1782757993.394551:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394573:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394581:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394587:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782757993.394592:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394600:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394637:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9171a0e3a900) 00010000:00010000:1.0:1782757993.394641:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782757993.394646:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757993.394653:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da4fe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757994.028906:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782757995.055573:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782757995.386677:0:80858:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2071da90 20000000:00000080:1.0:1782757995.386699:0:80858:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbcfd400 uarg=0000000000000000 00010000:00010000:1.0:1782757995.394977:0:80858:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782757995.394999:0:80858:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782757995.395045:0:80858:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782757995.395063:0:80858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757995.395080:0:80858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757995.395088:0:80858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757995.395128:0:80858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757995.395144:0:80858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 18 pid: 5793 timeout: 2163 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757995.395164:0:80858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80858:1869355211555328:0@lo:104: 00000100:00100000:1.0:1782757995.396181:0:80858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757995.398980:0:80858:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46840 going to sleep for 11 seconds 00000100:00100000:0.0:1782757995.399072:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555328 00000100:00100000:0.0:1782757995.399081:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555328 00000100:00100000:0.0:1782757995.399142:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1782757995.399153:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:80858:x1869355211555328:12345-0@lo:104: 00010000:00010000:0.0:1782757995.399170:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.399583:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757995.399592:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:80858:x1869355211555328:12345-0@lo:104: Request processed in 440us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757995.399599:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1782757995.399986:0:80858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80858:1869355211555328:0@lo:104: 00010000:00010000:2.0:1782757995.400014:0:80858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757995.400158:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782757995.400166:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757995.400175:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782757995.400179:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757995.400198:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782757995.400216:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782757995.400223:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757995.400563:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.400571:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782757995.400634:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211555456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782757995.400684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782757995.400733:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555456 00000100:00100000:0.0:1782757995.400738:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555456 00010000:00010000:0.0:1782757995.400768:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 2163 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757995.400808:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782757995.400817:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211555456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782757995.400851:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782757995.400858:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 2163 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400867:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 2163 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400882:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777da193 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da18c expref: 19 pid: 5793 timeout: 2163 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400905:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400915:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400931:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.400938:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400938:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.400946:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695400/0xdd99f5c4777da18c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da193 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400947:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400953:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400958:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757995.400960:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757995.400962:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757995.400962:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.400964:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782757995.400969:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.400994:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757995.401004:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782757995.401059:0:80858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.401066:0:80858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757995.401072:0:80858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777da50c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782757995.405193:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211555456:12345-0@lo:103:ldlm_bl.0 Request processed in 4360us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757995.405218:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782757995.406246:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211555456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782757995.439956:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782757995.440044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757995.440119:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555584 00000100:00100000:1.0:1782757995.440128:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555584 00000100:00100000:1.0:1782757995.440187:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1782757995.440195:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211555584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782757995.440245:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782757995.440290:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211555584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757995.440297:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00080000:1.0:1782757995.440318:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782757995.440365:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211555584:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1782757995.512071:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967611 is committed 00000001:00080000:2.0:1782757995.512182:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967613 is committed 00010000:00010000:2.0:1782757996.079402:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757996.681990:0:80908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2aac4ea0 20000000:00000080:3.0:1782757996.682010:0:80908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c4800 uarg=0000000000000000 00010000:00010000:3.0:1782757996.684813:0:80908:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757996.685583:0:80908:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757996.685613:0:80908:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757996.685634:0:80908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685650:0:80908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685662:0:80908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685669:0:80908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685675:0:80908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685682:0:80908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685689:0:80908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782757996.685693:0:80908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685702:0:80908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685721:0:80908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685729:0:80908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757996.685736:0:80908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da513 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757996.744597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782757996.746431:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710272 00000100:00100000:3.0:1782757996.746445:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710272 00000100:00100000:3.0:1782757996.746691:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1169 00000100:00100000:3.0:1782757996.746702:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196710272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782757996.749389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757996.750756:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710400 00000100:00100000:0.0:1782757996.750778:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710400 00000100:00080000:2.0:1782757996.750929:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782757996.750954:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1452 00000100:00100000:0.0:1782757996.750969:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196710400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757996.751064:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196710400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757996.751072:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1452 00000100:00100000:0.0:1782757996.753410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757996.754303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782757996.754342:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710656 00000100:00100000:0.0:1782757996.754350:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710656 00000100:00100000:0.0:1782757996.754405:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710528 00000100:00100000:0.0:1782757996.754408:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710528 00000100:00100000:0.0:1782757996.754433:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:0.0:1782757996.754444:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196710656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757996.755042:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196710656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 598us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757996.755053:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:0.0:1782757996.755076:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1101 00000100:00100000:0.0:1782757996.755085:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196710528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782757996.755112:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196710528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757996.755119:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1101 00000100:00080000:0.0:1782757996.755144:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782757996.755149:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782757996.757028:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196710272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 10314us (12427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782757996.757042:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1169 10000000:01000000:1.0:1782757997.108914:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782757997.108922:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782757997.108928:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782757997.108985:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757997.108998:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782757997.109014:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782757997.109043:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211555712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782757997.109120:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782757997.109171:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c469c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782757997.110731:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782757997.118348:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555712 00000100:00100000:3.0:1782757997.118364:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555712 00000100:00100000:3.0:1782757997.118762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1782757997.118773:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211555712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782757997.118794:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782757997.118814:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da51a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757997.119565:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757997.119579:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757997.119588:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782757997.120372:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211555712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1597us (11248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.120381:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1782757997.133770:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211555712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782757997.133806:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757997.133818:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757997.133942:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782757997.133947:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757997.133955:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757997.484007:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211555968:0@lo:400:kworker.0 00000100:00100000:2.0:1782757997.484081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757997.484147:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757997.484153:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211556096:0@lo:400:kworker.0 00000100:00100000:2.0:1782757997.484181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757997.484338:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211555840:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757997.484400:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211556352:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757997.484444:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782757997.484449:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211556224:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757997.484529:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556096 00000100:00100000:3.0:1782757997.484537:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556096 00000100:00100000:3.0:1782757997.484587:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556352 00000100:00100000:3.0:1782757997.484590:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556352 00000100:00100000:3.0:1782757997.484617:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1782757997.484626:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211556096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484680:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211556096:12345-0@lo:400:kworker.0 Request processed in 55us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.484687:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1782757997.484704:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1782757997.484710:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211556352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484756:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211556352:12345-0@lo:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.484763:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1782757997.484781:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555968 00000100:00100000:3.0:1782757997.484784:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555968 00000100:00100000:3.0:1782757997.484807:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211555840 00000100:00100000:3.0:1782757997.484811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211555840 00000100:00100000:3.0:1782757997.484846:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556224 00000100:00100000:3.0:1782757997.484849:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556224 00000100:00100000:3.0:1782757997.484867:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1782757997.484873:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211555968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484904:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211555968:12345-0@lo:400:kworker.0 Request processed in 32us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.484910:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1782757997.484920:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1782757997.484926:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484952:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211555840:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.484958:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1782757997.484967:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1782757997.484972:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211556224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.484996:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211556224:12345-0@lo:400:kworker.0 Request processed in 23us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.485002:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00080000:3.0:1782757997.485017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782757997.485022:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782757997.485023:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782757997.485055:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211556224:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.485065:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211555840:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.485073:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211556352:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.485104:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211556096:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.485116:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211555968:0@lo:400:kworker.0 00000100:00100000:3.0:1782757997.998760:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211556480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782757997.998853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757997.998928:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556480 00000100:00100000:3.0:1782757997.998936:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556480 00000100:00100000:3.0:1782757997.998984:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1782757997.998994:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211556480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782757997.999032:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782757997.999094:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211556480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782757997.999102:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1782757997.999319:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211556480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782757998.125002:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782757998.133684:0:80956:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd498365c0 20000000:00000080:3.0:1782757998.133703:0:80956:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbc29000 uarg=0000000000000000 00010000:00010000:3.0:1782757998.134566:0:80956:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782757998.134584:0:80956:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782757998.134605:0:80956:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782757998.134624:0:80956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.134641:0:80956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.134650:0:80956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.134687:0:80956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.134702:0:80956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 18 pid: 5796 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782757998.134715:0:80956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80956:1869355211556608:0@lo:104: 00000100:00100000:3.0:1782757998.134786:0:80956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782757998.135011:0:80956:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718637f300 going to sleep for 11 seconds 00000100:00100000:0.0:1782757998.141960:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556608 00000100:00100000:0.0:1782757998.141979:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556608 00000100:00100000:0.0:1782757998.142071:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782757998.142084:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:80956:x1869355211556608:12345-0@lo:104: 00010000:00010000:0.0:1782757998.142105:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782757998.142218:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782757998.142224:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:80956:x1869355211556608:12345-0@lo:104: Request processed in 144us (7439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782757998.142231:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1782757998.142606:0:80956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80956:1869355211556608:0@lo:104: 00010000:00010000:3.0:1782757998.142637:0:80956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143677:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782757998.143688:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143700:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782757998.143704:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143715:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782757998.143740:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782757998.143746:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782757998.143801:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143809:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782757998.143865:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143872:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777da51a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da521 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.143891:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757998.143893:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782757998.143895:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782757998.143903:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782757998.143921:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211556736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782757998.143983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782757998.144037:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556736 00000100:00100000:2.0:1782757998.144043:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556736 00010000:00010000:2.0:1782757998.144080:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782757998.144109:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1782757998.144118:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211556736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782757998.144130:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782757998.144136:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144147:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144160:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777da521 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da51a expref: 19 pid: 5796 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144173:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144181:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144195:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144201:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144208:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144214:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144219:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782757998.144223:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144229:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144241:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757998.144266:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782757998.144301:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211556736:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782757998.144308:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1782757998.144381:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211556736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782757998.144613:0:80956:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.144622:0:80956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782757998.144628:0:80956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691800/0xdd99f5c4777da528 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782757999.149006:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782758000.171930:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758000.171939:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758000.171945:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758000.172004:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758000.172017:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758000.172029:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758000.172059:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211556864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758000.172140:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758000.172191:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758000.172430:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556864 00000100:00100000:1.0:1782758000.172438:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556864 00000100:00100000:1.0:1782758000.172505:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1782758000.172516:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211556864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758000.172532:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758000.172548:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da52f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758000.172576:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758000.172588:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758000.172597:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758000.172647:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211556864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758000.172654:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1782758000.172736:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211556864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758000.172753:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758000.172763:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758000.172792:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758000.172798:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758000.172804:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758000.173184:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758000.562774:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211556992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758000.562895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758000.563046:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211556992 00000100:00100000:2.0:1782758000.563055:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211556992 00000100:00100000:2.0:1782758000.563113:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1782758000.563127:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211556992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758000.563164:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758000.563219:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211556992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758000.563226:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00080000:3.0:1782758000.566967:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758000.571094:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211556992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758001.197342:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758001.852059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758001.852094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758001.852141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758001.852170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758001.852213:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711040 00000100:00100000:2.0:1782758001.852222:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711040 00000100:00100000:2.0:1782758001.852280:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711168 00000100:00100000:2.0:1782758001.852283:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711168 00000100:00100000:2.0:1782758001.852309:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1104 00000100:00100000:2.0:1782758001.852318:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758001.852403:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758001.852411:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1104 00000100:00100000:2.0:1782758001.852428:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1105 00000100:00100000:2.0:1782758001.852435:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758001.852460:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758001.852467:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1105 00000100:00100000:2.0:1782758001.852486:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710912 00000100:00100000:2.0:1782758001.852489:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710912 00000100:00100000:2.0:1782758001.852516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1456 00000100:00100000:2.0:1782758001.852523:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196710912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758001.852551:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196710912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758001.852558:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1456 00000100:00080000:2.0:1782758001.852604:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758001.852608:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758001.852610:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758001.852949:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196710784 00000100:00100000:1.0:1782758001.852955:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196710784 00000100:00100000:1.0:1782758001.852990:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1172 00000100:00100000:1.0:1782758001.852997:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196710784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758001.853043:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196710784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758001.853050:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1172 00010000:00010000:2.0:1782758002.221271:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758002.616345:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211557248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.616416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758002.616467:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211557760:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.616539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758002.616565:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758002.616572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211557376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.616594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758002.616627:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557248 00000100:00100000:3.0:1782758002.616634:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557248 00000100:00100000:3.0:1782758002.616685:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557376 00000100:00100000:3.0:1782758002.616688:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557376 00000100:00100000:3.0:1782758002.616719:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1782758002.616727:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211557248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.616787:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211557248:12345-0@lo:400:kworker.0 Request processed in 59us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758002.616795:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1782758002.616814:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1782758002.616858:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211557376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.616890:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211557376:12345-0@lo:400:kworker.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758002.616897:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1782758002.616918:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557760 00000100:00100000:3.0:1782758002.616921:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557760 00000100:00100000:3.0:1782758002.616948:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1782758002.616954:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211557760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617136:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211557504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758002.617191:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758002.617197:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211557120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758002.617254:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211557632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758002.617305:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557504 00000100:00100000:2.0:1782758002.617309:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557504 00000100:00100000:2.0:1782758002.617338:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1782758002.617344:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211557504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617379:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211557504:12345-0@lo:400:kworker.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758002.617386:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1782758002.617404:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557632 00000100:00100000:2.0:1782758002.617407:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557632 00000100:00100000:2.0:1782758002.617430:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1782758002.617436:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211557632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617738:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211557632:12345-0@lo:400:kworker.0 Request processed in 300us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758002.617745:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1782758002.617792:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211557632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.617803:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211557504:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.620277:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211557760:12345-0@lo:400:kworker.0 Request processed in 3312us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758002.620291:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:3.0:1782758002.620345:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758002.620350:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758002.620354:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758002.620376:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557120 00000100:00100000:3.0:1782758002.620384:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557120 00000100:00100000:3.0:1782758002.620437:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1782758002.620445:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211557120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.620486:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211557120:12345-0@lo:400:kworker.0 Request processed in 42us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758002.620493:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1782758002.620568:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211557376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.620582:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211557248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758002.620595:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211557760:0@lo:400:kworker.0 00000100:00100000:2.0:1782758002.620782:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211557120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758003.120545:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211557888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758003.120618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758003.120704:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211557888 00000100:00100000:2.0:1782758003.120712:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211557888 00000100:00100000:2.0:1782758003.120761:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1782758003.120770:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211557888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758003.120809:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758003.120881:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211557888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758003.120888:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1782758003.120934:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211557888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758003.243980:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758003.531186:0:81153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4425d330 20000000:00000080:1.0:1782758003.531204:0:81153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917191996c00 uarg=0000000000000000 00010000:00010000:1.0:1782758003.532200:0:81153:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758003.532219:0:81153:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758003.532238:0:81153:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758003.532257:0:81153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.532274:0:81153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.532288:0:81153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.532439:0:81153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.532456:0:81153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 18 pid: 5793 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758003.532471:0:81153:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81153:1869355211558016:0@lo:104: 00000100:00100000:1.0:1782758003.532543:0:81153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758003.532670:0:81153:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916000 going to sleep for 11 seconds 00000100:00100000:2.0:1782758003.533269:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558016 00000100:00100000:2.0:1782758003.533277:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558016 00000100:00100000:2.0:1782758003.533424:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782758003.533434:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81153:x1869355211558016:12345-0@lo:104: 00010000:00010000:2.0:1782758003.533448:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758003.533523:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758003.533530:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81153:x1869355211558016:12345-0@lo:104: Request processed in 98us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758003.533537:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:3.0:1782758003.533591:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758003.533598:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533607:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758003.533611:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533619:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758003.533637:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758003.533643:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758003.533678:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533685:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758003.533706:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533712:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da52f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da536 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533730:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758003.533732:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758003.533734:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758003.533749:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758003.533762:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211558144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758003.533798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758003.533869:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558144 00000100:00100000:3.0:1782758003.533873:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558144 00010000:00010000:3.0:1782758003.533893:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 19 pid: 5793 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758003.533916:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782758003.533922:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211558144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758003.533932:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758003.533950:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 19 pid: 5793 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533961:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 19 pid: 5793 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533979:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.533987:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534002:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534009:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534015:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534020:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534025:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758003.534030:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534037:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534044:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758003.534052:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758003.534081:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211558144:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758003.534088:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782758003.534128:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211558144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758003.534282:0:81153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777da536 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da52f expref: 18 pid: 5793 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758003.534292:0:81153:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81153:1869355211558016:0@lo:104: 00010000:00010000:1.0:1782758003.534318:0:81153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.534327:0:81153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.534332:0:81153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758003.534337:0:81153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da53d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758004.268261:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758005.044010:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758005.044017:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758005.044021:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758005.044070:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758005.044082:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758005.044092:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758005.044117:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211558272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758005.044185:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758005.044248:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26300 going to sleep for 11 seconds 00000100:00100000:2.0:1782758005.044315:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558272 00000100:00100000:2.0:1782758005.044322:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558272 00000100:00100000:2.0:1782758005.044380:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1782758005.044390:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211558272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758005.044404:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758005.044418:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da544 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758005.044448:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758005.044473:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758005.044483:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758005.044535:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211558272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758005.044543:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1782758005.044637:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211558272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758005.044654:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758005.044664:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758005.044685:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758005.044691:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758005.044698:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758005.292010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758005.678138:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758005.678165:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211558400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758005.678245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758005.678321:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558400 00000100:00100000:3.0:1782758005.678328:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558400 00000100:00100000:3.0:1782758005.678392:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1782758005.678401:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211558400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758005.678442:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758005.678491:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211558400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758005.678498:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00080000:3.0:1782758005.678521:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758005.678565:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211558400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758006.316770:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758006.964229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758006.964260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758006.964295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758006.964326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758006.964363:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711424 00000100:00100000:1.0:1782758006.964372:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711424 00000100:00100000:1.0:1782758006.964447:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1460 00000100:00100000:1.0:1782758006.964458:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758006.964536:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758006.964544:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1460 00000100:00100000:1.0:1782758006.964592:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711552 00000100:00100000:1.0:1782758006.964596:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711552 00000100:00100000:1.0:1782758006.964620:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711680 00000100:00100000:1.0:1782758006.964623:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711680 00000100:00100000:1.0:1782758006.964644:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1108 00000100:00100000:1.0:1782758006.964651:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758006.964678:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758006.964685:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1108 00000100:00100000:1.0:1782758006.964696:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00100000:1.0:1782758006.964702:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758006.964722:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196711680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758006.964729:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00080000:3.0:1782758006.964876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758006.964891:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758006.964894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758006.966674:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711296 00000100:00100000:0.0:1782758006.966686:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711296 00000100:00100000:0.0:1782758006.966757:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1175 00000100:00100000:0.0:1782758006.966769:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196711296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758006.966866:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196711296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758006.966874:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1175 00010000:00010000:3.0:1782758007.341447:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758007.728769:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211558528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758007.728787:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211558912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.728888:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211558656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758007.741372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758007.741459:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758007.741472:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211558784:0@lo:400:kworker.0 00000100:00100000:1.0:1782758007.741518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758007.741590:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558784 00000100:00100000:1.0:1782758007.741599:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558784 00000100:00100000:1.0:1782758007.741670:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1782758007.741679:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211558784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758007.741736:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211558784:12345-0@lo:400:kworker.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758007.741743:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1782758007.741801:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211558784:0@lo:400:kworker.0 00000100:00080000:1.0:1782758007.741925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758007.742129:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558912 00000100:00100000:0.0:1782758007.742134:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558912 00000100:00100000:0.0:1782758007.742180:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1782758007.742190:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211558912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758007.742233:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211558912:12345-0@lo:400:kworker.0 Request processed in 46us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758007.742243:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00080000:1.0:1782758007.742285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758007.742307:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211558912:0@lo:400:kworker.0 00000100:00100000:2.0:1782758007.753363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758007.756215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558528 00000100:00100000:3.0:1782758007.756231:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558528 00000100:00100000:3.0:1782758007.756295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1782758007.756304:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756391:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211558528:12345-0@lo:400:kworker.0 Request processed in 88us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758007.756397:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1782758007.756456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758007.756487:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211558656 00000100:00100000:3.0:1782758007.756490:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211558656 00000100:00100000:3.0:1782758007.756518:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1782758007.756524:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211558656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756568:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211558656:12345-0@lo:400:kworker.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758007.756574:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1782758007.756627:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211558656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756639:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211559168:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758007.756684:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559168 00000100:00100000:3.0:1782758007.756687:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559168 00000100:00100000:3.0:1782758007.756720:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1782758007.756725:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211559168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756753:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211559168:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758007.756773:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00080000:3.0:1782758007.756792:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758007.756813:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211559168:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756861:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758007.756868:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211559040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758007.756909:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559040 00000100:00100000:3.0:1782758007.756912:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559040 00000100:00100000:3.0:1782758007.756939:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1782758007.756944:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.756969:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211559040:12345-0@lo:400:kworker.0 Request processed in 25us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758007.756975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00080000:3.0:1782758007.756987:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758007.757004:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211559040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758007.766067:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211558528:0@lo:400:kworker.0 00000100:00100000:1.0:1782758008.237444:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758008.237470:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211559296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758008.237563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758008.238477:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559296 00000100:00100000:2.0:1782758008.238487:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559296 00000100:00100000:2.0:1782758008.238544:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1782758008.238555:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211559296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758008.238593:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758008.238652:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211559296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758008.238659:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1782758008.238707:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211559296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758008.366754:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758009.388134:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758010.416857:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758010.799516:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211559424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758010.799608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758010.799935:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559424 00000100:00100000:2.0:1782758010.799945:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559424 00000100:00100000:2.0:1782758010.800028:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1782758010.800039:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211559424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758010.800076:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758010.800137:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211559424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758010.800144:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:3.0:1782758010.800203:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758010.800350:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211559424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758011.441352:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758012.101064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758012.101112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758012.101142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758012.101171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758012.101202:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711936 00000100:00100000:1.0:1782758012.101218:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711936 00000100:00100000:1.0:1782758012.101303:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1464 00000100:00100000:1.0:1782758012.101314:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196711936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758012.101394:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196711936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758012.101402:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1464 00000100:00080000:1.0:1782758012.101429:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758012.102374:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712064 00000100:00100000:2.0:1782758012.102384:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712064 00000100:00100000:2.0:1782758012.102437:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712192 00000100:00100000:2.0:1782758012.102440:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712192 00000100:00100000:2.0:1782758012.102478:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:2.0:1782758012.102488:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196712064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758012.102538:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196712064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758012.102546:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:2.0:1782758012.102561:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1113 00000100:00100000:2.0:1782758012.102566:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196712192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758012.102589:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196712192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758012.102595:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1113 00000100:00100000:3.0:1782758012.103806:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196711808 00000100:00100000:3.0:1782758012.103849:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196711808 00000100:00100000:3.0:1782758012.103903:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1177 00000100:00100000:3.0:1782758012.103914:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196711808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758012.104001:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196711808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758012.104009:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1177 00000100:00080000:1.0:1782758012.105649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758012.105659:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758012.460241:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758012.847755:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211559808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758012.847873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758012.847955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758012.847965:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211559936:0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.848005:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211559552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758012.848007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758012.848011:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211559680:0@lo:400:kworker.0 00000100:00100000:1.0:1782758012.848061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758012.848097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211560192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758012.848097:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559808 00000100:00100000:0.0:1782758012.848106:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559808 00000100:00100000:3.0:1782758012.848115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758012.848137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758012.848187:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211560064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.848230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758012.849762:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559552 00000100:00100000:3.0:1782758012.849777:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559552 00000100:00100000:3.0:1782758012.849932:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1782758012.849944:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.850031:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211559552:12345-0@lo:400:kworker.0 Request processed in 88us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758012.850040:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00080000:1.0:1782758012.850763:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758012.853656:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559680 00000100:00100000:0.0:1782758012.853671:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559680 00000100:00100000:2.0:1782758012.853782:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560064 00000100:00100000:2.0:1782758012.853787:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560064 00000100:00100000:2.0:1782758012.853872:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1782758012.853883:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211559808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.853979:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1782758012.853995:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211559808:12345-0@lo:400:kworker.0 Request processed in 111us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758012.854004:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211559680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758012.854022:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1782758012.854051:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1782758012.854061:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.854109:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211559680:12345-0@lo:400:kworker.0 Request processed in 118us (6046us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758012.854116:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1782758012.854123:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211560064:12345-0@lo:400:kworker.0 Request processed in 60us (5890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758012.854132:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1782758012.854178:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211559936 00000100:00100000:2.0:1782758012.854182:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211559936 00000100:00100000:3.0:1782758012.854210:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211559552:0@lo:400:kworker.0 00000100:00100000:2.0:1782758012.854216:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560192 00000100:00100000:2.0:1782758012.854222:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560192 00000100:00100000:2.0:1782758012.854247:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1782758012.854255:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758012.854290:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211559936:12345-0@lo:400:kworker.0 Request processed in 36us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758012.854299:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1782758012.854316:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211560064:0@lo:400:kworker.0 00000100:00080000:3.0:1782758012.854440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758012.854456:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758012.854460:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758012.854485:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1782758012.854507:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211560192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.854567:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211560192:12345-0@lo:400:kworker.0 Request processed in 73us (6430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758012.854576:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1782758012.854665:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211559936:0@lo:400:kworker.0 00000100:00100000:3.0:1782758012.854681:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211559808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758012.854791:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211559680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758012.854807:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211560192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758013.357432:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758013.357523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758013.357602:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560320 00000100:00100000:0.0:1782758013.357610:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560320 00000100:00100000:0.0:1782758013.357662:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1782758013.357673:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758013.357716:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758013.357776:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758013.357784:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1782758013.358238:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758013.485399:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758014.508465:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758015.532070:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758015.918063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758015.918092:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758015.918180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758015.918522:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560448 00000100:00100000:3.0:1782758015.918531:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560448 00000100:00100000:3.0:1782758015.918608:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1782758015.918618:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758015.918658:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758015.918709:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758015.918717:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00080000:3.0:1782758015.918768:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758015.918812:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560448:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782758016.182076:0:81497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 14:33:33 (1782758013) 00010000:00010000:0.0:1782758016.556098:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758017.205322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758017.205375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758017.205405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758017.205432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758017.205489:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712448 00000100:00100000:2.0:1782758017.205499:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712448 00000100:00100000:2.0:1782758017.205567:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1468 00000100:00100000:2.0:1782758017.205578:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196712448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758017.205659:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196712448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758017.205666:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1468 00000100:00100000:2.0:1782758017.205704:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712576 00000100:00100000:2.0:1782758017.205707:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712576 00000100:00100000:2.0:1782758017.205731:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712704 00000100:00100000:2.0:1782758017.205734:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712704 00000100:00100000:2.0:1782758017.205750:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 450 00000100:00100000:2.0:1782758017.205755:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196712576:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1782758017.205775:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d9df7 00000100:00080000:2.0:1782758017.205783:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917189071800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782758017.205845:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:2.0:1782758017.206093:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196712576:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 335us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758017.206100:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 450 00000100:00100000:2.0:1782758017.206112:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 451 00000100:00100000:2.0:1782758017.206119:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196712704:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1782758017.206131:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777da0c8 00000100:00080000:2.0:1782758017.206137:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917191a82800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782758017.206163:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:2.0:1782758017.206304:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196712704:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 185us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758017.206311:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 451 00010000:00010000:2.0:1782758017.206450:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758017.206457:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758017.206719:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712320 00000100:00100000:3.0:1782758017.206725:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712320 00000100:00100000:3.0:1782758017.206764:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00100000:3.0:1782758017.206771:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196712320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758017.206804:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196712320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758017.206810:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00080000:1.0:1782758017.211547:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758017.211555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758017.211559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000400:1.0:1782758017.335976:0:81546:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782758017.349529:0:81546:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:2.0:1782758017.580016:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758017.972070:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211560832:0@lo:400:kworker.0 00000100:00100000:3.0:1782758017.972145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758017.972206:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758017.972212:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560960:0@lo:400:kworker.0 00000100:00100000:3.0:1782758017.972235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758017.972265:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560960 00000100:00100000:3.0:1782758017.972271:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560960 00000100:00100000:3.0:1782758017.972323:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1782758017.972330:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758017.972396:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211560960:12345-0@lo:400:kworker.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758017.972402:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1782758017.972442:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211560960:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972559:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211560576:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758017.972619:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211561088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758017.972671:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758017.972676:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211560704:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758017.972714:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211561216:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758017.972758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560576 00000100:00100000:0.0:1782758017.972761:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560576 00000100:00100000:0.0:1782758017.972791:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1782758017.972796:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211560576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972842:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211560576:12345-0@lo:400:kworker.0 Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758017.972847:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1782758017.972872:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560832 00000100:00100000:0.0:1782758017.972875:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560832 00000100:00100000:0.0:1782758017.972899:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561088 00000100:00100000:0.0:1782758017.972901:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561088 00000100:00100000:0.0:1782758017.972915:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211560704 00000100:00100000:0.0:1782758017.972917:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211560704 00000100:00100000:0.0:1782758017.972928:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1782758017.972934:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211560832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.972965:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211560832:12345-0@lo:400:kworker.0 Request processed in 32us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758017.972970:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1782758017.972981:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1782758017.972986:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211561088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973010:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211561088:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758017.973015:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1782758017.973023:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1782758017.973028:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211560704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973052:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211560704:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758017.973057:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1782758017.973079:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561216 00000100:00100000:0.0:1782758017.973082:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561216 00000100:00100000:0.0:1782758017.973111:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1782758017.973116:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211561216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973144:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211561216:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758017.973150:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1782758017.973186:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211560832:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973210:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211560704:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973219:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211561216:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973225:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211560576:0@lo:400:kworker.0 00000100:00100000:0.0:1782758017.973233:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211561088:0@lo:400:kworker.0 00000100:00080000:2.0:1782758017.973565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758017.973570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758017.973573:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758018.478235:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211561344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758018.478322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758018.478418:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561344 00000100:00100000:0.0:1782758018.478425:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561344 00000100:00100000:0.0:1782758018.478477:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1782758018.478486:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211561344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758018.478524:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758018.478569:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211561344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758018.478577:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1782758018.478626:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211561344:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1782758018.479006:0:81594:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfa4067c0 20000000:00000080:0.0:1782758018.479020:0:81594:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7a92000 uarg=0000000000000000 10000000:01000000:0.0:1782758018.479780:0:81594:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758018.479799:0:81594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.479817:0:81594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.479847:0:81594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.479879:0:81594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.479892:0:81594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 18 pid: 5793 timeout: 2186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758018.479904:0:81594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81594:1869355211561472:0@lo:104: 00000100:00100000:0.0:1782758018.479950:0:81594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758018.479986:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561472 00000100:00100000:0.0:1782758018.479991:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561472 00000100:00100000:0.0:1782758018.480024:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1782758018.480032:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81594:x1869355211561472:12345-0@lo:104: 00010000:00010000:0.0:1782758018.480045:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480086:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758018.480092:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81594:x1869355211561472:12345-0@lo:104: Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758018.480098:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:0.0:1782758018.480129:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758018.480222:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480230:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758018.480234:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480242:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758018.480249:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758018.480254:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758018.480279:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480284:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758018.480300:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480307:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5600/0xdd99f5c4777da544 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da54b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480320:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758018.480322:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758018.480323:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758018.480351:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211561600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758018.480380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758018.480424:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561600 00000100:00100000:0.0:1782758018.480428:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561600 00010000:00010000:0.0:1782758018.480445:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 19 pid: 5793 timeout: 2186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758018.480465:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1782758018.480471:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211561600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758018.480480:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758018.480485:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 19 pid: 5793 timeout: 2186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480495:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 19 pid: 5793 timeout: 2186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480511:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480519:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480552:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480559:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480566:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480573:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480579:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758018.480583:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480591:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480599:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480609:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758018.480635:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211561600:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758018.480642:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1782758018.480671:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211561600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758018.480760:0:81594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171811ca480 going to sleep for 11 seconds 00010000:00010000:0.0:1782758018.480775:0:81594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777da54b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da544 expref: 18 pid: 5793 timeout: 2186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758018.480786:0:81594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81594:1869355211561472:0@lo:104: 00010000:00010000:0.0:1782758018.480799:0:81594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480808:0:81594:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480814:0:81594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758018.480820:0:81594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777da552 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1782758018.551778:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758018.551789:0:7507:0:(genops.c:906:class_export_put()) final put ffff917191a81000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758018.551818:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff917191a81000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:1.0:1782758018.552362:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917191a82800 for lustre-OST0001 00000001:00100000:2.0:1782758018.577242:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758018.577252:0:6622:0:(genops.c:906:class_export_put()) final put ffff917189070000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758018.577300:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917189070000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:2.0:1782758018.577351:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189071800 for lustre-OST0000 00010000:00010000:1.0:1782758018.614860:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758019.576175:0:81646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde7a84900 20000000:00000080:3.0:1782758019.576193:0:81646:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b58400 uarg=0000000000000000 10000000:01000000:3.0:1782758019.576498:0:81646:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758019.576522:0:81646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576538:0:81646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576550:0:81646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576557:0:81646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576564:0:81646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576575:0:81646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576583:0:81646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758019.576588:0:81646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576596:0:81646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.576610:0:81646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.577256:0:81646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758019.577275:0:81646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da559 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758019.629761:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758020.268155:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758020.268163:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758020.268169:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758020.268211:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.268223:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.268235:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758020.268261:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211561728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758020.269015:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758020.269072:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758020.269405:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561728 00000100:00100000:0.0:1782758020.269413:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561728 00000100:00100000:0.0:1782758020.269470:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1782758020.269479:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211561728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758020.269493:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758020.269509:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da560 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.269531:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.269542:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.269552:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782758020.269598:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211561728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758020.269604:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1782758020.270017:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211561728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758020.270034:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.270043:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758020.270064:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758020.270069:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.270076:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782758020.639038:0:81694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc63a583d0 20000000:00000080:0.0:1782758020.639058:0:81694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d4800 uarg=0000000000000000 10000000:01000000:0.0:1782758020.639323:0:81694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758020.639344:0:81694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.639364:0:81694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.639373:0:81694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.639416:0:81694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758020.639432:0:81694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 18 pid: 5796 timeout: 2189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758020.639450:0:81694:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81694:1869355211561856:0@lo:104: 00000100:00100000:0.0:1782758020.639530:0:81694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758020.639603:0:81694:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb9e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782758020.639972:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561856 00000100:00100000:1.0:1782758020.639981:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561856 00000100:00100000:1.0:1782758020.640033:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1782758020.640043:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81694:x1869355211561856:12345-0@lo:104: 00010000:00010000:1.0:1782758020.640059:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640131:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758020.640139:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81694:x1869355211561856:12345-0@lo:104: Request processed in 97us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758020.640146:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:1.0:1782758020.640173:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758020.640179:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640186:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758020.640192:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640201:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758020.640209:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758020.640215:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758020.640247:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640253:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758020.640279:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640286:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da560 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da567 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640311:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758020.640313:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758020.640315:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758020.640335:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211561984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758020.640367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758020.640408:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211561984 00000100:00100000:1.0:1782758020.640412:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211561984 00010000:00010000:1.0:1782758020.640430:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 19 pid: 5796 timeout: 2189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758020.640453:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1782758020.640459:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211561984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758020.640469:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758020.640474:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 19 pid: 5796 timeout: 2189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640484:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 19 pid: 5796 timeout: 2189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640499:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640507:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640519:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640527:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640534:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640541:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640545:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758020.640549:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640556:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640565:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.640573:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758020.640601:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211561984:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758020.640607:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1782758020.640645:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211561984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758020.644742:0:81694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da567 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da560 expref: 18 pid: 5796 timeout: 2189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758020.644762:0:81694:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81694:1869355211561856:0@lo:104: 00010000:00010000:2.0:1782758020.644791:0:81694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758020.644801:0:81694:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758020.644807:0:81694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758020.644838:0:81694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777da56e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758020.670148:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758021.040727:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211562112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758021.040839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758021.040921:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562112 00000100:00100000:3.0:1782758021.040929:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562112 00000100:00100000:3.0:1782758021.041001:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1782758021.041011:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211562112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758021.041054:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758021.041097:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211562112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758021.041107:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00080000:3.0:1782758021.041129:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758021.041656:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211562112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758021.680916:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758021.756382:0:81745:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc7494870 20000000:00000080:3.0:1782758021.756398:0:81745:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082708800 uarg=0000000000000000 10000000:01000000:3.0:1782758021.757480:0:81745:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758021.757506:0:81745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757524:0:81745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757536:0:81745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757544:0:81745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757550:0:81745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757558:0:81745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757564:0:81745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758021.757569:0:81745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757577:0:81745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757724:0:81745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757732:0:81745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758021.757738:0:81745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777da575 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758022.188246:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758022.188255:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758022.188260:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758022.188319:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758022.188332:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758022.188343:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758022.188373:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211562240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758022.188451:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758022.188539:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758022.188643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562240 00000100:00100000:0.0:1782758022.188650:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562240 00000100:00100000:0.0:1782758022.188708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1782758022.188719:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211562240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758022.188733:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758022.188747:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da57c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.188771:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.188782:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.188791:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782758022.188865:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211562240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758022.188872:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1782758022.190443:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211562240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758022.190471:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.190482:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758022.190508:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758022.190513:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.190521:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758022.328210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758022.328278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758022.328312:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712832 00000100:00100000:1.0:1782758022.328322:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712832 00000100:00100000:1.0:1782758022.328375:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:1.0:1782758022.328385:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196712832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758022.328458:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196712832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758022.328468:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:3.0:1782758022.328670:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196712960 00000100:00100000:3.0:1782758022.328686:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196712960 00000100:00100000:3.0:1782758022.328749:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1472 00000100:00100000:3.0:1782758022.328758:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196712960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758022.328799:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196712960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758022.328806:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1472 00000100:00080000:1.0:1782758022.330589:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758022.700683:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758022.800636:0:81793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffacc846f0 20000000:00000080:0.0:1782758022.800653:0:81793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d7c00 uarg=0000000000000000 10000000:01000000:0.0:1782758022.800896:0:81793:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758022.800917:0:81793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.800934:0:81793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.800944:0:81793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.800983:0:81793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.800997:0:81793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 18 pid: 5794 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758022.801012:0:81793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81793:1869355211562368:0@lo:104: 00000100:00100000:0.0:1782758022.801082:0:81793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758022.801141:0:81793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171860679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758022.801391:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562368 00000100:00100000:2.0:1782758022.801399:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562368 00000100:00100000:2.0:1782758022.801458:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782758022.801468:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81793:x1869355211562368:12345-0@lo:104: 00010000:00010000:2.0:1782758022.801482:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.801564:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758022.801570:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81793:x1869355211562368:12345-0@lo:104: Request processed in 104us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758022.801577:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:2.0:1782758022.801983:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758022.801990:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802000:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758022.802004:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802014:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758022.802021:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758022.802033:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758022.802073:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802079:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758022.802101:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802108:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777da57c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da583 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802124:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758022.802126:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758022.802128:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758022.802142:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211562496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758022.802179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758022.802224:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562496 00000100:00100000:2.0:1782758022.802229:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562496 00010000:00010000:2.0:1782758022.802262:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 19 pid: 5794 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758022.802284:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1782758022.802291:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211562496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758022.802302:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758022.802307:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 19 pid: 5794 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802317:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 19 pid: 5794 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802335:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802344:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802358:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802365:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802372:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802379:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802384:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758022.802388:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802395:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802403:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758022.802412:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758022.802442:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211562496:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758022.802451:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1782758022.802486:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211562496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758022.802616:0:81793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777da583 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da57c expref: 18 pid: 5794 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758022.802626:0:81793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81793:1869355211562368:0@lo:104: 00010000:00010000:0.0:1782758022.802643:0:81793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.802652:0:81793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.802658:0:81793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758022.802669:0:81793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da58a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758023.087393:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211562624:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.087477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.087537:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211563136:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.087704:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.087736:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758023.087743:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211563008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.087770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.087804:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211562752:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.087937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.087967:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758023.087973:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211562880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.088002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.088044:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562624 00000100:00100000:0.0:1782758023.088052:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562624 00000100:00100000:0.0:1782758023.088104:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563008 00000100:00100000:0.0:1782758023.088108:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563008 00000100:00100000:0.0:1782758023.088140:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562752 00000100:00100000:0.0:1782758023.088143:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562752 00000100:00100000:0.0:1782758023.088173:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1782758023.088184:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.088333:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211562624:12345-0@lo:400:kworker.0 Request processed in 151us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.088341:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1782758023.088365:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1782758023.088373:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.088413:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211563008:12345-0@lo:400:kworker.0 Request processed in 41us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.088420:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1782758023.088434:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1782758023.088442:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211562752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.088481:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211562752:12345-0@lo:400:kworker.0 Request processed in 41us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.088489:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1782758023.088513:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563136 00000100:00100000:0.0:1782758023.088518:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563136 00000100:00100000:0.0:1782758023.088555:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211562880 00000100:00100000:0.0:1782758023.089596:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211562880 00000100:00100000:0.0:1782758023.089652:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1782758023.089661:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.089724:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211563136:12345-0@lo:400:kworker.0 Request processed in 64us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.089731:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1782758023.089746:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1782758023.089753:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211562880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.089783:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211562880:12345-0@lo:400:kworker.0 Request processed in 31us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.089789:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:0.0:1782758023.090040:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758023.090046:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758023.090049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758023.090105:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211562880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.090120:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211562752:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.090165:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211563008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.090180:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211562624:0@lo:400:kworker.0 00000100:00100000:0.0:1782758023.090196:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211563136:0@lo:400:kworker.0 00000100:00100000:3.0:1782758023.596142:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758023.596166:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211563264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758023.596251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758023.596360:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563264 00000100:00100000:0.0:1782758023.596370:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563264 00000100:00100000:0.0:1782758023.596423:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1782758023.596434:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211563264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758023.596759:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758023.596817:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211563264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 385us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758023.596850:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1782758023.596937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211563264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758023.726711:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758023.958178:0:81841:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9025be10 20000000:00000080:0.0:1782758023.958194:0:81841:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d6800 uarg=0000000000000000 10000000:01000000:0.0:1782758023.958406:0:81841:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758023.958428:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958446:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958457:0:81841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958464:0:81841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958477:0:81841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958485:0:81841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958491:0:81841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758023.958496:0:81841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958504:0:81841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958517:0:81841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958525:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758023.958532:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50200/0xdd99f5c4777da591 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758024.300450:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758024.300458:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758024.300464:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758024.300517:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758024.300986:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758024.301002:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758024.301029:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211563392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758024.301092:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758024.301152:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758024.301669:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563392 00000100:00100000:1.0:1782758024.301680:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563392 00000100:00100000:1.0:1782758024.301741:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1782758024.301752:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211563392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758024.301770:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758024.301787:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da598 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758024.301812:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758024.301867:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758024.301878:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782758024.301944:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211563392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758024.301951:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1782758024.302065:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211563392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758024.302084:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758024.302093:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758024.302113:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758024.302119:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758024.302126:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758024.748093:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758025.772167:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758026.158626:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211563520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758026.158709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758026.158789:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563520 00000100:00100000:3.0:1782758026.158797:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563520 00000100:00100000:3.0:1782758026.158867:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1782758026.158877:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211563520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758026.159067:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758026.159114:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211563520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758026.159122:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00080000:3.0:1782758026.159143:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758026.159181:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211563520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758026.796150:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758027.444597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758027.444660:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758027.444798:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713216 00000100:00100000:2.0:1782758027.444810:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713216 00000100:00100000:2.0:1782758027.444912:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1476 00000100:00100000:2.0:1782758027.444923:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196713216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758027.445001:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196713216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758027.445008:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1476 00000100:00080000:1.0:1782758027.446457:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758027.451891:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713088 00000100:00100000:3.0:1782758027.451907:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713088 00000100:00100000:3.0:1782758027.451965:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1185 00000100:00100000:3.0:1782758027.451976:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196713088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758027.452077:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196713088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (7415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758027.452085:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1185 00010000:00010000:1.0:1782758027.820104:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758028.204521:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211563904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758028.204592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758028.204652:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758028.204658:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211564032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758028.204682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758028.204720:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563904 00000100:00100000:3.0:1782758028.204727:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563904 00000100:00100000:3.0:1782758028.204781:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1782758028.204790:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211563904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758028.204885:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211563904:12345-0@lo:400:kworker.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758028.204893:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1782758028.204917:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564032 00000100:00100000:3.0:1782758028.204921:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564032 00000100:00100000:3.0:1782758028.204948:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1782758028.204955:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211564032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758028.204986:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211564032:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758028.204992:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:3.0:1782758028.205006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758028.205011:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758028.205044:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211564032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758028.205054:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211563904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205329:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211563776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758028.205392:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211564288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758028.205434:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782758028.205440:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211563648:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758028.205503:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211564160:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758028.205550:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563776 00000100:00100000:2.0:1782758028.205554:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563776 00000100:00100000:2.0:1782758028.205580:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564160 00000100:00100000:2.0:1782758028.205583:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564160 00000100:00100000:2.0:1782758028.205612:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1782758028.205618:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205655:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211563776:12345-0@lo:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758028.205662:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1782758028.205675:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1782758028.205681:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211564160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205708:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211564160:12345-0@lo:400:kworker.0 Request processed in 27us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758028.205714:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1782758028.205731:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564288 00000100:00100000:2.0:1782758028.205735:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564288 00000100:00100000:2.0:1782758028.205762:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1782758028.205768:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211564288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205798:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211564288:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758028.205808:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1782758028.205842:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211563648 00000100:00100000:2.0:1782758028.205845:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211563648 00000100:00100000:2.0:1782758028.205884:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1782758028.205890:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211563648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205920:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211563648:12345-0@lo:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758028.205926:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:2.0:1782758028.205963:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758028.205966:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758028.205986:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211563648:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.205997:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211564160:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.206007:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211563776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758028.206016:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211564288:0@lo:400:kworker.0 00000020:00000080:1.0:1782758028.210236:0:81988:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf6c309f0 20000000:00000080:1.0:1782758028.210253:0:81988:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc3c00 uarg=0000000000000000 10000000:01000000:0.0:1782758028.214486:0:81988:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758028.214511:0:81988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758028.214530:0:81988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758028.214545:0:81988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758028.214587:0:81988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758028.214602:0:81988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 18 pid: 5793 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758028.214618:0:81988:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81988:1869355211564416:0@lo:104: 00000100:00100000:0.0:1782758028.214701:0:81988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758028.214754:0:81988:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7900 going to sleep for 11 seconds 00000100:00100000:2.0:1782758028.215071:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782758028.215085:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564416 00000100:00100000:2.0:1782758028.215092:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564416 00000100:00100000:2.0:1782758028.215156:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1782758028.215166:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170833e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81988:x1869355211564416:12345-0@lo:104: 00010000:00010000:2.0:1782758028.215180:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758028.215246:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758028.215252:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170833e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:81988:x1869355211564416:12345-0@lo:104: Request processed in 88us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758028.215262:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:3.0:1782758028.215332:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758028.215340:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215352:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758028.215356:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215366:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758028.215373:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758028.215380:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758028.215417:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215424:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758028.215444:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215451:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777da598 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da59f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215480:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758028.215482:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758028.215483:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758028.215495:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211564544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758028.215529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758028.215569:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564544 00000100:00100000:3.0:1782758028.215574:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564544 00010000:00010000:3.0:1782758028.215593:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 19 pid: 5793 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758028.215616:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1782758028.215623:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211564544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758028.215633:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758028.215638:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 19 pid: 5793 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215650:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 19 pid: 5793 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215665:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215675:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215690:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215698:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215706:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215714:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215720:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758028.215725:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215734:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215744:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758028.215754:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758028.215783:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211564544:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758028.215791:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1782758028.215863:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211564544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758028.216179:0:81988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777da59f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da598 expref: 18 pid: 5793 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758028.216191:0:81988:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81988:1869355211564416:0@lo:104: 00010000:00010000:1.0:1782758028.216210:0:81988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758028.216219:0:81988:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758028.216224:0:81988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758028.216229:0:81988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777da5a6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758028.717024:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211564672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758028.717095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758028.717227:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564672 00000100:00100000:0.0:1782758028.717236:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564672 00000100:00100000:0.0:1782758028.717290:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1782758028.717300:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211564672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758028.717335:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758028.717384:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211564672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758028.717402:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1782758028.718892:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211564672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758028.844091:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758029.613707:0:82037:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb700cbc0 20000000:00000080:0.0:1782758029.613726:0:82037:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b347e000 uarg=0000000000000000 10000000:01000000:0.0:1782758029.613983:0:82037:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758029.614006:0:82037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614022:0:82037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614034:0:82037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614040:0:82037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614046:0:82037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614052:0:82037:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614058:0:82037:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758029.614062:0:82037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614071:0:82037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614083:0:82037:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614091:0:82037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.614097:0:82037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777da5ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758029.630631:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758029.630639:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758029.630644:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758029.630695:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758029.631367:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758029.631382:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758029.631412:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211564800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758029.631479:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758029.631538:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758029.631608:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564800 00000100:00100000:0.0:1782758029.631615:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564800 00000100:00100000:0.0:1782758029.631663:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1782758029.631673:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211564800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758029.631687:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758029.631702:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da5b4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.631726:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.631736:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758029.631744:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782758029.631795:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211564800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758029.631802:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1782758029.632534:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211564800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758029.632551:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758029.632561:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758029.632580:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758029.632586:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758029.632593:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758029.868098:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758030.899310:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758031.282386:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211564928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758031.282475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758031.283223:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211564928 00000100:00100000:3.0:1782758031.283232:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211564928 00000100:00100000:3.0:1782758031.283302:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1782758031.283311:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211564928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758031.283346:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758031.283396:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211564928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758031.283519:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1782758031.283651:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211564928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758031.285720:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758031.915992:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758032.565623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758032.565663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758032.565695:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713472 00000100:00100000:3.0:1782758032.565707:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713472 00000100:00100000:3.0:1782758032.565769:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:3.0:1782758032.565795:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782758032.566068:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758032.567045:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1245us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758032.567057:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:3.0:1782758032.567127:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713344 00000100:00100000:3.0:1782758032.567134:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713344 00000100:00100000:3.0:1782758032.567167:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1188 00000100:00100000:3.0:1782758032.567173:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758032.567209:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758032.567216:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1188 00010000:00010000:1.0:1782758032.939961:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758033.325066:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211565056:0@lo:400:kworker.0 00000100:00100000:2.0:1782758033.325099:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211565440:0@lo:400:kworker.0 00000100:00100000:2.0:1782758033.325165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758033.325321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758033.325393:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211565568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.325429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758033.327028:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565440 00000100:00100000:3.0:1782758033.327057:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565440 00000100:00100000:3.0:1782758033.327237:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1782758033.327251:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211565440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.327348:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211565440:12345-0@lo:400:kworker.0 Request processed in 100us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.327356:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1782758033.327392:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211565312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.327434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758033.327476:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782758033.327483:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211565184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.327514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758033.327538:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211565696:0@lo:400:kworker.0 00000100:00080000:3.0:1782758033.327578:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758033.327598:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565568 00000100:00100000:3.0:1782758033.327603:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565568 00000100:00100000:3.0:1782758033.327635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565312 00000100:00100000:3.0:1782758033.327637:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565312 00000100:00100000:3.0:1782758033.327655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565184 00000100:00100000:3.0:1782758033.327657:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565184 00000100:00100000:3.0:1782758033.327673:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1782758033.327680:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211565568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.327721:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211565568:12345-0@lo:400:kworker.0 Request processed in 41us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.327728:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1782758033.327742:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1782758033.327748:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.327779:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211565312:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.327786:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1782758033.327797:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:3.0:1782758033.327803:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211565184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.329309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211565184:12345-0@lo:400:kworker.0 Request processed in 1497us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.329326:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:3.0:1782758033.329374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758033.329419:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211565568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.330003:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565056 00000100:00100000:3.0:1782758033.330011:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565056 00000100:00100000:3.0:1782758033.330062:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1782758033.330070:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758033.330262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758033.333037:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565696 00000100:00100000:0.0:1782758033.333067:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565696 00000100:00100000:0.0:1782758033.333300:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1782758033.333316:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211565696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758033.335059:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211565440:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.335313:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211565056:12345-0@lo:400:kworker.0 Request processed in 5240us (9988us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.335327:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:3.0:1782758033.335611:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758033.335640:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211565056:0@lo:400:kworker.0 00000100:00100000:1.0:1782758033.340938:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211565312:0@lo:400:kworker.0 00000100:00100000:1.0:1782758033.340977:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211565184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758033.354683:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211565696:12345-0@lo:400:kworker.0 Request processed in 21347us (24394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758033.354702:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1782758033.354858:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211565696:0@lo:400:kworker.0 00000100:00100000:1.0:1782758033.838028:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211565824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758033.838106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758033.838973:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565824 00000100:00100000:2.0:1782758033.838986:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565824 00000100:00100000:2.0:1782758033.839053:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1782758033.839063:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211565824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758033.839100:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758033.839181:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211565824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758033.839188:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1782758033.839241:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211565824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758033.964148:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758034.619692:0:82233:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9d8dee60 20000000:00000080:3.0:1782758034.619710:0:82233:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd9400 uarg=0000000000000000 00010000:00010000:3.0:1782758034.621606:0:82233:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758034.621624:0:82233:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758034.621638:0:82233:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758034.621658:0:82233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.621675:0:82233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.621684:0:82233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.621722:0:82233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.621735:0:82233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 18 pid: 5796 timeout: 2203 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758034.621750:0:82233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82233:1869355211565952:0@lo:104: 00000100:00100000:3.0:1782758034.621819:0:82233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758034.622052:0:82233:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171872ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758034.622759:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211565952 00000100:00100000:2.0:1782758034.622768:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211565952 00000100:00100000:2.0:1782758034.622951:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782758034.622962:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82233:x1869355211565952:12345-0@lo:104: 00010000:00010000:2.0:1782758034.622981:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758034.623308:0:82233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82233:1869355211565952:0@lo:104: 00010000:00010000:3.0:1782758034.623332:0:82233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758034.623432:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758034.623439:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82233:x1869355211565952:12345-0@lo:104: Request processed in 480us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758034.623450:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:1.0:1782758034.623609:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758034.623616:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623624:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758034.623629:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623638:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758034.623645:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758034.623652:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758034.623699:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623706:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758034.623736:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623744:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777da5b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623762:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758034.623764:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758034.623765:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758034.623774:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758034.623788:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211566080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758034.623857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758034.623901:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566080 00000100:00100000:1.0:1782758034.623906:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566080 00010000:00010000:1.0:1782758034.623927:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 2203 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758034.623952:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1782758034.623959:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211566080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758034.623971:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758034.623976:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 2203 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.623986:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 2203 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624000:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777da5bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da5b4 expref: 19 pid: 5796 timeout: 2203 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624015:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624036:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624052:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624059:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624067:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624078:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624084:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758034.624088:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624095:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.624107:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.624275:0:82233:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.624283:0:82233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758034.624289:0:82233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5c2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758034.625499:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758034.625582:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211566080:12345-0@lo:103:ldlm_bl.0 Request processed in 1619us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758034.625593:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1782758034.626655:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211566080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758034.990700:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758036.012294:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758036.139947:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758036.139957:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758036.139963:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758036.140029:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758036.140048:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758036.140059:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758036.140087:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211566208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758036.140163:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758036.140227:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782758036.142068:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566208 00000100:00100000:2.0:1782758036.142081:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566208 00000100:00100000:2.0:1782758036.142155:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1782758036.142165:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211566208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758036.142184:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758036.142204:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da5c9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758036.142232:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758036.142244:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758036.142253:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758036.142343:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211566208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758036.142351:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1782758036.145768:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211566208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758036.145802:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758036.145815:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758036.145867:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758036.145873:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758036.145884:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758036.413355:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211566336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758036.413440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758036.413537:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566336 00000100:00100000:3.0:1782758036.413546:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566336 00000100:00100000:3.0:1782758036.413618:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1782758036.413628:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211566336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758036.413671:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758036.413720:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211566336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758036.413727:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00080000:3.0:1782758036.413752:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758036.413790:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211566336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758037.036479:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758037.686530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758037.686606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758037.686636:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713728 00000100:00100000:3.0:1782758037.686646:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713728 00000100:00100000:3.0:1782758037.686705:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1484 00000100:00100000:3.0:1782758037.686716:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758037.686798:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758037.686806:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1484 00000100:00100000:3.0:1782758037.686853:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713600 00000100:00100000:3.0:1782758037.686857:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713600 00000100:00100000:3.0:1782758037.686886:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00100000:3.0:1782758037.686893:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758037.686921:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758037.686928:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00080000:3.0:1782758037.686954:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758038.060790:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758038.451493:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211566592:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451615:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211567104:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451662:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782758038.451668:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211566464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451713:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211566976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451753:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211566720:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451790:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758038.451795:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211566848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.451814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758038.451875:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566592 00000100:00100000:3.0:1782758038.451886:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566592 00000100:00100000:3.0:1782758038.451934:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566976 00000100:00100000:3.0:1782758038.451937:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566976 00000100:00100000:3.0:1782758038.451973:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566720 00000100:00100000:3.0:1782758038.451976:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566720 00000100:00100000:3.0:1782758038.452005:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1782758038.452015:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211566592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452069:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211566592:12345-0@lo:400:kworker.0 Request processed in 54us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452077:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1782758038.452095:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1782758038.452101:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211566976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452127:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211566976:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452133:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1782758038.452143:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1782758038.452148:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211566720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452175:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211566720:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452181:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1782758038.452199:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567104 00000100:00100000:3.0:1782758038.452202:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567104 00000100:00100000:3.0:1782758038.452224:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566848 00000100:00100000:3.0:1782758038.452227:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566848 00000100:00100000:3.0:1782758038.452243:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1782758038.452249:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211567104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452278:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211567104:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452284:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1782758038.452294:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1782758038.452300:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452329:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211566848:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452334:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1782758038.452350:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211566464 00000100:00100000:3.0:1782758038.452353:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211566464 00000100:00100000:3.0:1782758038.452375:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1782758038.452381:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452407:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211566464:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758038.452412:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:3.0:1782758038.452449:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758038.452453:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758038.452455:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758038.452494:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211566848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452505:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211566720:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452535:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211566464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452545:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211566976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452554:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211566592:0@lo:400:kworker.0 00000100:00100000:3.0:1782758038.452561:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211567104:0@lo:400:kworker.0 00000100:00100000:2.0:1782758038.957004:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758038.957030:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211567232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758038.957101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758038.957165:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567232 00000100:00100000:2.0:1782758038.957173:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567232 00000100:00100000:2.0:1782758038.957320:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1782758038.957331:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211567232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758038.957367:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758038.957415:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211567232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758038.957424:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1782758038.957759:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211567232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758039.085868:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758040.108438:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758040.508106:0:82430:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7dfe2160 20000000:00000080:2.0:1782758040.508125:0:82430:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810dcc00 uarg=0000000000000000 00010000:00010000:2.0:1782758040.508611:0:82430:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758040.508625:0:82430:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758040.508638:0:82430:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758040.508656:0:82430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758040.508672:0:82430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758040.508681:0:82430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758040.508719:0:82430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758040.508733:0:82430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 18 pid: 5796 timeout: 2208 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758040.508747:0:82430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82430:1869355211567360:0@lo:104: 00000100:00100000:2.0:1782758040.508812:0:82430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758040.508915:0:82430:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186293e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782758040.509431:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567360 00000100:00100000:1.0:1782758040.509439:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567360 00000100:00100000:1.0:1782758040.509507:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1782758040.509517:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82430:x1869355211567360:12345-0@lo:104: 00010000:00010000:1.0:1782758040.509532:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758040.509599:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758040.509605:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82430:x1869355211567360:12345-0@lo:104: Request processed in 90us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758040.509612:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:3.0:1782758040.509738:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758040.509745:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.509753:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758040.509757:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.509767:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758040.509778:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758040.509783:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758040.509819:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.509850:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758040.509884:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.509891:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777da5c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.509917:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758040.509919:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758040.509921:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758040.509933:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211567488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758040.509967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758040.510002:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567488 00000100:00100000:3.0:1782758040.510006:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567488 00010000:00010000:3.0:1782758040.510023:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 19 pid: 5796 timeout: 2208 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758040.510042:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1782758040.510048:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211567488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758040.510058:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758040.510062:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 19 pid: 5796 timeout: 2208 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510072:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 19 pid: 5796 timeout: 2208 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510087:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510095:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510108:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510116:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510122:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510129:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510134:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758040.510139:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510146:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510155:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510168:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758040.510208:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211567488:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758040.510214:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782758040.510300:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211567488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758040.510580:0:82430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777da5d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da5c9 expref: 18 pid: 5796 timeout: 2208 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758040.510591:0:82430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82430:1869355211567360:0@lo:104: 00010000:00010000:3.0:1782758040.510606:0:82430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510614:0:82430:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510620:0:82430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758040.510626:0:82430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777da5d7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758041.139088:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758041.472491:0:82478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2395adf0 20000000:00000080:0.0:1782758041.472510:0:82478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb934000 uarg=0000000000000000 00010000:00010000:0.0:1782758041.472760:0:82478:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758041.472775:0:82478:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758041.472789:0:82478:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758041.473274:0:82478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473297:0:82478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473309:0:82478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473317:0:82478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473324:0:82478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473332:0:82478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473338:0:82478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758041.473415:0:82478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473426:0:82478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473440:0:82478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473448:0:82478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758041.473455:0:82478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51400/0xdd99f5c4777da5de lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758041.516463:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211567616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758041.516551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758041.518762:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567616 00000100:00100000:0.0:1782758041.518777:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567616 00000100:00100000:0.0:1782758041.518866:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1782758041.518880:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211567616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758041.518934:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758041.519019:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211567616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758041.519027:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:3.0:1782758041.521010:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758041.521150:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211567616:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1782758042.096374:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758042.096383:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758042.096389:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758042.096440:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758042.096453:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758042.096465:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758042.096494:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211567744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758042.096564:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758042.096667:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782758042.105166:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567744 00000100:00100000:2.0:1782758042.105184:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567744 00000100:00100000:2.0:1782758042.105267:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1782758042.105279:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211567744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758042.105302:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758042.105324:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da5e5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758042.105355:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758042.105366:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758042.105375:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758042.105471:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211567744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758042.105477:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1782758042.105663:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211567744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758042.105686:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758042.105696:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758042.105724:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758042.105730:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758042.105737:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758042.163387:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758042.811360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758042.811415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758042.811448:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713984 00000100:00100000:0.0:1782758042.811459:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713984 00000100:00100000:0.0:1782758042.811519:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1488 00000100:00100000:0.0:1782758042.811533:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758042.811608:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196713984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758042.811616:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1488 00000100:00100000:0.0:1782758042.811644:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196713856 00000100:00100000:0.0:1782758042.811648:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196713856 00000100:00100000:0.0:1782758042.811675:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:0.0:1782758042.811698:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713856:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758042.811726:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196713856:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758042.811733:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00080000:0.0:1782758042.811760:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758043.183650:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758043.565718:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211568000:0@lo:400:kworker.0 00000100:00100000:3.0:1782758043.565731:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211567872:0@lo:400:kworker.0 00000100:00100000:1.0:1782758043.570835:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211568256:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.574422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.574802:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758043.574816:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211568128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.574898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.576030:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758043.576044:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211568512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.576089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.581730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.581803:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758043.581816:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211568384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.581905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.582905:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568512 00000100:00100000:0.0:1782758043.582916:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568512 00000100:00100000:0.0:1782758043.582981:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568256 00000100:00100000:0.0:1782758043.582985:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568256 00000100:00100000:0.0:1782758043.583013:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1782758043.583022:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211568512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583098:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211568512:12345-0@lo:400:kworker.0 Request processed in 76us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.583106:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1782758043.583125:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1782758043.583132:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211568256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583166:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211568256:12345-0@lo:400:kworker.0 Request processed in 35us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.583172:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1782758043.583190:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568000 00000100:00100000:0.0:1782758043.583194:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568000 00000100:00100000:0.0:1782758043.583215:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568128 00000100:00100000:0.0:1782758043.583218:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568128 00000100:00100000:0.0:1782758043.583234:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568384 00000100:00100000:0.0:1782758043.583236:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568384 00000100:00100000:0.0:1782758043.583250:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1782758043.583254:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211568000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583290:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211568000:12345-0@lo:400:kworker.0 Request processed in 35us (8878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.583296:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1782758043.583305:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1782758043.583311:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211568128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583335:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211568128:12345-0@lo:400:kworker.0 Request processed in 25us (8438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.583340:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1782758043.583349:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1782758043.583354:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211568384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583377:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211568384:12345-0@lo:400:kworker.0 Request processed in 24us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.583382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00080000:0.0:1782758043.583398:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758043.583402:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758043.583404:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758043.583438:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211568512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583486:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211568128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583497:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211568000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583531:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211568384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.583540:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211568256:0@lo:400:kworker.0 00000100:00100000:3.0:1782758043.584688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758043.585032:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211567872 00000100:00100000:0.0:1782758043.585041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211567872 00000100:00100000:0.0:1782758043.585140:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1782758043.585151:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211567872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758043.585233:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211567872:12345-0@lo:400:kworker.0 Request processed in 84us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758043.585240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1782758043.585516:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211567872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758044.079581:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211568640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758044.079657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758044.079739:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568640 00000100:00100000:0.0:1782758044.079747:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568640 00000100:00100000:0.0:1782758044.079798:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1782758044.079808:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211568640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758044.079872:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758044.079920:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211568640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758044.079927:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1782758044.080284:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211568640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758044.208679:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758045.236873:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758046.257687:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758046.638653:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211568768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758046.638725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758046.638815:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568768 00000100:00100000:2.0:1782758046.638862:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568768 00000100:00100000:2.0:1782758046.638923:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1782758046.638936:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211568768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758046.638970:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758046.639023:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211568768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758046.639032:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1782758046.639069:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211568768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758046.639524:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758047.280035:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758047.944347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758047.946013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758047.946362:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714240 00000100:00100000:0.0:1782758047.946383:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714240 00000100:00100000:0.0:1782758047.946544:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1492 00000100:00100000:0.0:1782758047.946575:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196714240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758047.947615:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196714240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1052us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758047.947629:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1492 00000100:00080000:0.0:1782758047.948067:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758047.949907:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714112 00000100:00100000:2.0:1782758047.950216:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714112 00000100:00100000:2.0:1782758047.950365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1196 00000100:00100000:2.0:1782758047.950388:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196714112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758047.950581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196714112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 204us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758047.950590:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1196 00010000:00010000:2.0:1782758048.302107:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758048.696334:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211568896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758048.696438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758048.696530:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211568896 00000100:00100000:3.0:1782758048.696539:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211568896 00000100:00100000:3.0:1782758048.696612:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1782758048.696623:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758048.696689:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211568896:12345-0@lo:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758048.696697:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1782758048.696773:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211568896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.713623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758048.713664:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211569024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.713781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758048.714682:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569024 00000100:00100000:0.0:1782758048.714696:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569024 00000100:00100000:0.0:1782758048.714788:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1782758048.714799:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758048.714924:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211569024:12345-0@lo:400:kworker.0 Request processed in 127us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758048.714937:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1782758048.715447:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211569024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.715976:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211569280:0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.716041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758048.716118:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211569408:0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.716146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758048.716183:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569408 00000100:00100000:2.0:1782758048.716189:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569408 00000100:00100000:2.0:1782758048.716252:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1782758048.716264:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.716315:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211569408:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758048.716321:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1782758048.716354:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211569408:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716555:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211569152:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758048.716628:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758048.716634:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211569536:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758048.716689:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569280 00000100:00100000:1.0:1782758048.716693:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569280 00000100:00100000:1.0:1782758048.716725:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569536 00000100:00100000:1.0:1782758048.716728:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569536 00000100:00100000:1.0:1782758048.716763:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1782758048.716771:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211569280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716815:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211569280:12345-0@lo:400:kworker.0 Request processed in 45us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758048.716844:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1782758048.716860:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1782758048.716866:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211569536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716897:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211569536:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758048.716903:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1782758048.716939:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211569280:0@lo:400:kworker.0 00000100:00100000:1.0:1782758048.716966:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211569536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.717507:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569152 00000100:00100000:2.0:1782758048.717515:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569152 00000100:00100000:2.0:1782758048.717570:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1782758048.717578:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758048.717641:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211569152:12345-0@lo:400:kworker.0 Request processed in 64us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758048.717648:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00080000:0.0:1782758048.717868:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758048.717874:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758048.717878:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758048.717991:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211569152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758049.209879:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758049.209905:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211569664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758049.209978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758049.219475:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569664 00000100:00100000:0.0:1782758049.219490:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569664 00000100:00100000:0.0:1782758049.219549:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1782758049.219559:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211569664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758049.219602:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758049.219752:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211569664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (9774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758049.219760:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1782758049.224281:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211569664:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1782758049.322719:0:82772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbb888070 00010000:00010000:3.0:1782758049.325312:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:00000080:0.0:1782758049.332301:0:82772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2d10c00 uarg=0000000000000000 00010000:00010000:1.0:1782758049.333233:0:82772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758049.333251:0:82772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758049.333265:0:82772:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758049.333284:0:82772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.333301:0:82772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.333310:0:82772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.333348:0:82772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.333363:0:82772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 18 pid: 5796 timeout: 2217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758049.333379:0:82772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82772:1869355211569792:0@lo:104: 00000100:00100000:1.0:1782758049.333456:0:82772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758049.333521:0:82772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758049.333581:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569792 00000100:00100000:3.0:1782758049.333588:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569792 00000100:00100000:3.0:1782758049.333636:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1782758049.333646:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82772:x1869355211569792:12345-0@lo:104: 00010000:00010000:3.0:1782758049.333660:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758049.333727:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758049.333742:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:82772:x1869355211569792:12345-0@lo:104: Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758049.333750:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782758049.333984:0:82772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82772:1869355211569792:0@lo:104: 00010000:00010000:1.0:1782758049.334004:0:82772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334074:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758049.334094:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334102:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758049.334106:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334115:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758049.334124:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758049.334131:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758049.334166:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334173:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758049.334197:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334205:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777da5e5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da5ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334220:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758049.334222:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758049.334223:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758049.334302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758049.334314:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211569920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758049.334345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758049.334788:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211569920 00000100:00100000:0.0:1782758049.334793:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211569920 00010000:00010000:0.0:1782758049.334818:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 2217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758049.334878:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782758049.334886:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211569920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758049.334897:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758049.334901:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 2217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334911:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 2217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334924:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777da5ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da5e5 expref: 19 pid: 5796 timeout: 2217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334937:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334946:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334960:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334967:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334973:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334979:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334985:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758049.334989:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.334996:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.335006:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758049.335014:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758049.335188:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211569920:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758049.335196:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:1.0:1782758049.335252:0:82772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.335260:0:82772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758049.335267:0:82772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777da5f3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758049.343289:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211569920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758050.355424:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758051.006608:0:82821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff63b20040 20000000:00000080:3.0:1782758051.006626:0:82821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7699800 uarg=0000000000000000 00010000:00010000:3.0:1782758051.006890:0:82821:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758051.006903:0:82821:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758051.006915:0:82821:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758051.006934:0:82821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006948:0:82821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006958:0:82821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006964:0:82821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006971:0:82821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006977:0:82821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006983:0:82821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758051.006987:0:82821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.006993:0:82821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.009866:0:82821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.009880:0:82821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.009886:0:82821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777da5fa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758051.262961:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758051.262969:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758051.262973:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758051.263179:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758051.263191:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758051.263202:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758051.263226:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211570048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758051.263291:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758051.263394:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaadd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758051.272921:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570048 00000100:00100000:1.0:1782758051.272937:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570048 00000100:00100000:0.0:1782758051.273089:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1782758051.273100:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211570048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758051.273119:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758051.273138:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da601 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758051.273167:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758051.273177:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758051.273186:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758051.273268:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211570048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (9976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758051.273275:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1782758051.273509:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211570048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758051.273527:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758051.273537:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758051.273558:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758051.273563:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758051.273571:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758051.375276:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758051.757837:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758051.757867:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211570176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758051.757934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758051.758298:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570176 00000100:00100000:1.0:1782758051.758306:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570176 00000100:00100000:1.0:1782758051.758370:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1782758051.758379:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211570176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758051.758411:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758051.758455:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211570176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758051.758462:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1782758051.758503:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211570176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758051.758622:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758052.400136:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758053.049375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758053.049447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758053.049537:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714368 00000100:00100000:3.0:1782758053.049563:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714368 00000100:00100000:3.0:1782758053.049617:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1199 00000100:00100000:3.0:1782758053.049626:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196714368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758053.049725:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196714368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758053.049733:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1199 00000100:00100000:1.0:1782758053.050369:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714496 00000100:00100000:1.0:1782758053.050375:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714496 00000100:00100000:1.0:1782758053.050440:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1496 00000100:00100000:1.0:1782758053.050449:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196714496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758053.050500:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196714496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758053.050508:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1496 00000100:00080000:2.0:1782758053.052155:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758053.419989:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758053.804247:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211570560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.804319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758053.804371:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758053.804378:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211570688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.804406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758053.804439:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570560 00000100:00100000:3.0:1782758053.804447:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570560 00000100:00100000:3.0:1782758053.804497:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1782758053.804506:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211570560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.804561:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211570560:12345-0@lo:400:kworker.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758053.804568:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1782758053.804589:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570688 00000100:00100000:3.0:1782758053.804592:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570688 00000100:00100000:3.0:1782758053.804616:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1782758053.804621:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211570688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.804661:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211570688:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758053.804668:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:3.0:1782758053.804683:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758053.804686:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758053.804713:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211570688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.804724:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211570560:0@lo:400:kworker.0 00000100:00100000:0.0:1782758053.804784:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211570304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758053.804818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758053.804882:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211570816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758053.804903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758053.804918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758053.804924:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211570432:0@lo:400:kworker.0 00000100:00100000:0.0:1782758053.804945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758053.804959:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211570944:0@lo:400:kworker.0 00000100:00100000:0.0:1782758053.804992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758053.805188:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570304 00000100:00100000:3.0:1782758053.805193:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570304 00000100:00100000:3.0:1782758053.805225:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1782758053.805231:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211570304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758053.805267:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211570304:12345-0@lo:400:kworker.0 Request processed in 36us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758053.805273:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1782758053.805304:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211570304:0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.805662:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570816 00000100:00100000:1.0:1782758053.805667:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570816 00000100:00100000:1.0:1782758053.805708:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570432 00000100:00100000:1.0:1782758053.805711:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570432 00000100:00100000:1.0:1782758053.805729:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1782758053.805735:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211570816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.805777:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211570816:12345-0@lo:400:kworker.0 Request processed in 42us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758053.805783:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1782758053.805799:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1782758053.805805:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211570432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.805852:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211570432:12345-0@lo:400:kworker.0 Request processed in 47us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758053.805858:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1782758053.805890:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211570944 00000100:00100000:1.0:1782758053.805893:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211570944 00000100:00100000:1.0:1782758053.805918:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1782758053.805924:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211570944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.805954:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211570944:12345-0@lo:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758053.805960:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1782758053.806322:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211570432:0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.806332:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211570944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758053.806341:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211570816:0@lo:400:kworker.0 00000100:00080000:2.0:1782758053.807515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758053.807523:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758054.316201:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211571072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758054.316284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758054.316439:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571072 00000100:00100000:1.0:1782758054.316448:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571072 00000100:00100000:1.0:1782758054.316500:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1782758054.316510:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211571072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758054.316548:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758054.316602:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211571072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758054.316609:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1782758054.316689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211571072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758054.444722:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758055.474143:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758056.112192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758056.112235:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714624 00000100:00100000:1.0:1782758056.112245:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714624 00000100:00100000:1.0:1782758056.112327:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 816 00000100:00100000:1.0:1782758056.112356:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48692:x1869355196714624:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758056.112379:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758056.112464:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da60f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649aa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112535:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112551:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112565:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758056.112809:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758056.112813:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758056.112912:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112936:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da60f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649aa expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112952:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649aa expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.112961:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758056.112964:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758056.112967:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758056.113041:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48692:x1869355196714624:12345-192.168.204.31@tcp:101:rm.0 Request processed in 694us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758056.113048:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 816 00000100:00080000:1.0:1782758056.113193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758056.118324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758056.118571:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714752 00000100:00100000:1.0:1782758056.118583:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714752 00000100:00100000:1.0:1782758056.118693:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 817 00000100:00100000:1.0:1782758056.118705:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48692:x1869355196714752:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758056.118733:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758056.118757:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da61d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649b1 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118867:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118885:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118898:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118967:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118976:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.118983:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119535:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119546:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119553:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119560:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758056.119565:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119574:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119588:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758056.119592:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758056.119596:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119613:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119625:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119632:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119638:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119642:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758056.119645:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119651:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119658:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3a400) 00010000:00010000:1.0:1782758056.119661:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758056.119663:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119669:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da62b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119704:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da61d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649b1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119715:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758056.119718:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758056.119721:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da61d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649b1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.119730:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758056.119800:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48692:x1869355196714752:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1097us (1484us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758056.119809:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 817 00000100:00100000:1.0:1782758056.192908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758056.193144:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715136 00000100:00100000:3.0:1782758056.193157:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715136 00000100:00100000:3.0:1782758056.193246:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 818 00000100:00100000:3.0:1782758056.193260:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48696:x1869355196715136:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782758056.193338:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758056.193377:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649aa expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.193404:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758056.193418:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758056.195587:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.195626:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.195641:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.195657:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.195664:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.195670:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758056.197073:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00010000:00010000:3.0:1782758056.197093:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197104:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197112:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197118:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758056.197124:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197133:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197150:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758056.197153:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758056.197159:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.197166:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da632 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758056.197190:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ebc4c9f reply state 0000000043dc49fb transno 4294967614 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758056.197200:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758056.201354:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48696:x1869355196715136:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 8076us (8443us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1782758056.201372:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 818 00000100:00100000:0.0:1782758056.204261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758056.204721:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196714880 00000100:00100000:2.0:1782758056.204737:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196714880 00000100:00100000:2.0:1782758056.205423:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 819 00000100:00100000:2.0:1782758056.205440:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196714880:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782758056.205882:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782758056.206098:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196714880:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 662us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758056.206108:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 819 00010000:00010000:3.0:1782758056.210589:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210624:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210634:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210642:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758056.210650:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210659:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210681:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75100) 00010000:00010000:3.0:1782758056.210684:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758056.210690:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.210697:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da639 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758056.256552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758056.257289:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715264 00000100:00100000:1.0:1782758056.257303:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715264 00000100:00100000:1.0:1782758056.258159:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 820 00000100:00100000:1.0:1782758056.258174:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48700:x1869355196715264:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782758056.258214:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758056.258251:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649b8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.258340:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.258368:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.258380:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758056.261489:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758056.261503:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758056.261547:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.261613:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649b8 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.261644:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649b8 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.261655:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a400) 00010000:00010000:1.0:1782758056.261658:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758056.261662:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758056.261782:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48700:x1869355196715264:12345-192.168.204.31@tcp:101:chown.0 Request processed in 3610us (5244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758056.261793:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 820 00000100:00100000:1.0:1782758056.266545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758056.266650:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715392 00000100:00100000:3.0:1782758056.266664:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715392 00000100:00100000:3.0:1782758056.266738:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 821 00000100:00100000:3.0:1782758056.266914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48700:x1869355196715392:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782758056.266947:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758056.266976:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da64e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649bf expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267061:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267158:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267173:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267191:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267255:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.267264:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269225:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269251:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269265:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758056.269344:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00000004:00200000:3.0:1782758056.269348:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758056.269375:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269394:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269399:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269406:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269411:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758056.269415:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269422:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269434:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a400) 00010000:00010000:3.0:1782758056.269438:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758056.269441:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269447:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269462:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269468:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269474:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269479:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758056.269482:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269487:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269493:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75100) 00010000:00010000:3.0:1782758056.269496:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758056.269498:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269503:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777da65c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269540:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da64e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649bf expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269552:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649bf expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758056.269558:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758056.269560:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758056.269562:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758056.269649:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:48700:x1869355196715392:12345-192.168.204.31@tcp:101:chown.0 Request processed in 2875us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758056.269658:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 821 00000100:00100000:2.0:1782758056.278328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758056.280220:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715648 00000100:00100000:1.0:1782758056.280236:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715648 00000100:00100000:1.0:1782758056.280323:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 822 00000100:00100000:1.0:1782758056.280334:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:48700:x1869355196715648:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782758056.280407:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758056.280451:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649bf expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.280477:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758056.280494:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758056.280529:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.280550:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.280562:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758056.281042:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058cd988b reply state 000000008b3e4b0b transno 4294967615 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758056.281055:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758056.281434:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00000100:00100000:1.0:1782758056.282528:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48700:x1869355196715648:12345-192.168.204.31@tcp:36:chown.0 Request processed in 2187us (4209us total) trans 4294967615 rc 0/0 00000100:00100000:1.0:1782758056.282542:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 822 00010000:00010000:1.0:1782758056.293371:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293394:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293403:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293411:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758056.293417:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293426:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293446:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3a600) 00010000:00010000:1.0:1782758056.293449:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758056.293455:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758056.293461:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da66a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758056.492325:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758056.876322:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211571200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758056.876407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758056.876944:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571200 00000100:00100000:1.0:1782758056.876953:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571200 00000100:00100000:1.0:1782758056.877026:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782758056.877037:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211571200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758056.877075:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758056.877129:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211571200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758056.877137:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782758056.877191:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211571200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758056.877700:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782758057.041405:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967615 is committed 00000020:00000080:2.0:1782758057.508001:0:83019:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfa7f7330 20000000:00000080:2.0:1782758057.508022:0:83019:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312e400 uarg=0000000000000000 00010000:00010000:2.0:1782758057.508561:0:83019:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758057.508951:0:83019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a400) 00010000:00010000:2.0:1782758057.508957:0:83019:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758057.508970:0:83019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da647 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649b8 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758057.508996:0:83019:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758057.509018:0:83019:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758057.509036:0:83019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758057.509051:0:83019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758057.509061:0:83019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758057.509102:0:83019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758057.509117:0:83019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 18 pid: 5796 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758057.509133:0:83019:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83019:1869355211571328:0@lo:104: 00000100:00100000:2.0:1782758057.509210:0:83019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758057.509262:0:83019:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1782758057.509382:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571328 00000100:00100000:3.0:1782758057.509391:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571328 00000100:00100000:3.0:1782758057.509445:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782758057.509456:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:83019:x1869355211571328:12345-0@lo:104: 00010000:00010000:3.0:1782758057.509472:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509548:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758057.509555:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:83019:x1869355211571328:12345-0@lo:104: Request processed in 101us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758057.509561:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:3.0:1782758057.509599:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758057.509605:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509613:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758057.509617:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509625:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758057.509632:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758057.509638:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758057.509668:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509675:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758057.509696:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509704:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777da601 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da608 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509717:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758057.509719:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758057.509721:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758057.509739:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211571456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758057.509769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758057.509803:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571456 00000100:00100000:3.0:1782758057.509807:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571456 00010000:00010000:3.0:1782758057.509849:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 19 pid: 5796 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758057.509871:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782758057.509879:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211571456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758057.509891:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758057.509897:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 19 pid: 5796 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509907:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 19 pid: 5796 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509921:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509929:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509949:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509958:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509965:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509971:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509977:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758057.509982:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509989:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.509997:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758057.510005:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758057.510034:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211571456:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758057.510040:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782758057.510076:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211571456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758057.510163:0:83019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777da608 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da601 expref: 18 pid: 5796 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758057.510174:0:83019:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83019:1869355211571328:0@lo:104: 00010000:00010000:1.0:1782758057.510188:0:83019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758057.510197:0:83019:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758057.510203:0:83019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758057.510210:0:83019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777da671 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758057.517812:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758058.166676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758058.166752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758058.167549:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715904 00000100:00100000:1.0:1782758058.167573:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715904 00000100:00100000:1.0:1782758058.167653:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1500 00000100:00100000:1.0:1782758058.167664:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196715904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758058.167750:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196715904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758058.167759:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1500 00000100:00080000:2.0:1782758058.167971:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758058.168893:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196715776 00000100:00100000:0.0:1782758058.168902:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196715776 00000100:00100000:0.0:1782758058.168960:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1201 00000100:00100000:0.0:1782758058.168970:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196715776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758058.169025:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196715776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758058.169031:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1201 00010000:00010000:3.0:1782758058.545367:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758058.790764:0:83067:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd140f3c90 20000000:00000080:0.0:1782758058.790784:0:83067:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bc193000 uarg=0000000000000000 00010000:00010000:0.0:1782758058.791299:0:83067:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758058.791315:0:83067:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758058.791328:0:83067:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758058.791348:0:83067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791366:0:83067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791378:0:83067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791385:0:83067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791392:0:83067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791400:0:83067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791405:0:83067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758058.791410:0:83067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791420:0:83067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791434:0:83067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791441:0:83067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758058.791448:0:83067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777da678 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758058.924142:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211571840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758058.924220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758058.924279:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758058.924285:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211571712:0@lo:400:kworker.0 00000100:00100000:1.0:1782758058.924309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758058.924324:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211572224:0@lo:400:kworker.0 00000100:00100000:1.0:1782758058.924348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758058.924409:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211571968:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758058.924468:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758058.924475:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211571584:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758058.924567:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211572096:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758058.924623:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571584 00000100:00100000:2.0:1782758058.924632:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571584 00000100:00100000:2.0:1782758058.924675:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1782758058.924684:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211571584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924733:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211571584:12345-0@lo:400:kworker.0 Request processed in 50us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758058.924740:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1782758058.924773:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571840 00000100:00100000:2.0:1782758058.924776:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571840 00000100:00100000:2.0:1782758058.924810:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571712 00000100:00100000:2.0:1782758058.924814:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571712 00000100:00100000:2.0:1782758058.924863:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572096 00000100:00100000:2.0:1782758058.924866:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572096 00000100:00100000:2.0:1782758058.924883:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1782758058.924889:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211571840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924927:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211571840:12345-0@lo:400:kworker.0 Request processed in 38us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758058.924933:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1782758058.924946:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1782758058.924952:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211571712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.924978:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211571712:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758058.924984:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1782758058.924996:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1782758058.925002:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211572096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.925029:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211572096:12345-0@lo:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758058.925034:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00080000:2.0:1782758058.925054:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758058.925081:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211571584:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.925095:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211572096:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.925126:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211571712:0@lo:400:kworker.0 00000100:00100000:2.0:1782758058.925135:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211571840:0@lo:400:kworker.0 00000100:00100000:3.0:1782758058.925411:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572224 00000100:00100000:3.0:1782758058.925416:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572224 00000100:00100000:3.0:1782758058.925461:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211571968 00000100:00100000:3.0:1782758058.925464:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211571968 00000100:00100000:3.0:1782758058.925487:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1782758058.925508:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211572224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758058.925567:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211572224:12345-0@lo:400:kworker.0 Request processed in 73us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758058.925573:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1782758058.925584:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1782758058.925590:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211571968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758058.925622:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211571968:12345-0@lo:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758058.925627:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1782758058.925661:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211571968:0@lo:400:kworker.0 00000100:00100000:3.0:1782758058.925685:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211572224:0@lo:400:kworker.0 00000100:00080000:2.0:1782758058.927307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758058.927318:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1782758059.436892:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758059.436900:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758059.436904:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758059.437020:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758059.437031:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758059.437042:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758059.437069:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211572352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758059.437138:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758059.438090:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758059.438130:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572352 00000100:00100000:3.0:1782758059.438137:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572352 00000100:00100000:2.0:1782758059.439109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1782758059.439123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211572352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758059.439139:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758059.439162:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777da67f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758059.439198:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758059.439209:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758059.439217:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758059.439289:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211572352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758059.439295:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1782758059.439403:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211572480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758059.439439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758059.439582:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572480 00000100:00100000:2.0:1782758059.439587:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572480 00000100:00100000:2.0:1782758059.439631:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1782758059.439637:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211572480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758059.439663:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758059.439700:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211572480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758059.439706:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1782758059.441588:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211572480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758059.441629:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170812baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211572352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758059.441649:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758059.441660:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758059.441677:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758059.441683:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758059.441692:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758059.565283:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758060.588118:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758061.627724:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758061.996052:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758061.996073:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211572608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758061.996141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758061.996204:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572608 00000100:00100000:1.0:1782758061.996212:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572608 00000100:00100000:1.0:1782758061.996268:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1782758061.996277:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211572608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758061.996316:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758061.996361:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211572608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758061.996368:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00080000:1.0:1782758061.996389:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758061.996433:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211572608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758062.636315:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758063.296903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758063.296950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758063.297099:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716160 00000100:00100000:3.0:1782758063.297109:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716160 00000100:00100000:3.0:1782758063.297181:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1504 00000100:00100000:3.0:1782758063.297192:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196716160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758063.297262:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196716160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758063.297270:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1504 00000100:00100000:1.0:1782758063.297466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716032 00000100:00100000:1.0:1782758063.297471:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716032 00000100:00100000:1.0:1782758063.297501:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1204 00000100:00100000:1.0:1782758063.297508:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196716032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758063.297541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196716032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758063.297547:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1204 00000100:00080000:0.0:1782758063.299620:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758063.400941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758063.401075:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716288 00000100:00100000:0.0:1782758063.401085:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716288 00000100:00100000:0.0:1782758063.401148:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:0.0:1782758063.401158:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196716288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758063.401175:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758063.401179:0:7497:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777da647) 00010000:00010000:0.0:1782758063.401181:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758063.401231:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196716288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (302us total) trans 0 rc 116/116 00000100:00100000:0.0:1782758063.401237:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00010000:00010000:0.0:1782758063.662592:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758064.044431:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211572864:0@lo:400:kworker.0 00000100:00100000:0.0:1782758064.044511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758064.044554:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211573376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758064.044576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758064.044595:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758064.044600:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211572992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758064.044617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758064.044906:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572864 00000100:00100000:3.0:1782758064.044913:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572864 00000100:00100000:3.0:1782758064.044950:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572992 00000100:00100000:3.0:1782758064.044952:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572992 00000100:00100000:3.0:1782758064.044989:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1782758064.044998:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211572864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045063:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211572864:12345-0@lo:400:kworker.0 Request processed in 65us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045070:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1782758064.045086:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1782758064.045092:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211572992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045116:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211572992:12345-0@lo:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045122:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1782758064.045138:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573376 00000100:00100000:3.0:1782758064.045141:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573376 00000100:00100000:3.0:1782758064.045163:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1782758064.045168:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211573376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045194:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211573376:12345-0@lo:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045200:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:3.0:1782758064.045217:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758064.045221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758064.045251:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211572992:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045261:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211572864:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045269:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211573376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045304:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211573120:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758064.045343:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758064.045348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211572736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758064.045387:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211573248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758064.045422:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573120 00000100:00100000:3.0:1782758064.045425:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573120 00000100:00100000:3.0:1782758064.045469:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1782758064.045476:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211573120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045506:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211573120:12345-0@lo:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045515:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1782758064.045529:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211572736 00000100:00100000:3.0:1782758064.045531:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211572736 00000100:00100000:3.0:1782758064.045552:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1782758064.045557:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211572736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045582:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211572736:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045588:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1782758064.045609:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573248 00000100:00100000:3.0:1782758064.045612:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573248 00000100:00100000:3.0:1782758064.045642:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1782758064.045648:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211573248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045671:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211573248:12345-0@lo:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758064.045677:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00080000:3.0:1782758064.045691:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758064.045694:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758064.045705:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211572736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045713:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211573248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758064.045721:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211573120:0@lo:400:kworker.0 00000100:00100000:1.0:1782758064.556451:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211573504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758064.556531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758064.556599:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573504 00000100:00100000:1.0:1782758064.556607:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573504 00000100:00100000:1.0:1782758064.556662:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1782758064.556671:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211573504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758064.556706:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758064.556749:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211573504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758064.556769:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1782758064.556845:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211573504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758064.684132:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758065.270415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.278621:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716416 00000100:00100000:3.0:1782758065.278636:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716416 00000100:00100000:3.0:1782758065.278736:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 823 00000100:00100000:3.0:1782758065.278748:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48805:x1869355196716416:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758065.278770:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758065.278794:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da68d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649c6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.278881:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.278896:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.278909:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758065.279126:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758065.279131:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758065.279209:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.279234:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649c6 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.279252:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649c6 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.279260:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758065.279263:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758065.279267:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758065.279336:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48805:x1869355196716416:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 590us (8931us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758065.279345:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 823 00000100:00080000:2.0:1782758065.279755:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758065.297676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.297784:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716544 00000100:00100000:3.0:1782758065.297794:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716544 00000100:00100000:3.0:1782758065.297879:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 824 00000100:00100000:3.0:1782758065.297890:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48805:x1869355196716544:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758065.297912:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758065.297934:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da69b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649cd expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.297998:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298014:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298025:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298037:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298044:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298050:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298400:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298410:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298430:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758065.298526:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:3.0:1782758065.298531:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758065.298608:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298622:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298629:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298635:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298640:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758065.298644:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298650:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298662:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758065.298665:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758065.298669:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298675:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da6a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298688:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298698:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298703:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298708:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758065.298710:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298898:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298909:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75800) 00010000:00010000:3.0:1782758065.298912:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758065.298915:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298921:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da6a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298954:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da69b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649cd expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298968:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649cd expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.298975:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782758065.298978:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758065.298981:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782758065.299049:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48805:x1869355196716544:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1160us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758065.299058:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 824 00000100:00100000:2.0:1782758065.307431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.307503:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716800 00000100:00100000:3.0:1782758065.307514:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716800 00000100:00100000:3.0:1782758065.307574:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 825 00000100:00100000:3.0:1782758065.307584:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48805:x1869355196716800:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758065.307640:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758065.307667:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649cd expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.307688:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782758065.307699:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758065.307724:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.307747:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.307758:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758065.389444:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967616 is committed 00000004:00010000:0.0:1782758065.391776:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000816120fb reply state 0000000063d126de transno 4294967616 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758065.391793:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758065.391995:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00080000:0.0:1782758065.404493:0:5801:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782758065.404527:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48805:x1869355196716800:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 96936us (97110us total) trans 4294967616 rc 0/0 00000100:00100000:0.0:1782758065.404538:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 825 00010000:00010000:1.0:1782758065.405031:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405043:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405052:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405065:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758065.405070:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405079:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405097:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782758065.405100:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758065.405105:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.405112:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777da6b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758065.566041:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758065.566162:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196716928 00000100:00100000:1.0:1782758065.566173:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196716928 00000100:00100000:1.0:1782758065.566233:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 826 00000100:00100000:1.0:1782758065.566243:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48809:x1869355196716928:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758065.566267:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758065.566286:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da6be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649d4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566349:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566365:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566377:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566392:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566399:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.566421:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567121:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567130:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567138:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758065.567226:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1782758065.567230:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758065.567316:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567329:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567335:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567342:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567351:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758065.567355:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567361:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567374:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758065.567377:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758065.567382:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567388:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567400:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567424:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567430:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567435:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758065.567438:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567443:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567455:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758065.567458:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758065.567460:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567466:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da6cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567498:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da6be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649d4 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567511:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649d4 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.567518:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758065.567521:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758065.567523:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758065.567584:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48809:x1869355196716928:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1342us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758065.567592:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 826 00000100:00100000:2.0:1782758065.578171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758065.578210:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196717184 00000100:00100000:2.0:1782758065.578219:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196717184 00000100:00100000:2.0:1782758065.578273:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 827 00000100:00100000:2.0:1782758065.578283:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48809:x1869355196717184:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758065.578304:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758065.578327:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da6da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649db expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578659:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578673:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578684:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578696:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578702:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.578709:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758065.579553:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:2.0:1782758065.579841:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da6ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579854:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579863:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579898:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579906:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579912:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579918:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758065.579922:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579929:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579941:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758065.579944:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758065.579949:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.579959:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da6e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758065.579971:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003629e94e reply state 0000000088600e07 transno 4294967617 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758065.579980:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758065.580011:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da6da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649db expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.580026:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649db expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.580032:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:2.0:1782758065.580034:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758065.580036:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758065.580101:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48809:x1869355196717184:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1820us (1939us total) trans 4294967617 rc 0/0 00000100:00100000:2.0:1782758065.580109:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 827 00010000:00010000:3.0:1782758065.587707:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.587725:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.587733:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.587740:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758065.587744:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.587752:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.588011:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff917182dd1600) 00010000:00010000:3.0:1782758065.588016:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758065.588021:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.588027:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da6e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758065.597096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.597326:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196717440 00000100:00100000:3.0:1782758065.597344:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196717440 00000100:00100000:3.0:1782758065.597433:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 828 00000100:00100000:3.0:1782758065.597446:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48809:x1869355196717440:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:3.0:1782758065.597530:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758065.597570:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da6ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649db expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.597599:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:3.0:1782758065.597613:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758065.597673:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.597691:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.597705:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758065.597941:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013a7f112 reply state 000000009a095b11 transno 4294967618 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758065.597952:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758065.598223:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48809:x1869355196717440:12345-192.168.204.31@tcp:36:touch.0 Request processed in 778us (1134us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1782758065.598232:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 828 00010000:00010000:1.0:1782758065.609215:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.609238:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.609246:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.609258:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758065.609264:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.609273:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758065.609285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782758065.609307:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff917191f75500) 00010000:00010000:1.0:1782758065.609312:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758065.609319:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758065.609326:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777da6fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758065.609375:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196717568 00000100:00100000:0.0:1782758065.609386:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196717568 00000100:00100000:0.0:1782758065.609464:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 829 00000100:00100000:0.0:1782758065.609475:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48809:x1869355196717568:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758065.609499:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758065.609521:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649e2 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758065.609579:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e2 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758065.609597:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e2 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758065.609615:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758065.609618:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782758065.609621:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758065.609683:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48809:x1869355196717568:12345-192.168.204.31@tcp:101:touch.0 Request processed in 210us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758065.609690:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 829 00000100:00100000:2.0:1782758065.614129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.614217:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196717696 00000100:00100000:3.0:1782758065.614233:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196717696 00000100:00100000:3.0:1782758065.614297:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 452 00000100:00100000:3.0:1782758065.614310:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196717696:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:3.0:1782758065.614363:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2134 last 0 00000020:00000080:3.0:1782758065.614401:0:6598:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777da70b 00002000:00100000:3.0:1782758065.614465:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917081afe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758065.614497:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758065.614804:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782758065.614886:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917081aff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758065.614985:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196717696:12345-192.168.204.31@tcp:8:touch.0 Request processed in 676us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758065.615102:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 452 00000100:00100000:1.0:1782758065.619798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.620017:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196717824 00000100:00100000:3.0:1782758065.620031:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196717824 00000100:00100000:3.0:1782758065.620099:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 453 00000100:00100000:3.0:1782758065.620113:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196717824:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:2.0:1782758065.620866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758065.711216:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758065.715717:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:0:x1869355196717824:12345-192.168.204.31@tcp:2:touch.0 Request processed in 95594us (95920us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1782758065.715742:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 453 00000001:00080000:2.0:1782758065.715947:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000001:00100000:2.0:1782758065.716146:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:2.0:1782758065.731183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.731912:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718080 00000100:00100000:3.0:1782758065.731932:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718080 00000100:00100000:3.0:1782758065.733060:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:3.0:1782758065.733082:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48809:x1869355196718080:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:2.0:1782758065.734889:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48809:x1869355196718080:12345-192.168.204.31@tcp:35:touch.0 Request processed in 1807us (3706us total) trans 4294967619 rc 0/0 00000100:00100000:2.0:1782758065.734903:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:0.0:1782758065.884051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758065.888134:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718208 00000100:00100000:2.0:1782758065.888152:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718208 00000100:00100000:2.0:1782758065.888302:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 830 00000100:00100000:2.0:1782758065.888315:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48813:x1869355196718208:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758065.888341:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758065.888364:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da712 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649e9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888450:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888465:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888476:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888491:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888498:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888504:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888614:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888623:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888629:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758065.888664:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00000004:00200000:2.0:1782758065.888668:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758065.888687:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888698:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888705:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888710:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888715:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888720:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758065.888724:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888729:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888742:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758065.888745:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758065.888749:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888767:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888780:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888787:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888792:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888799:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758065.888801:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888807:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888814:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff917182dd1900) 00010000:00010000:2.0:1782758065.888817:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758065.888866:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888874:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888908:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da712 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e9 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888921:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e9 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.888927:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:2.0:1782758065.888930:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758065.888932:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782758065.890664:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48813:x1869355196718208:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2343us (6614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758065.890677:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 830 00000100:00100000:1.0:1782758065.895309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758065.895434:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718336 00000100:00100000:0.0:1782758065.895444:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718336 00000100:00100000:0.0:1782758065.895510:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 454 00000100:00100000:0.0:1782758065.895520:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196718336:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758065.895541:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758065.895561:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649f0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758065.895588:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6a42bab0, atime: 0x6a42bab0, ctime: 0x6a42bab0, blocks: 0x1 00010000:00010000:0.0:1782758065.895608:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=2134s v=(0 0) 00010000:00010000:0.0:1782758065.895613:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758065.895622:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758065.895641:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758065.895656:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782758065.895726:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196718336:12345-192.168.204.31@tcp:101:rm.0 Request processed in 208us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758065.895733:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 454 00000100:00100000:0.0:1782758065.902698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758065.902778:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718592 00000100:00100000:3.0:1782758065.902788:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718592 00000100:00100000:3.0:1782758065.902867:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 831 00000100:00100000:3.0:1782758065.902878:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48813:x1869355196718592:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758065.902936:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758065.902965:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e9 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.902987:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777da704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649e2 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.902998:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:3.0:1782758065.903010:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758065.903033:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903046:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903054:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903071:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903079:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903085:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903201:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903210:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903217:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758065.903797:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:3.0:1782758065.903809:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2134306985608ns, next at 2135306982868ns, rc = 0 00010000:00010000:3.0:1782758065.903921:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903931:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903939:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903947:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903957:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903962:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.903983:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758065.904004:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904010:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904017:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904023:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758065.904027:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904034:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904042:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758065.904045:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758065.904049:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904054:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904069:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904076:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904081:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904086:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758065.904089:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904095:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904102:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:3.0:1782758065.904105:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758065.904107:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758065.904112:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758065.904122:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bcfa7c5 reply state 00000000a4de6ca4 transno 4294967620 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758065.904131:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758065.904205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48813:x1869355196718592:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1326us (1514us total) trans 4294967620 rc 0/0 00000100:00100000:3.0:1782758065.904213:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 831 00010000:00010000:2.0:1782758065.905452:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758065.905461:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.905469:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758065.905473:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.905480:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.905493:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782758065.905495:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782758065.905498:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.905504:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777da74a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.905522:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758065.905524:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758065.905526:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758065.938184:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938201:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938210:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938216:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758065.938221:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938228:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938245:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff917191f75c00) 00010000:00010000:2.0:1782758065.938248:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758065.938253:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758065.938259:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777da73c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758066.732896:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758067.116174:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2135519348307ns, next at 2136519345140ns, rc = 0 00000100:00100000:0.0:1782758067.116294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758067.116324:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211573632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758067.116436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758067.117125:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573632 00000100:00100000:1.0:1782758067.117135:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573632 00000100:00100000:1.0:1782758067.117221:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1782758067.117233:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211573632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758067.117266:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782758067.117413:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758067.117566:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211573632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758067.117574:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1782758067.118459:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211573632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758067.728363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758067.728542:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718720 00000100:00100000:1.0:1782758067.728553:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718720 00000100:00100000:1.0:1782758067.728630:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 832 00000100:00100000:1.0:1782758067.728641:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48829:x1869355196718720:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758067.728664:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758067.728682:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649f7 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728752:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728765:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728777:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758067.728875:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1782758067.728879:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758067.728916:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728940:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f7 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728957:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f7 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.728966:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758067.728970:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758067.728974:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758067.729029:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48829:x1869355196718720:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 391us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758067.729036:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 832 00000100:00080000:3.0:1782758067.729936:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758067.734718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758067.734938:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196718976 00000100:00100000:1.0:1782758067.734948:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196718976 00000100:00100000:1.0:1782758067.735006:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 833 00000100:00100000:1.0:1782758067.735017:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48829:x1869355196718976:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758067.735075:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758067.735101:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f7 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.735123:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da6d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649d4 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.735135:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758067.735148:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758067.735173:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.735185:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.735195:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.767147:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758067.877779:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967621 is committed 00000004:00080000:0.0:1782758067.877799:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000100:00100000:0.0:1782758067.877971:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211573760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758067.878039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758067.878111:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211573760 00000100:00100000:0.0:1782758067.878118:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211573760 00000100:00100000:0.0:1782758067.878333:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1782758067.878344:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211573760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782758067.878396:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00010000:00010000:0.0:1782758067.878422:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.878444:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.878453:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782758067.878458:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758067.878462:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.878489:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.878504:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 5 pid: 9120 timeout: 2236 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758067.878518:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211573888:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758067.878577:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46240 going to sleep for 11 seconds 00000004:00080000:0.0:1782758067.878721:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00000004:00010000:1.0:1782758067.878855:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024160336 reply state 00000000fa634db2 transno 4294967621 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758067.878870:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758067.879057:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00080000:1.0:1782758067.879154:0:5803:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758067.879172:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48829:x1869355196718976:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 144155us (144461us total) trans 4294967621 rc 0/0 00000100:00100000:1.0:1782758067.879180:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 833 00010000:00010000:1.0:1782758067.879215:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879223:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879230:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879236:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758067.879240:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879246:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879260:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758067.879264:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758067.879268:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.879274:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da75f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758067.907863:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211573888:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758067.907899:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758067.912929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758067.916506:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196719104 00000100:00100000:3.0:1782758067.916521:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196719104 00010000:00010000:3.0:1782758067.916593:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 2236 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758067.916886:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00100000:3.0:1782758067.916897:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196719104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758067.916914:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758067.916921:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 2236 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.917105:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 2236 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.917132:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b2f5251/0xdd99f5c4777da72e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649f0 expref: 6 pid: 9120 timeout: 2236 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.918309:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758067.918314:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758067.918321:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.918333:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.918382:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758067.918447:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196719104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1550us (5527us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758067.918457:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00080000:2.0:1782758067.919353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758067.919837:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.919855:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.919874:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.919881:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.919903:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782758067.920590:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211573760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42244us (42547us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1782758067.920603:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00010000:0.0:1782758067.920644:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758067.920650:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.920660:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758067.920664:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.920674:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.920706:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.920713:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777da766 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758067.920738:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758067.920740:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758067.920741:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758067.920782:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170826a3b80/2, rc 0, transno 4294967349 00000100:00100000:0.0:1782758067.920790:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211573760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782758067.979102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758067.979198:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196719232 00000100:00100000:3.0:1782758067.979208:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196719232 00000100:00100000:3.0:1782758067.979271:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 834 00000100:00100000:3.0:1782758067.979281:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48833:x1869355196719232:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758067.979304:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758067.979390:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da76d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf649fe expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979456:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979471:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979482:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979509:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979517:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.979550:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980026:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980040:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980048:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758067.980133:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:3.0:1782758067.980138:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758067.980218:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980231:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980237:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980244:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980251:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758067.980255:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980262:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980275:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758067.980278:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758067.980283:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980293:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980305:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980312:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980317:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980322:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758067.980324:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980330:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980337:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75800) 00010000:00010000:3.0:1782758067.980340:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758067.980343:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980348:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da77b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980391:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da76d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649fe expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980413:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649fe expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758067.980420:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758067.980422:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758067.980424:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758067.980497:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48833:x1869355196719232:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1217us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758067.980504:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 834 00000100:00100000:3.0:1782758067.986165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758067.986672:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196719488 00000100:00100000:0.0:1782758067.987101:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196719488 00000100:00100000:0.0:1782758067.987211:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 835 00000100:00100000:0.0:1782758067.987226:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:48833:x1869355196719488:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758067.987356:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758067.987400:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da789 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a05 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987781:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987796:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987808:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987882:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987890:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.987898:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758067.989087:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:1.0:1782758067.991330:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991354:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991378:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991422:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991429:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991436:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991441:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758067.991445:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991452:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991467:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758067.991470:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758067.991474:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991480:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da790 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758067.991494:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c8b9312 reply state 0000000053512743 transno 4294967622 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758067.991503:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758067.991541:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da789 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a05 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991561:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a05 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.991569:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758067.991572:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758067.991574:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758067.992519:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48833:x1869355196719488:12345-192.168.204.31@tcp:101:touch.0 Request processed in 5289us (6359us total) trans 4294967622 rc 0/0 00000100:00100000:1.0:1782758067.992530:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 835 00010000:00010000:1.0:1782758067.998965:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.998987:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.998996:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.999003:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758067.999010:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.999020:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.999041:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758067.999045:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758067.999051:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758067.999060:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da797 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758068.004373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.005517:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196719744 00000100:00100000:1.0:1782758068.005532:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196719744 00000100:00100000:1.0:1782758068.005642:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 836 00000100:00100000:1.0:1782758068.005654:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48833:x1869355196719744:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782758068.005743:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758068.005775:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a05 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.005797:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758068.005853:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758068.005923:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.005941:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.006181:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758068.006363:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002cd50557 reply state 00000000d999f099 transno 4294967623 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758068.006385:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758068.006510:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48833:x1869355196719744:12345-192.168.204.31@tcp:36:touch.0 Request processed in 856us (2158us total) trans 4294967623 rc 0/0 00000100:00100000:1.0:1782758068.006518:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 836 00010000:00010000:2.0:1782758068.010130:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010154:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010164:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010171:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758068.010177:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010186:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010207:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782758068.010211:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758068.010216:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.010223:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da7ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758068.011363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.011710:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196719872 00000100:00100000:1.0:1782758068.012058:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196719872 00000100:00100000:1.0:1782758068.012125:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 837 00000100:00100000:1.0:1782758068.012137:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48833:x1869355196719872:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758068.012167:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758068.012196:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da7b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a0c expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.012269:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a0c expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.012287:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a0c expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.012319:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758068.012322:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758068.012326:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758068.012588:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48833:x1869355196719872:12345-192.168.204.31@tcp:101:touch.0 Request processed in 451us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758068.012597:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 837 00000100:00100000:0.0:1782758068.019496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758068.019697:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720000 00000100:00100000:3.0:1782758068.019709:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720000 00000100:00100000:3.0:1782758068.019763:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 456 00000100:00100000:3.0:1782758068.019773:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196720000:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:3.0:1782758068.019817:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2136 last 0 00000020:00000080:3.0:1782758068.019898:0:9120:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777da7ba 00002000:00100000:3.0:1782758068.020086:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917081af9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758068.020117:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758068.020418:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782758068.020454:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917081af9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758068.020580:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196720000:12345-192.168.204.31@tcp:8:touch.0 Request processed in 807us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758068.020594:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 456 00000100:00100000:0.0:1782758068.025208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.025304:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720128 00000100:00100000:1.0:1782758068.025325:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720128 00000100:00100000:1.0:1782758068.025416:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 457 00000100:00100000:1.0:1782758068.025427:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196720128:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:3.0:1782758068.026204:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782758068.097774:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00000001:00100000:3.0:1782758068.097800:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:1.0:1782758068.098263:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196720128:12345-192.168.204.31@tcp:2:touch.0 Request processed in 72828us (73058us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1782758068.098278:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 457 00000100:00100000:0.0:1782758068.111474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758068.111918:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720384 00000100:00100000:3.0:1782758068.111932:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720384 00000100:00100000:3.0:1782758068.112081:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:3.0:1782758068.112095:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:48833:x1869355196720384:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782758068.112566:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48833:x1869355196720384:12345-192.168.204.31@tcp:35:touch.0 Request processed in 472us (1106us total) trans 4294967624 rc 0/0 00000100:00100000:3.0:1782758068.112576:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:3.0:1782758068.189645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.190023:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720512 00000100:00100000:1.0:1782758068.190035:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720512 00000100:00100000:1.0:1782758068.190112:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 838 00000100:00100000:1.0:1782758068.190123:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48837:x1869355196720512:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758068.190157:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758068.190192:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a13 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190271:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190288:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190301:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190317:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190324:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190330:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190459:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190469:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190482:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758068.190524:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x45:0x0]: returning size 0 00000004:00200000:1.0:1782758068.190529:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758068.190550:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190563:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190572:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190579:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190586:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190593:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758068.190598:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190606:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190620:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758068.190624:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758068.190629:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190640:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190656:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190663:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190669:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190674:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758068.190676:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190682:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190688:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3a300) 00010000:00010000:1.0:1782758068.190690:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758068.190692:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.190699:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.191686:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a13 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.191713:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a13 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.191723:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758068.191726:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758068.191729:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758068.191903:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48837:x1869355196720512:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1780us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758068.191912:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 838 00000100:00100000:0.0:1782758068.196810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758068.197083:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720640 00000100:00100000:3.0:1782758068.197097:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720640 00000100:00100000:3.0:1782758068.197169:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 458 00000100:00100000:3.0:1782758068.197181:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196720640:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758068.197204:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758068.197229:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a1a expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758068.197260:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6a42bab3, atime: 0x6a42bab3, ctime: 0x6a42bab3, blocks: 0x1 00010000:00010000:3.0:1782758068.197283:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=2136s v=(0 0) 00010000:00010000:3.0:1782758068.197288:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758068.197299:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758068.197327:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758068.197343:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758068.197429:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196720640:12345-192.168.204.31@tcp:101:rm.0 Request processed in 249us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758068.197437:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 458 00000100:00100000:2.0:1782758068.203538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.203656:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196720896 00000100:00100000:1.0:1782758068.203669:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196720896 00000100:00100000:1.0:1782758068.203752:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 839 00000100:00100000:1.0:1782758068.203770:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48837:x1869355196720896:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:1.0:1782758068.203878:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758068.203912:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da7d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a13 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.203937:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da7b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a0c expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.203949:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758068.203973:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758068.204000:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204016:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204027:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204045:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204053:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204060:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204196:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204205:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204212:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782758068.204899:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:1.0:1782758068.204911:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2136608087715ns, next at 2137608085168ns, rc = 0 00010000:00010000:1.0:1782758068.204979:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204989:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.204999:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205008:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205022:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205029:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205060:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758068.205085:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205091:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205099:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205105:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758068.205110:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205117:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205127:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758068.205131:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758068.205134:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205141:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da7f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205156:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205164:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205170:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205175:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758068.205177:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205182:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205188:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758068.205191:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758068.205194:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758068.205199:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777da7e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758068.205207:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f82f35eb reply state 0000000099ec1210 transno 4294967625 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758068.205218:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758068.205309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48837:x1869355196720896:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1545us (1783us total) trans 4294967625 rc 0/0 00000100:00100000:1.0:1782758068.205319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 839 00010000:00010000:2.0:1782758068.206408:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758068.206419:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.206427:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758068.206431:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.206441:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.206455:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758068.206458:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782758068.206461:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.206468:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777da7f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.206489:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758068.206491:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758068.206493:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758068.208491:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208509:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208517:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208524:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758068.208530:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208539:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208557:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3a300) 00010000:00010000:2.0:1782758068.208561:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758068.208565:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758068.208573:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777da7eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758068.404736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758068.405239:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721024 00000100:00100000:1.0:1782758068.405254:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721024 00000100:00100000:1.0:1782758068.405324:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1206 00000100:00100000:1.0:1782758068.405334:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196721024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758068.405445:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196721024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 112us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758068.405453:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1206 00010000:00010000:3.0:1782758068.789045:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758069.166544:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211574144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166697:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211574656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166753:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758069.166760:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211574016:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166814:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211574528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166886:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211574272:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166930:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758069.166934:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.166953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.166984:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574656 00000100:00100000:0.0:1782758069.166991:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574656 00000100:00100000:0.0:1782758069.167040:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574400 00000100:00100000:0.0:1782758069.167043:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574400 00000100:00100000:0.0:1782758069.167065:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1782758069.167076:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167129:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211574656:12345-0@lo:400:kworker.0 Request processed in 56us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167136:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1782758069.167152:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1782758069.167158:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211574400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167188:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211574400:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167194:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1782758069.167211:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574016 00000100:00100000:0.0:1782758069.167214:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574016 00000100:00100000:0.0:1782758069.167237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1782758069.167242:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211574016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167267:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211574016:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1782758069.167298:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574144 00000100:00100000:0.0:1782758069.167301:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574144 00000100:00100000:0.0:1782758069.167324:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574528 00000100:00100000:0.0:1782758069.167326:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574528 00000100:00100000:0.0:1782758069.167341:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574272 00000100:00100000:0.0:1782758069.167356:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574272 00000100:00100000:0.0:1782758069.167374:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1782758069.167379:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211574144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167407:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211574144:12345-0@lo:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167412:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1782758069.167423:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1782758069.167429:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211574528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167453:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211574528:12345-0@lo:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167458:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1782758069.167468:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:0.0:1782758069.167473:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211574272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167498:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211574272:12345-0@lo:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.167503:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00080000:0.0:1782758069.167524:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758069.167529:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758069.167531:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758069.167577:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167589:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211574272:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167614:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211574016:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167624:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211574528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167632:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211574144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758069.167641:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211574656:0@lo:400:kworker.0 00000004:00080000:0.0:1782758069.676954:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2138080128187ns, next at 2139080125416ns, rc = 0 00000100:00100000:3.0:1782758069.676965:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758069.677050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758069.677239:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574784 00000100:00100000:0.0:1782758069.677247:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574784 00000100:00100000:0.0:1782758069.677307:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1782758069.677318:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211574784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758069.677370:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758069.677445:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211574784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.677452:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1782758069.677503:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758069.697654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758069.697740:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721152 00000100:00100000:2.0:1782758069.697750:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721152 00000100:00100000:2.0:1782758069.697850:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 840 00000100:00100000:2.0:1782758069.697862:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48851:x1869355196721152:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758069.697888:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758069.697909:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a21 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.697977:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.697993:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.698005:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758069.698069:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1782758069.698073:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758069.698101:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.698129:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a21 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.698150:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a21 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758069.698159:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:2.0:1782758069.698162:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758069.698166:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00080000:3.0:1782758069.698236:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758069.698326:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48851:x1869355196721152:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 465us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758069.698345:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 840 00000100:00100000:0.0:1782758069.713851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758069.713963:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721408 00000100:00100000:1.0:1782758069.714042:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721408 00000100:00100000:1.0:1782758069.714107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 841 00000100:00100000:1.0:1782758069.714118:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48851:x1869355196721408:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758069.714175:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758069.714204:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a21 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.714226:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777da782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649fe expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.714238:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758069.714248:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758069.714273:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.714288:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.714299:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758069.714532:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001c3fa4b reply state 000000006a8a293d transno 4294967626 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758069.714539:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758069.714550:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:1.0:1782758069.714625:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48851:x1869355196721408:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 510us (803us total) trans 4294967626 rc 0/0 00000100:00100000:1.0:1782758069.714631:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 841 00010000:00010000:1.0:1782758069.729062:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729078:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729085:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729092:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758069.729097:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729106:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729126:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758069.729129:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758069.729134:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758069.729141:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da80e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758069.804254:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758069.942471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758069.942585:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721536 00000100:00100000:2.0:1782758069.942595:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721536 00000100:00100000:2.0:1782758069.942666:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 842 00000100:00100000:2.0:1782758069.942677:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196721536:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758069.942784:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196721536:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758069.942792:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 842 00000100:00100000:1.0:1782758069.947146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.947264:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721664 00000100:00100000:0.0:1782758069.947275:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721664 00000100:00100000:0.0:1782758069.947369:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 459 00000100:00100000:0.0:1782758069.947381:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48863:x1869355196721664:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:3.0:1782758069.947438:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758069.947757:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48863:x1869355196721664:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 377us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.947769:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 459 00000100:00100000:1.0:1782758069.951352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.952511:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721792 00000100:00100000:0.0:1782758069.952524:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721792 00000100:00100000:0.0:1782758069.952599:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 460 00000100:00100000:0.0:1782758069.952611:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48863:x1869355196721792:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758069.953057:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48863:x1869355196721792:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 447us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.953065:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 460 00000100:00100000:2.0:1782758069.960090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758069.960194:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196721920 00000100:00100000:1.0:1782758069.960205:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196721920 00000100:00100000:1.0:1782758069.960269:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 843 00000100:00100000:1.0:1782758069.960281:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196721920:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758069.961098:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196721920:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 814us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758069.961111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 843 00000100:00100000:1.0:1782758069.972258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.972754:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722048 00000100:00100000:0.0:1782758069.972768:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722048 00000100:00100000:0.0:1782758069.972898:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 844 00000100:00100000:0.0:1782758069.972911:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196722048:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758069.973026:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196722048:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 117us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.973034:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 844 00000100:00100000:2.0:1782758069.975574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.975678:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722176 00000100:00100000:0.0:1782758069.975689:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722176 00000100:00100000:0.0:1782758069.975750:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 461 00000100:00100000:0.0:1782758069.975761:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48863:x1869355196722176:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758069.976670:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48863:x1869355196722176:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 906us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.976680:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 461 00000100:00100000:3.0:1782758069.985595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.985920:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722304 00000100:00100000:0.0:1782758069.985931:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722304 00000100:00100000:0.0:1782758069.985993:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 462 00000100:00100000:0.0:1782758069.986005:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48863:x1869355196722304:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758069.986378:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48863:x1869355196722304:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 375us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.986386:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 462 00000100:00100000:1.0:1782758069.990926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758069.991032:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722432 00000100:00100000:0.0:1782758069.991043:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722432 00000100:00100000:0.0:1782758069.991114:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 845 00000100:00100000:0.0:1782758069.991124:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196722432:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758069.992193:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48863:x1869355196722432:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1065us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758069.992205:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 845 00000100:00100000:1.0:1782758070.101584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758070.103127:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722560 00000100:00100000:0.0:1782758070.103141:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722560 00000100:00100000:0.0:1782758070.103207:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 846 00000100:00100000:0.0:1782758070.103218:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:48867:x1869355196722560:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782758070.103239:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758070.103261:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a28 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103344:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103359:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103371:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103388:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103396:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.103403:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104281:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104294:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104303:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758070.104367:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1782758070.104372:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758070.104562:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104579:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104585:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104593:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104598:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758070.104603:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104610:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104626:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:0.0:1782758070.104630:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758070.104636:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104642:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777da81c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104673:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104679:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104685:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104690:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758070.104692:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104697:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104704:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758070.104707:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758070.104710:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104716:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104751:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a28 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104769:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a28 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758070.104776:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782758070.104779:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758070.104793:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758070.105392:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48867:x1869355196722560:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2173us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758070.105401:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 846 00000100:00100000:2.0:1782758070.111533:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758070.111623:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722816 00000100:00100000:1.0:1782758070.111633:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722816 00000100:00100000:1.0:1782758070.111710:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 847 00000100:00100000:1.0:1782758070.111720:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:48867:x1869355196722816:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758070.111741:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758070.111762:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da831 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a2f expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112451:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112468:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112479:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112494:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112501:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.112507:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758070.114260:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1782758070.114531:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114547:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114557:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114595:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114603:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114609:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114615:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758070.114619:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114629:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114641:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:1.0:1782758070.114644:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758070.114649:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114654:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da838 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758070.114668:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000455d5df8 reply state 000000000d21a3b5 transno 4294967627 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758070.114677:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758070.114710:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da831 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a2f expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114723:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a2f expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.114730:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782758070.114732:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758070.114734:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758070.115307:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+15:48867:x1869355196722816:12345-192.168.204.31@tcp:101:dd.0 Request processed in 3586us (3784us total) trans 4294967627 rc 0/0 00000100:00100000:1.0:1782758070.115318:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 847 00010000:00010000:2.0:1782758070.128306:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128333:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128341:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128348:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758070.128353:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128361:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128381:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3a200) 00010000:00010000:2.0:1782758070.128385:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758070.128389:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.128395:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da83f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758070.129399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758070.129470:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196722944 00000100:00100000:1.0:1782758070.129481:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196722944 00000100:00100000:1.0:1782758070.129538:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 463 00000100:00100000:1.0:1782758070.129549:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:48867:x1869355196722944:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758070.129568:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758070.129590:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a36 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758070.129616:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782758070.129636:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=2138s v=(0 0) 00010000:00010000:1.0:1782758070.129641:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758070.129657:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.129675:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758070.129688:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758070.129750:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:48867:x1869355196722944:12345-192.168.204.31@tcp:101:dd.0 Request processed in 202us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758070.129758:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 463 00000100:00100000:1.0:1782758070.169560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758070.169678:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723072 00000100:00100000:2.0:1782758070.169688:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723072 00002000:00100000:2.0:1782758070.169747:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9171b3121c00 x1869355196723072/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:741/0 lens 488/0 e 0 to 0 dl 1782758081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782758070.169758:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b3121c00 with x1869355196723072 ext(0->1048575) 00002000:00010000:2.0:1782758070.169765:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b3121c00 00000100:00100000:2.0:1782758070.170300:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1782758070.170336:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196723072:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:0.0:1782758070.257101:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196723072:12345-192.168.204.31@tcp:4:dd.0 Request processed in 86760us (87531us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782758070.257120:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00002000:00100000:0.0:1782758070.257136:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9171b3121c00 x1869355196723072/t4294967350(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:741/0 lens 488/448 e 0 to 0 dl 1782758081 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782758070.257150:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b3121c00 with x1869355196723072 ext(0->1048575) 00002000:00010000:0.0:1782758070.257160:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b3121c00 00000100:00100000:2.0:1782758070.277604:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758070.277864:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723200 00000100:00100000:3.0:1782758070.277878:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723200 00000100:00100000:3.0:1782758070.277961:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 848 00000100:00100000:3.0:1782758070.277971:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+14:48867:x1869355196723200:12345-192.168.204.31@tcp:44:dd.0 00000004:00080000:0.0:1782758070.365284:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000001:00080000:0.0:1782758070.365347:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967627 is committed 00000004:00080000:0.0:1782758070.365363:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00000100:00100000:0.0:1782758070.365981:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:48867:x1869355196723200:12345-192.168.204.31@tcp:44:dd.0 Request processed in 87999us (88385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758070.365998:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 848 00000100:00100000:3.0:1782758070.368368:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758070.368404:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782758070.381364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758070.383260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758070.385205:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211574912 00000100:00100000:3.0:1782758070.385222:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211574912 00000100:00100000:3.0:1782758070.385294:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723328 00000100:00100000:3.0:1782758070.385297:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723328 00000100:00100000:3.0:1782758070.385341:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1782758070.385352:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211574912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782758070.385389:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00010000:00010000:3.0:1782758070.385416:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.385438:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.385448:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782758070.385452:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758070.385456:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.385493:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.385507:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 5 pid: 6598 timeout: 2238 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758070.385521:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211575040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758070.385608:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758070.386060:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 465 00000100:00100000:0.0:1782758070.386074:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196723328:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:3.0:1782758070.389338:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211575040:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782758070.389372:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758070.395103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758070.398394:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723456 00000100:00100000:2.0:1782758070.398413:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723456 00010000:00010000:2.0:1782758070.398488:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 2238 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758070.398557:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 382 00000100:00080000:3.0:1782758070.398565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758070.398577:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196723456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758070.398598:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758070.399135:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 2238 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.399153:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 2238 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.399179:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ced6bb/0xdd99f5c4777da7dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a1a expref: 6 pid: 6598 timeout: 2238 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.399198:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758070.399202:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758070.399208:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.399217:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.405795:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758070.405928:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196723456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7352us (10826us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758070.405957:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 382 00010000:00010000:3.0:1782758070.413247:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.413270:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.413285:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.413293:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758070.413396:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758070.414150:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211574912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28796us (32790us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1782758070.414161:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000004:00080000:0.0:1782758070.418244:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170810e1880/2, rc 0, transno 4294967349 00000100:00100000:0.0:1782758070.418264:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211574912:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782758070.418283:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758070.418300:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.418315:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758070.418331:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.418345:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.418369:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.418377:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb79e372/0xdd99f5c4777da85b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758070.418405:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758070.418407:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758070.418409:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758070.529496:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:3.0:1782758070.529529:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000100:00100000:0.0:1782758070.529931:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196723328:12345-192.168.204.31@tcp:16:dd.0 Request processed in 143853us (146670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758070.529946:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 465 00000100:00100000:0.0:1782758070.540692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758070.540969:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723712 00000100:00100000:2.0:1782758070.540983:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723712 00000100:00100000:2.0:1782758070.541059:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:2.0:1782758070.541071:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:48867:x1869355196723712:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:2.0:1782758070.542405:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:48867:x1869355196723712:12345-192.168.204.31@tcp:35:dd.0 Request processed in 1327us (1718us total) trans 4294967628 rc 0/0 00000100:00100000:2.0:1782758070.542419:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 88 00010000:00010000:3.0:1782758070.829097:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758071.852133:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758072.238652:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211575168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758072.238788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758072.238933:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575168 00000100:00100000:0.0:1782758072.238945:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575168 00000100:00100000:0.0:1782758072.239030:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1782758072.239051:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211575168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758072.239131:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758072.239198:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211575168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758072.239207:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00080000:0.0:1782758072.239238:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758072.239297:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1782758072.239304:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170826a3b80, transno 4294967349 00000100:00100000:0.0:1782758072.239329:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211575168:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782758072.371503:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967628 is committed 00010000:00010000:2.0:1782758072.875998:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758073.432379:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000100:00100000:1.0:1782758073.533619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758073.533676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758073.533722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758073.533752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758073.533793:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724096 00000100:00100000:1.0:1782758073.533807:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724096 00000100:00100000:1.0:1782758073.534047:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724224 00000100:00100000:1.0:1782758073.534052:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724224 00000100:00100000:1.0:1782758073.534080:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1138 00000100:00100000:1.0:1782758073.534093:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196724096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758073.534195:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196724096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 104us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758073.534205:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1138 00000100:00100000:1.0:1782758073.534229:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1139 00000100:00100000:1.0:1782758073.534235:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196724224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758073.534438:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196724224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758073.534447:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1139 00000100:00100000:2.0:1782758073.537715:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723840 00000100:00100000:2.0:1782758073.537736:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723840 00000100:00100000:2.0:1782758073.537847:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1208 00000100:00100000:2.0:1782758073.537861:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196723840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758073.538065:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196723968 00000100:00100000:0.0:1782758073.538071:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196723968 00000100:00100000:0.0:1782758073.538147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1511 00000100:00100000:0.0:1782758073.538160:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196723968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758073.538204:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196723968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758073.538212:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1511 00000100:00080000:0.0:1782758073.538238:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758073.538243:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758073.538246:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758073.548315:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196723840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 10435us (14691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758073.548338:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1208 00010000:00010000:3.0:1782758073.903412:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758074.284123:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758074.284149:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211575424:0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.284149:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211575296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758074.284263:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211575808:0@lo:400:kworker.0 00000100:00100000:1.0:1782758074.285012:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211575552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758074.286864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758074.286924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758074.286981:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211575936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.286981:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211575680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.287022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758074.287045:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575424 00000100:00100000:2.0:1782758074.287063:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575680 00000100:00100000:2.0:1782758074.287069:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575680 00000100:00100000:2.0:1782758074.287473:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1782758074.287486:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211575680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.287560:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211575680:12345-0@lo:400:kworker.0 Request processed in 77us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758074.287568:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:2.0:1782758074.287594:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758074.287635:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211575680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758074.287804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758074.287864:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575296 00000100:00100000:0.0:1782758074.287869:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575296 00000100:00100000:0.0:1782758074.287902:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1782758074.287910:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211575296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758074.287956:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211575296:12345-0@lo:400:kworker.0 Request processed in 47us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758074.287962:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1782758074.288000:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211575296:0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.288624:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575808 00000100:00100000:2.0:1782758074.288630:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575808 00000100:00100000:2.0:1782758074.288687:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1782758074.288696:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211575808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.288743:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211575808:12345-0@lo:400:kworker.0 Request processed in 49us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758074.288749:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:0.0:1782758074.288863:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758074.288892:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211575808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758074.292388:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575424 00000100:00100000:3.0:1782758074.292522:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1782758074.292535:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211575424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758074.292572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758074.292983:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211575424:12345-0@lo:400:kworker.0 Request processed in 449us (6128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758074.293072:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211575424:0@lo:400:kworker.0 00000100:00100000:1.0:1782758074.294947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758074.295453:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575552 00000100:00100000:0.0:1782758074.296111:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575552 00000100:00080000:2.0:1782758074.296208:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758074.296297:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1782758074.296312:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211575552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758074.296431:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211575552:12345-0@lo:400:kworker.0 Request processed in 124us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758074.296440:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1782758074.299489:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1782758074.299571:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211575936 00000100:00100000:3.0:1782758074.299780:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211575936 00000100:00100000:3.0:1782758074.299882:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1782758074.299894:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211575936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758074.300034:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211575552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758074.300083:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211575936:12345-0@lo:400:kworker.0 Request processed in 190us (7508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758074.300092:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:3.0:1782758074.300129:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758074.302869:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:3.0:1782758074.302887:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170810e1880, transno 4294967349 00000100:00100000:3.0:1782758074.302919:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211575936:0@lo:400:kworker.0 00000004:00080000:2.0:1782758074.572156:0:83461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2142975330394ns, next at 2136519345140ns, rc = 0 00000004:00080000:2.0:1782758074.572268:0:83461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2142975444655ns, next at 2139080125416ns, rc = 0 00000004:00080000:0.0:1782758074.605522:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000004:00080000:0.0:1782758074.605544:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000100:00100000:2.0:1782758074.801910:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758074.801935:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211576064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758074.802020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758074.802095:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576064 00000100:00100000:2.0:1782758074.802104:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576064 00000100:00100000:2.0:1782758074.802153:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1782758074.802162:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211576064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758074.802204:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758074.802263:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211576064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758074.802271:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1782758074.802326:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211576064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758074.934052:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758075.949270:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758076.377288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.377330:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724352 00000100:00100000:3.0:1782758076.377342:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724352 00000100:00100000:3.0:1782758076.377419:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 849 00000100:00100000:3.0:1782758076.377430:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724352:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758076.377552:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724352:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.377561:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 849 00000100:00080000:3.0:1782758076.377582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758076.389518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758076.389603:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724480 00000100:00100000:2.0:1782758076.389616:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724480 00000100:00100000:2.0:1782758076.389694:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 466 00000100:00100000:2.0:1782758076.389707:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49060:x1869355196724480:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758076.390144:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49060:x1869355196724480:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 439us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758076.390153:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 466 00000100:00080000:3.0:1782758076.390339:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758076.393447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.393627:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724608 00000100:00100000:3.0:1782758076.393640:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724608 00000100:00100000:3.0:1782758076.393767:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 467 00000100:00100000:3.0:1782758076.393781:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49060:x1869355196724608:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758076.394215:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49060:x1869355196724608:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 426us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.394224:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 467 00000100:00080000:1.0:1782758076.396328:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758076.396688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758076.396762:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724736 00000100:00100000:2.0:1782758076.396774:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724736 00000100:00100000:2.0:1782758076.397019:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 850 00000100:00100000:2.0:1782758076.397032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724736:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758076.397591:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724736:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 559us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758076.397599:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 850 00000100:00100000:0.0:1782758076.401966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.402091:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724864 00000100:00100000:3.0:1782758076.402103:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724864 00000100:00100000:3.0:1782758076.402170:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 851 00000100:00100000:3.0:1782758076.402180:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724864:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758076.402303:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196724864:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.402312:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 851 00000100:00100000:0.0:1782758076.410874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.411282:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196724992 00000100:00100000:3.0:1782758076.411295:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196724992 00000100:00100000:3.0:1782758076.411364:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 468 00000100:00100000:3.0:1782758076.411376:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49060:x1869355196724992:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758076.412744:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49060:x1869355196724992:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 1360us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.412757:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 468 00000100:00100000:0.0:1782758076.421902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.422003:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725120 00000100:00100000:3.0:1782758076.422017:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725120 00000100:00100000:3.0:1782758076.422084:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 469 00000100:00100000:3.0:1782758076.422097:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49060:x1869355196725120:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758076.422530:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49060:x1869355196725120:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 435us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.422541:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 469 00000100:00100000:0.0:1782758076.430699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758076.430768:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725248 00000100:00100000:3.0:1782758076.430781:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725248 00000100:00100000:3.0:1782758076.430878:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 852 00000100:00100000:3.0:1782758076.430891:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196725248:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758076.431419:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49060:x1869355196725248:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 529us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758076.431429:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 852 00000100:00100000:0.0:1782758076.524421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758076.524483:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725504 00000100:00100000:0.0:1782758076.524497:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725504 00000100:00100000:0.0:1782758076.524579:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 853 00000100:00100000:0.0:1782758076.524592:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49064:x1869355196725504:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758076.524670:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758076.524714:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a2f expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524739:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:0.0:1782758076.524768:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758076.524797:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524816:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524851:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524871:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524884:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.524891:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.525328:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.525339:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.525346:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758076.527530:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:0.0:1782758076.527548:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2144930725145ns, next at 2145930721207ns, rc = 0 00010000:00010000:0.0:1782758076.527714:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527734:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527747:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527758:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527766:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527778:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527879:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758076.527912:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527920:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527928:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527934:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758076.527940:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527948:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527963:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782758076.527966:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758076.527972:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527978:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777da870 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.527998:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528004:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528011:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528016:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758076.528020:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528026:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528034:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782758076.528037:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758076.528041:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528047:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777da862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758076.528058:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000814f292e reply state 000000006bf11a95 transno 4294967629 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758076.528069:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758076.528192:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49064:x1869355196725504:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3598us (3780us total) trans 4294967629 rc 0/0 00000100:00100000:0.0:1782758076.528215:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 853 00010000:00010000:0.0:1782758076.528402:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758076.528410:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528417:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758076.528422:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528429:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528438:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782758076.528441:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758076.528444:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528450:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777da877 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.528467:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758076.528469:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758076.528471:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758076.532012:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532035:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532044:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532050:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758076.532056:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532065:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532089:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff91718bcfd300) 00010000:00010000:0.0:1782758076.532093:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758076.532098:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.532105:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777da869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758076.976421:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758077.356299:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211576192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758077.356452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758077.357252:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576192 00000100:00100000:3.0:1782758077.357263:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576192 00000100:00100000:3.0:1782758077.357441:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1782758077.357454:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211576192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758077.357562:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758077.357709:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211576192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 257us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758077.357718:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1782758077.357878:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211576192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758077.357960:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758077.996236:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758078.657193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758078.657247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758078.657268:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725632 00000100:00100000:2.0:1782758078.657281:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725632 00000100:00100000:0.0:1782758078.657281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758078.657308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758078.657348:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1210 00000100:00100000:2.0:1782758078.657360:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196725632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758078.657433:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725888 00000100:00100000:3.0:1782758078.657438:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725888 00000100:00100000:2.0:1782758078.657461:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196725632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758078.657492:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726016 00000100:00100000:3.0:1782758078.657496:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726016 00000100:00100000:3.0:1782758078.657523:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1142 00000100:00100000:3.0:1782758078.657530:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196725888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758078.657566:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196725888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758078.657573:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1142 00000100:00100000:3.0:1782758078.657590:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1143 00000100:00100000:3.0:1782758078.657596:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196726016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758078.657619:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196726016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758078.657625:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1143 00000100:00080000:3.0:1782758078.657644:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758078.657648:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758078.662980:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196725760 00000100:00100000:3.0:1782758078.663001:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196725760 00000100:00100000:3.0:1782758078.663120:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00100000:3.0:1782758078.663134:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196725760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758078.663266:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196725760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 134us (5982us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758078.663275:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00080000:3.0:1782758078.663308:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758078.671276:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1210 00010000:00010000:3.0:1782758079.020170:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758079.404307:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211576320:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.404350:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211576448:0@lo:400:kworker.0 00000100:00100000:3.0:1782758079.405063:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211576704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.411637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758079.411754:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211576832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.411839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758079.411891:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576320 00000100:00100000:2.0:1782758079.411901:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576320 00000100:00100000:2.0:1782758079.411959:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1782758079.411969:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211576320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.412034:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211576320:12345-0@lo:400:kworker.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758079.412043:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1782758079.412108:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211576320:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.413437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758079.413494:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211576960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.414842:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576832 00000100:00100000:2.0:1782758079.414855:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576832 00000100:00100000:1.0:1782758079.415564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758079.415623:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758079.415640:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211576576:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.415857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758079.415907:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576448 00000100:00100000:1.0:1782758079.415914:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576448 00000100:00100000:1.0:1782758079.415956:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576576 00000100:00100000:1.0:1782758079.415959:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576576 00000100:00100000:1.0:1782758079.415991:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782758079.416002:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211576448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.416014:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1782758079.416025:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211576576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.416088:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211576576:12345-0@lo:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758079.416090:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211576448:12345-0@lo:400:kworker.0 Request processed in 89us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758079.416100:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:1.0:1782758079.416317:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782758079.416333:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1782758079.416342:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211576832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.416388:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211576832:12345-0@lo:400:kworker.0 Request processed in 49us (4565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758079.416410:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:3.0:1782758079.416697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782758079.416804:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758079.417046:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576960 00000100:00100000:2.0:1782758079.417056:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576960 00000100:00100000:3.0:1782758079.417072:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211576704 00000100:00100000:1.0:1782758079.417080:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211576832:0@lo:400:kworker.0 00000100:00100000:3.0:1782758079.417090:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211576704 00000100:00100000:2.0:1782758079.417129:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1782758079.417140:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211576576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.417154:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211576960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758079.418019:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211576960:12345-0@lo:400:kworker.0 Request processed in 880us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758079.418028:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00080000:2.0:1782758079.418563:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758079.418569:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758079.419333:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1782758079.419358:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211576704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758079.419478:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211576704:12345-0@lo:400:kworker.0 Request processed in 132us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758079.419485:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1782758079.419553:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211576704:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.419788:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211576448:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.419837:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211576960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758079.921257:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211577088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758079.921358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758079.921596:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577088 00000100:00100000:1.0:1782758079.921606:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577088 00000100:00100000:1.0:1782758079.921659:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1782758079.921669:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211577088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758079.921714:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758079.921766:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211577088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758079.921773:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1782758079.921838:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211577088:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1782758079.935779:0:83606:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2148338953840ns, next at 2145930721207ns, rc = 0 00000001:00080000:1.0:1782758079.966412:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967629 is committed 00000004:00080000:1.0:1782758079.966426:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000100:00100000:1.0:1782758079.969170:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211577216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782758079.969251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758079.969382:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577216 00000100:00100000:3.0:1782758079.969391:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577216 00000100:00100000:3.0:1782758079.969460:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1782758079.969471:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211577216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782758079.969506:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:3.0:1782758079.969533:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.969556:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.969565:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1782758079.969569:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758079.969573:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.969611:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.969626:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 5 pid: 6597 timeout: 2248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758079.969640:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211577344:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758079.969726:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1e40 going to sleep for 11 seconds 00000004:00080000:1.0:1782758079.971851:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00000100:00100000:3.0:1782758079.975623:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211577344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782758079.975668:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758079.977970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758079.978347:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726144 00000100:00100000:2.0:1782758079.978362:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726144 00010000:00010000:2.0:1782758079.978408:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 2248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758079.978606:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 383 00000100:00100000:2.0:1782758079.978630:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196726144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758079.978647:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758079.978653:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 2248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758079.978668:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 2248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758079.978693:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da854 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a36 expref: 6 pid: 6597 timeout: 2248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758079.978709:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758079.978713:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758079.978718:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758079.978727:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758079.978763:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758079.978819:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196726144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 203us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758079.978867:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 383 00010000:00010000:3.0:1782758079.979281:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.979292:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.979302:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.979311:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758079.979340:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758079.980013:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211577216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10541us (10759us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1782758079.980023:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00010000:1.0:1782758079.980175:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758079.980185:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758079.980194:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758079.980199:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758079.980208:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758079.980223:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758079.980231:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777da87e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758079.980252:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758079.980254:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758079.980256:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758079.980298:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2323800/2, rc 0, transno 4294967351 00000100:00100000:1.0:1782758079.980321:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211577216:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1782758079.980657:0:83606:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2148383832887ns, next at 2139080125416ns, rc = 0 00000004:00080000:1.0:1782758079.984341:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00010000:00010000:0.0:1782758080.046560:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758081.069503:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758081.504724:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00010000:00010000:1.0:1782758082.092108:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758082.476314:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758082.476568:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211577472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758082.476641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758082.477007:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577472 00000100:00100000:3.0:1782758082.477017:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577472 00000100:00100000:3.0:1782758082.477108:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1782758082.477119:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211577472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758082.477158:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758082.477233:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211577472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758082.477244:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1782758082.477618:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:0.0:1782758082.477626:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2323800, transno 4294967351 00000100:00100000:0.0:1782758082.477654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211577472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758082.483001:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758083.124892:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758083.767244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758083.767282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758083.767311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758083.767350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758083.767388:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726400 00000100:00100000:3.0:1782758083.767398:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726400 00000100:00100000:3.0:1782758083.767462:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000100:00100000:3.0:1782758083.767473:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196726400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758083.767548:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196726400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758083.767556:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000100:00100000:3.0:1782758083.767580:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726656 00000100:00100000:3.0:1782758083.767584:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726656 00000100:00100000:3.0:1782758083.767608:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726528 00000100:00100000:3.0:1782758083.767610:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726528 00000100:00100000:3.0:1782758083.767630:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1146 00000100:00100000:3.0:1782758083.767636:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196726656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758083.767662:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196726656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758083.767668:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1146 00000100:00100000:3.0:1782758083.767679:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00100000:3.0:1782758083.767685:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196726528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758083.767711:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196726528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758083.767720:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00080000:3.0:1782758083.771777:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758083.771786:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758083.771790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758083.772134:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726272 00000100:00100000:2.0:1782758083.772145:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726272 00000100:00100000:2.0:1782758083.772206:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1212 00000100:00100000:2.0:1782758083.772216:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196726272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758083.789216:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196726272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 16985us (21888us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758083.789233:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1212 00010000:00010000:3.0:1782758084.151947:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758084.524206:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211577984:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211577600:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758084.524313:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211577728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524341:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211578112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758084.524346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758084.524365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758084.524380:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211578240:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524403:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577600 00000100:00100000:1.0:1782758084.524404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758084.524409:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577600 00000100:00100000:1.0:1782758084.524433:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577728 00000100:00100000:1.0:1782758084.524436:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577728 00000100:00100000:3.0:1782758084.524452:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1782758084.524460:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211577600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758084.524476:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578112 00000100:00100000:1.0:1782758084.524478:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578112 00000100:00100000:1.0:1782758084.524504:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1782758084.524507:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211577600:12345-0@lo:400:kworker.0 Request processed in 48us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758084.524510:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211577728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524514:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1782758084.524543:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211577728:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758084.524550:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1782758084.524560:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1782758084.524567:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211578112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758084.524600:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211577728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524605:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211578112:12345-0@lo:400:kworker.0 Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758084.524610:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1782758084.524627:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578240 00000100:00100000:3.0:1782758084.524630:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578240 00000100:00100000:3.0:1782758084.524664:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1782758084.524670:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758084.524692:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211577856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524716:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211578240:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758084.524718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758084.524723:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00080000:3.0:1782758084.524742:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758084.524746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758084.524747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577856 00000100:00100000:0.0:1782758084.524750:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577856 00000100:00100000:3.0:1782758084.524765:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211578240:0@lo:400:kworker.0 00000100:00100000:0.0:1782758084.524779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1782758084.524784:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211577600:0@lo:400:kworker.0 00000100:00100000:0.0:1782758084.524784:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211577856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.524793:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211578112:0@lo:400:kworker.0 00000100:00080000:3.0:1782758084.524856:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758084.524856:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211577856:12345-0@lo:400:kworker.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758084.524862:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1782758084.524887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211577856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758084.525541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758084.528904:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211577984 00000100:00100000:1.0:1782758084.528919:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211577984 00000100:00100000:1.0:1782758084.529003:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1782758084.529015:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211577984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758084.529141:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211577984:12345-0@lo:400:kworker.0 Request processed in 127us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758084.529149:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:3.0:1782758084.529466:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758084.529978:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211577984:0@lo:400:kworker.0 00000100:00100000:0.0:1782758085.038961:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758085.039053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758085.039216:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578368 00000100:00100000:2.0:1782758085.039226:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578368 00000100:00100000:2.0:1782758085.039413:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1782758085.039427:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211578368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758085.039469:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758085.039540:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211578368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758085.040140:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758085.041190:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00010000:00010000:0.0:1782758085.164346:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758086.190570:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758087.239931:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758087.596241:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211578496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758087.596324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758087.597327:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578496 00000100:00100000:3.0:1782758087.597351:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578496 00000100:00100000:3.0:1782758087.597440:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1782758087.597452:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211578496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758087.597506:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758087.597595:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211578496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758087.597603:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1782758087.597721:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211578496:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758087.598812:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758088.238075:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758088.884888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758088.884953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758088.885012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758088.885044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758088.885089:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726784 00000100:00100000:3.0:1782758088.885101:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727168 00000100:00100000:2.0:1782758088.885110:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726784 00000100:00100000:3.0:1782758088.885111:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727168 00000100:00100000:3.0:1782758088.885212:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727040 00000100:00100000:3.0:1782758088.885218:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727040 00000100:00100000:2.0:1782758088.885219:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00100000:2.0:1782758088.885236:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196726784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758088.885255:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1150 00000100:00100000:3.0:1782758088.885266:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196727168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758088.885330:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196726784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758088.885335:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196727168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758088.885352:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00100000:3.0:1782758088.885364:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1150 00000100:00100000:3.0:1782758088.885383:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00100000:3.0:1782758088.885391:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196727040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758088.885424:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196727040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758088.885431:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00100000:1.0:1782758088.885572:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196726912 00000100:00100000:1.0:1782758088.885577:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196726912 00000100:00100000:1.0:1782758088.885622:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1523 00000100:00100000:1.0:1782758088.885628:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196726912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758088.885672:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196726912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758088.885681:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1523 00000100:00080000:0.0:1782758088.885862:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758088.885868:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758088.885870:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758089.260619:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758089.644211:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.644321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758089.644407:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758089.644413:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211578880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.644443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758089.644493:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579008 00000100:00100000:2.0:1782758089.644503:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579008 00000100:00100000:2.0:1782758089.644574:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1782758089.644587:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.644654:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579008:12345-0@lo:400:kworker.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758089.644663:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1782758089.644727:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579008:0@lo:400:kworker.0 00000100:00100000:1.0:1782758089.644890:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211578752:0@lo:400:kworker.0 00000100:00100000:1.0:1782758089.645002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782758089.645025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758089.645316:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211579264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758089.645351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758089.645388:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758089.645395:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211578624:0@lo:400:kworker.0 00000100:00100000:0.0:1782758089.645444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758089.645449:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578880 00000100:00100000:2.0:1782758089.645456:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578880 00000100:00100000:0.0:1782758089.645475:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211579136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.645510:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578752 00000100:00100000:0.0:1782758089.645511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758089.645517:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578752 00000100:00100000:2.0:1782758089.645546:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:2.0:1782758089.645557:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211578880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758089.645564:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579136 00000100:00100000:0.0:1782758089.645574:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579136 00000100:00100000:2.0:1782758089.645617:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211578880:12345-0@lo:400:kworker.0 Request processed in 60us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758089.645627:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1782758089.645651:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1782758089.645663:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211578752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758089.645725:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211578752:12345-0@lo:400:kworker.0 Request processed in 64us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758089.646013:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1782758089.646025:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211579136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.646068:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211579136:12345-0@lo:400:kworker.0 Request processed in 47us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758089.646074:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1782758089.646110:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211578880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.646164:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211578624 00000100:00100000:2.0:1782758089.646169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211578624 00000100:00100000:2.0:1782758089.646210:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1782758089.646217:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211578624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.646249:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211578624:12345-0@lo:400:kworker.0 Request processed in 33us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758089.646255:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1782758089.646464:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579264 00000100:00100000:2.0:1782758089.646469:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579264 00000100:00100000:2.0:1782758089.646510:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00080000:1.0:1782758089.646511:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758089.646522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758089.646528:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211579264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.646576:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211579264:12345-0@lo:400:kworker.0 Request processed in 54us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758089.646578:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211578624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758089.646593:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1782758089.646631:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211579136:0@lo:400:kworker.0 00000100:00100000:1.0:1782758089.646653:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211578752:0@lo:400:kworker.0 00000100:00100000:1.0:1782758089.646673:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211579264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758089.658311:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1782758090.156353:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758090.156378:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758090.156470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758090.156684:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579392 00000100:00100000:2.0:1782758090.156692:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579392 00000100:00100000:2.0:1782758090.156755:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1782758090.156765:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758090.156799:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758090.156874:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758090.156883:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1782758090.157130:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758090.284123:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758091.308364:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758092.332434:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758092.716629:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758092.716730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758092.718206:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579520 00000100:00100000:1.0:1782758092.718221:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579520 00000100:00100000:1.0:1782758092.718384:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1782758092.718399:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758092.718460:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758092.718702:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211579520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758092.718710:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1782758092.720308:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211579520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758092.724227:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758093.357310:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758094.008818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.008919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.008951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.008980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.009015:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727424 00000100:00100000:3.0:1782758094.009028:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727424 00000100:00100000:3.0:1782758094.009104:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1527 00000100:00100000:3.0:1782758094.009115:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196727424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758094.009224:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196727424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758094.009232:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1527 00000100:00100000:1.0:1782758094.010038:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727296 00000100:00100000:1.0:1782758094.010047:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727296 00000100:00100000:1.0:1782758094.010093:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1216 00000100:00100000:1.0:1782758094.010102:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196727296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758094.010173:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196727296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.010180:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1216 00000100:00100000:1.0:1782758094.010225:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727552 00000100:00100000:1.0:1782758094.010229:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727552 00000100:00100000:1.0:1782758094.010273:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727680 00000100:00100000:1.0:1782758094.010277:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727680 00000100:00100000:1.0:1782758094.010302:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1154 00000100:00100000:1.0:1782758094.010308:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196727552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758094.010339:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196727552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.010346:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1154 00000100:00100000:1.0:1782758094.010358:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1155 00000100:00100000:1.0:1782758094.010364:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196727680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758094.010388:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196727680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.010395:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1155 00000100:00080000:0.0:1782758094.010704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758094.010709:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758094.010712:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758094.381578:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758094.577991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758094.582543:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727808 00000100:00100000:2.0:1782758094.582567:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727808 00000100:00100000:2.0:1782758094.582664:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 854 00000100:00100000:2.0:1782758094.582677:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196727808:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758094.582818:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196727808:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 144us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758094.582874:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 854 00000100:00100000:1.0:1782758094.590784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758094.593907:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196727936 00000100:00100000:2.0:1782758094.593929:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196727936 00000100:00100000:2.0:1782758094.594039:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 471 00000100:00100000:2.0:1782758094.594053:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196727936:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758094.594609:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196727936:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 557us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758094.594619:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 471 00000100:00100000:0.0:1782758094.599525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758094.599645:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728064 00000100:00100000:1.0:1782758094.599655:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728064 00000100:00100000:1.0:1782758094.599712:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 472 00000100:00100000:1.0:1782758094.599723:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728064:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758094.600212:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728064:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 490us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.600221:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 472 00000100:00100000:3.0:1782758094.602471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758094.602553:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728192 00000100:00100000:0.0:1782758094.602562:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728192 00000100:00100000:0.0:1782758094.602620:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 855 00000100:00100000:0.0:1782758094.602631:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728192:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758094.603135:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728192:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 504us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758094.603144:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 855 00000100:00100000:2.0:1782758094.606673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.606787:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728320 00000100:00100000:3.0:1782758094.606801:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728320 00000100:00100000:3.0:1782758094.606926:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 856 00000100:00100000:3.0:1782758094.606939:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728320:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758094.607082:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728320:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 146us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758094.607092:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 856 00000100:00100000:2.0:1782758094.609762:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.610550:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728448 00000100:00100000:3.0:1782758094.610564:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728448 00000100:00100000:3.0:1782758094.610647:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 473 00000100:00100000:3.0:1782758094.610660:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728448:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758094.611594:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728448:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 931us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758094.611605:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 473 00000100:00100000:3.0:1782758094.638263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758094.638331:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728576 00000100:00100000:0.0:1782758094.638347:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728576 00000100:00100000:0.0:1782758094.638425:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 474 00000100:00100000:0.0:1782758094.638438:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728576:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758094.639059:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49242:x1869355196728576:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 622us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758094.639068:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 474 00000100:00100000:3.0:1782758094.648068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758094.648130:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728704 00000100:00100000:3.0:1782758094.648144:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728704 00000100:00100000:3.0:1782758094.648214:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 857 00000100:00100000:3.0:1782758094.648227:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728704:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758094.648810:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49242:x1869355196728704:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 583us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758094.648820:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 857 00000100:00100000:0.0:1782758094.765045:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211579776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.765081:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211579648:0@lo:400:kworker.0 00000100:00100000:3.0:1782758094.771266:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211579904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.774805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758094.774805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758094.776046:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579776 00000100:00100000:1.0:1782758094.776061:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579776 00000100:00100000:1.0:1782758094.776125:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1782758094.776138:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211579776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758094.776249:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211579776:12345-0@lo:400:kworker.0 Request processed in 113us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.776257:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1782758094.776290:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579648 00000100:00100000:1.0:1782758094.776294:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579648 00000100:00100000:1.0:1782758094.776332:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1782758094.776340:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758094.776379:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211579648:12345-0@lo:400:kworker.0 Request processed in 40us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.776385:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1782758094.776551:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211580288:0@lo:400:kworker.0 00000100:00100000:0.0:1782758094.776598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758094.776665:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211579776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758094.776913:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580288 00000100:00100000:0.0:1782758094.776919:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580288 00000100:00100000:0.0:1782758094.776968:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1782758094.776974:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211580288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758094.777015:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211580288:12345-0@lo:400:kworker.0 Request processed in 42us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758094.777022:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00080000:0.0:1782758094.777037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758094.777058:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211580288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.778305:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580032:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.778433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758094.778517:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211579648:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.778526:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211580160:0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.778624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758094.778651:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580160 00000100:00100000:2.0:1782758094.778657:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580160 00000100:00100000:2.0:1782758094.778712:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1782758094.778720:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211580160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758094.778766:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211580160:12345-0@lo:400:kworker.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758094.778774:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1782758094.778803:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211580160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758094.784837:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580032 00000100:00100000:0.0:1782758094.784862:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580032 00000100:00100000:0.0:1782758094.784926:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1782758094.784950:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758094.785070:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580032:12345-0@lo:400:kworker.0 Request processed in 135us (6637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758094.785080:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:0.0:1782758094.785111:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758094.785118:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758094.785521:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758094.787873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758094.788447:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211579904 00000100:00100000:1.0:1782758094.788456:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211579904 00000100:00100000:1.0:1782758094.788533:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1782758094.788544:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211579904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758094.788620:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211579904:12345-0@lo:400:kworker.0 Request processed in 77us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758094.788628:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00080000:1.0:1782758094.788656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758094.788689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211579904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758095.278797:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758095.278854:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758095.278932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758095.278968:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580416 00000100:00100000:3.0:1782758095.278978:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580416 00000100:00100000:2.0:1782758095.279086:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1782758095.279098:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758095.279141:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758095.279197:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758095.279204:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1782758095.279252:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758095.406952:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758096.432923:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758096.930215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758096.932964:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196728832 00000100:00100000:1.0:1782758096.932981:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196728832 00000100:00100000:1.0:1782758096.933076:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 858 00000100:00100000:1.0:1782758096.933087:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49257:x1869355196728832:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758096.933110:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758096.933135:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a3d expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933208:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933222:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933236:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758096.933478:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1782758096.933483:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758096.933570:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933598:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a3d expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933617:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a3d expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758096.933625:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:1.0:1782758096.933628:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758096.933631:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758096.933704:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49257:x1869355196728832:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 620us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758096.933711:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 858 00000100:00080000:0.0:1782758096.933862:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758096.950059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758096.950244:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729088 00000100:00100000:0.0:1782758096.950254:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729088 00000100:00100000:0.0:1782758096.950320:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 859 00000100:00100000:0.0:1782758096.950332:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49257:x1869355196729088:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758096.950388:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758096.950418:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da88c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a3d expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758096.950439:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777da82a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a28 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758096.950450:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782758096.950463:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758096.950494:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758096.950508:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758096.950517:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758097.019656:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d199ff04 reply state 00000000311df362 transno 4294967630 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758097.019678:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758097.019876:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:0.0:1782758097.019986:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49257:x1869355196729088:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 69652us (69931us total) trans 4294967630 rc 0/0 00000100:00100000:0.0:1782758097.019996:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 859 00000001:00080000:0.0:1782758097.020056:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967630 is committed 00010000:00010000:0.0:1782758097.021820:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021851:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021865:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021871:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758097.021876:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021885:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021904:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758097.021907:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758097.021912:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.021918:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777da893 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758097.120035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758097.120255:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729216 00000100:00100000:1.0:1782758097.120268:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729216 00000100:00100000:1.0:1782758097.120344:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 860 00000100:00100000:1.0:1782758097.120355:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49261:x1869355196729216:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782758097.120380:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758097.120403:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da89a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a44 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120493:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120507:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120518:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120531:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120538:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.120545:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.122266:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.122294:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.122308:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758097.122785:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1782758097.122791:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758097.123271:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123290:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123297:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123305:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123311:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758097.123316:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123324:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123345:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758097.123349:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758097.123353:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123359:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123375:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123382:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123388:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123393:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758097.123395:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123401:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123409:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3af00) 00010000:00010000:3.0:1782758097.123412:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758097.123415:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123420:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123645:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da89a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a44 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123661:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a44 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.123669:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:3.0:1782758097.123671:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758097.123674:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:3.0:1782758097.123760:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49261:x1869355196729216:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 3406us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758097.123769:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 860 00000100:00100000:0.0:1782758097.134647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758097.134770:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729472 00000100:00100000:1.0:1782758097.134783:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729472 00000100:00100000:1.0:1782758097.134880:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 861 00000100:00100000:1.0:1782758097.134890:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49261:x1869355196729472:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782758097.134913:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758097.134935:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da8b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a4b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135427:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135445:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135458:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135475:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135482:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.135489:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758097.137371:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:1.0:1782758097.138858:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da8cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138879:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da8cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138892:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da8cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138935:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138942:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138948:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138954:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758097.138958:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138966:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138978:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:1.0:1782758097.138981:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758097.138986:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.138997:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758097.139010:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4c5279c reply state 0000000088887388 transno 4294967631 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758097.139020:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758097.139060:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da8b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a4b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.139075:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da8cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a4b expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.139081:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782758097.139083:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758097.139085:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758097.139443:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49261:x1869355196729472:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 4552us (4809us total) trans 4294967631 rc 0/0 00000100:00100000:1.0:1782758097.139452:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 861 00010000:00010000:2.0:1782758097.145603:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145697:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145706:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145713:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758097.145719:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145728:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145745:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3a200) 00010000:00010000:2.0:1782758097.145749:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758097.145754:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.145761:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777da8c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758097.149655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758097.152353:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729728 00000100:00100000:2.0:1782758097.152369:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729728 00000100:00100000:2.0:1782758097.152437:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 862 00000100:00100000:2.0:1782758097.152566:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49261:x1869355196729728:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:2.0:1782758097.152702:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758097.152731:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da8cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a4b expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.152750:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:2.0:1782758097.152762:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758097.152878:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.152891:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.152901:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758097.153028:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1d2a71b reply state 000000002a1d6476 transno 4294967632 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758097.153036:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758097.153130:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49261:x1869355196729728:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 684us (3484us total) trans 4294967632 rc 0/0 00000100:00100000:2.0:1782758097.153138:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 862 00010000:00010000:0.0:1782758097.155178:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155195:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155202:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155207:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758097.155211:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155219:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155234:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:0.0:1782758097.155237:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758097.155241:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.155246:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da8d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758097.162582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758097.162655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729856 00000100:00100000:3.0:1782758097.162666:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729856 00000100:00100000:3.0:1782758097.162732:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 863 00000100:00100000:3.0:1782758097.162743:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49261:x1869355196729856:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758097.162770:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758097.162807:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da8e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a52 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.162905:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da8e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a52 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.162922:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da8e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a52 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758097.162946:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782758097.162949:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782758097.162953:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758097.163014:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49261:x1869355196729856:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 272us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758097.163022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 863 00000100:00100000:1.0:1782758097.172927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758097.173036:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196729984 00000100:00100000:0.0:1782758097.173046:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196729984 00000100:00100000:0.0:1782758097.173116:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 475 00000100:00100000:0.0:1782758097.173129:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196729984:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:0.0:1782758097.173622:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196729984:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 495us (702us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782758097.173631:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 475 00000100:00080000:1.0:1782758097.173942:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758097.176974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758097.177066:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196730240 00000100:00100000:2.0:1782758097.177076:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196730240 00000100:00100000:2.0:1782758097.177173:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:2.0:1782758097.177183:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49261:x1869355196730240:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:2.0:1782758097.177508:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49261:x1869355196730240:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 326us (542us total) trans 4294967633 rc 0/0 00000100:00100000:2.0:1782758097.177516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:2.0:1782758097.273886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758097.276000:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196730368 00000100:00100000:1.0:1782758097.276019:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196730368 00000100:00100000:1.0:1782758097.276109:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 864 00000100:00100000:1.0:1782758097.276121:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49265:x1869355196730368:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782758097.276153:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758097.276174:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a59 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276240:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276255:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276267:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276282:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276289:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276296:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276399:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276408:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276414:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758097.276460:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 0 00000004:00200000:1.0:1782758097.276465:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758097.276486:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276501:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276509:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276516:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276523:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276529:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758097.276533:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276541:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276553:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:1.0:1782758097.276556:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758097.276561:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276567:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777da8ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276580:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276586:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276593:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276598:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758097.276602:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276608:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276615:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758097.276618:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758097.276621:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276627:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777da8f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276656:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da8e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a59 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276670:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a59 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758097.276677:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917191f75d00) 00010000:00010000:1.0:1782758097.276680:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758097.276683:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758097.276753:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49265:x1869355196730368:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 633us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758097.276764:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 864 00000100:00100000:1.0:1782758097.281957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758097.282165:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196730496 00000100:00100000:0.0:1782758097.282176:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196730496 00000100:00100000:0.0:1782758097.282247:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 476 00000100:00100000:0.0:1782758097.282259:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196730496:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:0.0:1782758097.282279:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758097.282302:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a60 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758097.282334:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x6a42bad0, atime: 0x6a42bad0, ctime: 0x6a42bad0, blocks: 0x1 00010000:00010000:0.0:1782758097.282354:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=2165s v=(0 0) 00010000:00010000:0.0:1782758097.282358:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758097.282368:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.282386:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.282400:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758097.282466:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196730496:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 210us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758097.282474:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 476 00000100:00100000:0.0:1782758097.303433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758097.303549:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196730752 00000100:00100000:2.0:1782758097.303559:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196730752 00000100:00100000:2.0:1782758097.303618:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 865 00000100:00100000:2.0:1782758097.303627:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49265:x1869355196730752:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782758097.303690:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758097.303730:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777da8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a59 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303753:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da8e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a52 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303765:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917191f75d00) 00010000:00010000:2.0:1782758097.303775:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758097.303808:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303880:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303890:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303911:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303919:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.303927:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.304052:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.304061:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.304068:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758097.305423:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:2.0:1782758097.305436:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2165708612677ns, next at 2166708610353ns, rc = 0 00010000:00010000:2.0:1782758097.305547:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305560:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305570:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305579:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305591:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305597:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305678:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758097.305703:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305710:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305780:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305788:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758097.305802:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305811:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305839:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917182dd1100) 00010000:00010000:2.0:1782758097.305844:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758097.305848:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305855:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da918 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305872:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305879:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305885:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305890:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758097.305893:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305899:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305907:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782758097.305909:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758097.305913:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.305918:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da90a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758097.305927:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7d891e8 reply state 00000000c3f03b03 transno 4294967634 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758097.305935:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758097.306029:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49265:x1869355196730752:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 2400us (2603us total) trans 4294967634 rc 0/0 00000100:00100000:2.0:1782758097.306038:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 865 00010000:00010000:2.0:1782758097.311724:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311749:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311757:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311763:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758097.311768:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311776:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311805:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff917182dd1300) 00010000:00010000:2.0:1782758097.311809:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758097.311814:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758097.311820:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da911 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315508:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758097.315521:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315532:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758097.315536:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315545:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315563:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff917182dd1100) 00010000:00010000:0.0:1782758097.315568:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758097.315573:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315579:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da91f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758097.315609:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758097.315612:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758097.315614:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758097.452565:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758097.836062:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758097.836270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758097.836386:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580544 00000100:00100000:0.0:1782758097.836394:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580544 00000100:00100000:0.0:1782758097.836453:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1782758097.836465:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758097.836501:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758097.836551:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211580544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758097.836559:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00080000:3.0:1782758097.836759:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758097.836803:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211580544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758098.401076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758098.401808:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196730880 00000100:00100000:3.0:1782758098.401850:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196730880 00000100:00100000:3.0:1782758098.401931:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 866 00000100:00100000:3.0:1782758098.401943:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49284:x1869355196730880:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758098.401970:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758098.401995:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a67 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.402069:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.402086:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782758098.402285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758098.402325:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758098.402388:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:3.0:1782758098.402392:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758098.402429:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.402568:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a67 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.402591:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a67 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.402600:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:3.0:1782758098.402603:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758098.402607:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758098.402676:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49284:x1869355196730880:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 736us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758098.402685:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 866 00000100:00100000:1.0:1782758098.409738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758098.409818:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731136 00000100:00100000:3.0:1782758098.409861:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731136 00000100:00100000:3.0:1782758098.409926:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 867 00000100:00100000:3.0:1782758098.409937:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49284:x1869355196731136:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758098.409990:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758098.410017:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da92d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a67 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.410035:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da8af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a44 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.410051:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1500) 00010000:00010000:3.0:1782758098.410060:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758098.410083:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.410359:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.410369:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.481312:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1782758098.505488:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cf09610 reply state 0000000043026e90 transno 4294967635 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758098.505507:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782758098.505791:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967631 is committed 00000001:00080000:0.0:1782758098.505806:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967634 is committed 00000004:00080000:0.0:1782758098.505811:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000001:00080000:0.0:1782758098.505904:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967635 is committed 00000004:00200000:3.0:1782758098.506224:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00080000:3.0:1782758098.506338:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782758098.506362:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49284:x1869355196731136:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 96421us (96643us total) trans 4294967635 rc 0/0 00000100:00100000:3.0:1782758098.506371:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 867 00010000:00010000:0.0:1782758098.506606:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.506617:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.506625:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758098.506731:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211580672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782758098.508186:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758098.508193:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.508204:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.508222:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917191f75a00) 00010000:00010000:0.0:1782758098.508225:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758098.508230:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.508236:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777da934 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758098.508371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758098.510918:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580672 00000100:00100000:0.0:1782758098.510931:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580672 00000100:00100000:0.0:1782758098.511038:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1782758098.511052:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211580672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782758098.512256:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:0.0:1782758098.512288:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.512312:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.512321:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782758098.512325:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758098.512330:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.512365:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758098.512379:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 6 pid: 9120 timeout: 2266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758098.512394:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211580800:192.168.204.31@tcp:104: 00000100:00080000:2.0:1782758098.512526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758098.530412:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c45480 going to sleep for 11 seconds 00000100:00100000:1.0:1782758098.549892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758098.549923:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731264 00000100:00100000:1.0:1782758098.549932:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731264 00010000:00010000:1.0:1782758098.549971:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 7 pid: 9120 timeout: 2266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758098.550006:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 384 00000100:00100000:1.0:1782758098.550015:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196731264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758098.550030:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758098.550035:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 7 pid: 9120 timeout: 2266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.550046:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 7 pid: 9120 timeout: 2266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.550069:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758098.550073:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758098.550078:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.550087:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.550113:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758098.550159:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196731264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 144us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758098.550167:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 384 00010000:00010000:3.0:1782758098.550493:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b42cfb6/0xdd99f5c4777da903 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a60 expref: 6 pid: 9120 timeout: 2266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758098.550508:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211580800:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782758098.550532:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.550545:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.550551:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.550560:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.550567:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758098.550592:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758098.551053:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758098.551060:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.551069:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758098.551074:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.551082:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.551096:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.551103:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab478b4/0xdd99f5c4777da93b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758098.551120:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758098.551122:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758098.551124:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758098.552988:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211580672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40378us (43056us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1782758098.553002:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000004:00080000:3.0:1782758098.553064:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7dd4000/2, rc 0, transno 4294967351 00000100:00100000:3.0:1782758098.553071:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211580672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782758098.619979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758098.620101:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731392 00000100:00100000:2.0:1782758098.620113:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731392 00000100:00100000:2.0:1782758098.620184:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 868 00000100:00100000:2.0:1782758098.620196:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49288:x1869355196731392:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782758098.620224:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758098.620248:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a6e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620319:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620335:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620348:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620365:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620372:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620380:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620875:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620885:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.620893:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758098.621708:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1782758098.621729:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758098.621861:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621883:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621891:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621898:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621903:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758098.621908:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621916:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621930:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758098.621933:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758098.621938:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621945:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777da949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621955:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621961:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621967:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621973:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758098.621976:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621981:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621989:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917182dd1300) 00010000:00010000:2.0:1782758098.621991:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758098.621994:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.621999:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777da950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.622040:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777da942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a6e expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.622054:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a6e expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758098.622061:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758098.622064:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758098.622066:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758098.622156:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49288:x1869355196731392:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1962us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758098.622165:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 868 00000100:00100000:1.0:1782758099.135024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758099.135061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758099.135223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758099.135250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758099.135281:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731520 00000100:00100000:1.0:1782758099.135290:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731520 00000100:00100000:1.0:1782758099.135341:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:1.0:1782758099.135352:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196731520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758099.135428:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196731520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.135435:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:1.0:1782758099.135472:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731776 00000100:00100000:1.0:1782758099.135476:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731776 00000100:00100000:1.0:1782758099.135511:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731904 00000100:00100000:1.0:1782758099.135514:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731904 00000100:00100000:1.0:1782758099.135536:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1158 00000100:00100000:1.0:1782758099.135542:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196731776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758099.135569:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196731776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.135575:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1158 00000100:00100000:1.0:1782758099.135586:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1159 00000100:00100000:1.0:1782758099.135591:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196731904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758099.135616:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196731904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.135622:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1159 00000100:00080000:1.0:1782758099.135640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758099.135643:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758099.137344:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196731648 00000100:00100000:1.0:1782758099.137357:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196731648 00000100:00100000:1.0:1782758099.137422:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1531 00000100:00100000:1.0:1782758099.137432:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196731648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758099.137498:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196731648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.137511:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1531 00010000:00010000:2.0:1782758099.501463:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758099.688787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758099.688924:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732032 00000100:00100000:2.0:1782758099.688934:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732032 00000100:00100000:2.0:1782758099.688990:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 869 00000100:00100000:2.0:1782758099.689000:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49306:x1869355196732032:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758099.689020:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758099.689039:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da95e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a75 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689099:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689113:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689125:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758099.689333:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1782758099.689338:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758099.689419:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689448:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da95e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a75 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689464:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a75 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.689473:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758099.689477:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758099.689481:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758099.689548:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49306:x1869355196732032:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 548us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758099.689555:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 869 00000100:00100000:1.0:1782758099.695986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758099.696052:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732288 00000100:00100000:2.0:1782758099.696061:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732288 00000100:00100000:2.0:1782758099.696116:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 870 00000100:00100000:2.0:1782758099.696126:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49306:x1869355196732288:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758099.696178:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758099.696206:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a75 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.696227:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a6e expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.696240:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758099.696250:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758099.696272:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.696286:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758099.696294:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758099.696732:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e3f6a02 reply state 000000004d2fdec2 transno 4294967636 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758099.696743:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758099.696814:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:2.0:1782758099.696919:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49306:x1869355196732288:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 792us (940us total) trans 4294967636 rc 0/0 00000100:00100000:2.0:1782758099.696926:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 870 00010000:00010000:0.0:1782758099.705259:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705278:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705286:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705292:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758099.705297:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705305:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705323:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782758099.705326:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758099.705331:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758099.705336:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777da96c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758099.891317:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211581312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891453:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758099.891460:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211580928:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891512:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211581440:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891562:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211581056:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891626:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211581568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891663:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758099.891669:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211581184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758099.891688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758099.891721:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581440 00000100:00100000:3.0:1782758099.891729:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581440 00000100:00100000:3.0:1782758099.891801:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581056 00000100:00100000:3.0:1782758099.891804:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581056 00000100:00100000:1.0:1782758099.891962:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581312 00000100:00100000:1.0:1782758099.891966:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581312 00000100:00100000:1.0:1782758099.892001:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581568 00000100:00100000:1.0:1782758099.892004:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581568 00000100:00100000:1.0:1782758099.892024:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1782758099.892033:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211581312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892103:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211581312:12345-0@lo:400:kworker.0 Request processed in 70us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892110:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1782758099.892130:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1782758099.892136:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211581568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892170:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211581568:12345-0@lo:400:kworker.0 Request processed in 34us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892176:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1782758099.892194:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211580928 00000100:00100000:1.0:1782758099.892197:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211580928 00000100:00100000:1.0:1782758099.892220:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1782758099.892226:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211580928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892256:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211580928:12345-0@lo:400:kworker.0 Request processed in 30us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892263:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1782758099.892291:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581184 00000100:00100000:1.0:1782758099.892294:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581184 00000100:00100000:1.0:1782758099.892311:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1782758099.892317:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211581440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892345:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211581440:12345-0@lo:400:kworker.0 Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892350:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1782758099.892372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1782758099.892378:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211581056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892405:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211581056:12345-0@lo:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892411:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1782758099.892423:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:1.0:1782758099.892429:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211581184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892454:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211581184:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.892460:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00080000:1.0:1782758099.892481:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758099.892486:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758099.892523:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211580928:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892538:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211581440:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892548:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211581312:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892585:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211581184:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892596:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211581056:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.892606:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211581568:0@lo:400:kworker.0 00000100:00100000:1.0:1782758099.974373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758099.974482:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732416 00000100:00100000:2.0:1782758099.974492:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732416 00000100:00100000:2.0:1782758099.974556:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 871 00000100:00100000:2.0:1782758099.974566:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732416:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758099.974785:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732416:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 219us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758099.974793:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 871 00000100:00100000:1.0:1782758099.982611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758099.982735:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732544 00000100:00100000:2.0:1782758099.982757:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732544 00000100:00100000:2.0:1782758099.982813:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 478 00000100:00100000:2.0:1782758099.982850:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49318:x1869355196732544:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758099.983523:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49318:x1869355196732544:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 699us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758099.983532:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 478 00000100:00100000:3.0:1782758099.987032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758099.987281:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732672 00000100:00100000:1.0:1782758099.987292:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732672 00000100:00100000:1.0:1782758099.987357:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 479 00000100:00100000:1.0:1782758099.987368:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49318:x1869355196732672:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758099.988165:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49318:x1869355196732672:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 795us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758099.988176:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 479 00000100:00100000:1.0:1782758099.991704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758099.991802:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732800 00000100:00100000:3.0:1782758099.991812:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732800 00000100:00100000:3.0:1782758099.991920:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 872 00000100:00100000:3.0:1782758099.991931:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732800:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758099.992654:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732800:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 721us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758099.992663:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 872 00000100:00100000:2.0:1782758099.999591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758099.999704:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196732928 00000100:00100000:0.0:1782758099.999716:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196732928 00000100:00100000:0.0:1782758099.999792:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 873 00000100:00100000:0.0:1782758099.999802:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758099.999946:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196732928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758099.999955:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 873 00000100:00100000:3.0:1782758100.001913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758100.002019:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733056 00000100:00100000:1.0:1782758100.002030:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733056 00000100:00100000:1.0:1782758100.002105:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 480 00000100:00100000:1.0:1782758100.002116:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49318:x1869355196733056:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758100.002540:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49318:x1869355196733056:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 425us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758100.002547:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 480 00000100:00100000:2.0:1782758100.007244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758100.007358:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733184 00000100:00100000:1.0:1782758100.007369:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733184 00000100:00100000:1.0:1782758100.007492:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 481 00000100:00100000:1.0:1782758100.007504:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49318:x1869355196733184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758100.008250:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49318:x1869355196733184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 746us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758100.008262:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 481 00000100:00100000:3.0:1782758100.013015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758100.013125:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733312 00000100:00100000:2.0:1782758100.013136:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733312 00000100:00100000:2.0:1782758100.013221:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 874 00000100:00100000:2.0:1782758100.013234:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196733312:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758100.013682:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49318:x1869355196733312:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 450us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758100.013691:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 874 00000100:00080000:3.0:1782758100.018982:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758100.093937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758100.094003:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733440 00000100:00100000:3.0:1782758100.094014:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733440 00000100:00100000:2.0:1782758100.094134:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 875 00000100:00100000:2.0:1782758100.094146:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49322:x1869355196733440:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758100.094166:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758100.094188:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a7c expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094255:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094269:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094280:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094296:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094303:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094310:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094694:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094708:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094715:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758100.094797:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1782758100.094801:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758100.094903:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094917:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094924:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094931:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094937:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758100.094941:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094948:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094959:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758100.094962:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758100.094966:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094977:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777da97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094988:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.094994:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095000:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095005:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758100.095008:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095013:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095019:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917182dd1400) 00010000:00010000:2.0:1782758100.095021:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758100.095024:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095029:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777da981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095053:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a7c expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095065:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a7c expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758100.095073:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758100.095075:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758100.095077:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758100.095134:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49322:x1869355196733440:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 990us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758100.095141:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 875 00000100:00100000:2.0:1782758100.108293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758100.108531:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733696 00000100:00100000:1.0:1782758100.108542:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733696 00000100:00100000:1.0:1782758100.108607:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 876 00000100:00100000:1.0:1782758100.108619:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49322:x1869355196733696:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:1.0:1782758100.108640:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758100.108660:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da98f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a83 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109087:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109103:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109115:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109129:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109135:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.109142:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758100.110006:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:1.0:1782758100.110257:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110270:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110282:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110321:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110329:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110335:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110341:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758100.110346:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110353:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110366:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782758100.110369:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758100.110373:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110379:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777da996 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758100.110392:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b83a875 reply state 00000000fbfdca72 transno 4294967637 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758100.110402:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758100.110435:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777da98f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a83 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110449:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a83 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.110456:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758100.110459:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758100.110461:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758100.110554:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49322:x1869355196733696:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1937us (2271us total) trans 4294967637 rc 0/0 00000100:00100000:1.0:1782758100.110564:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 876 00010000:00010000:1.0:1782758100.117512:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117532:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117541:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117548:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758100.117553:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117561:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117585:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758100.117588:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758100.117593:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.117598:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777da99d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758100.125600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758100.129238:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733824 00000100:00100000:1.0:1782758100.129255:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733824 00000100:00100000:1.0:1782758100.129343:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 482 00000100:00100000:1.0:1782758100.129353:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49322:x1869355196733824:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:1.0:1782758100.129372:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758100.129393:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a8a expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758100.129419:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782758100.129443:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=2168s v=(0 0) 00010000:00010000:1.0:1782758100.129448:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758100.129458:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.129655:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758100.129670:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758100.129850:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49322:x1869355196733824:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 497us (4263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758100.129859:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 482 00000100:00100000:3.0:1782758100.182074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758100.182182:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196733952 00000100:00100000:1.0:1782758100.182192:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196733952 00002000:00100000:1.0:1782758100.182248:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9171bdef4700 x1869355196733952/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:16/0 lens 488/0 e 0 to 0 dl 1782758111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1782758100.182259:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171bdef4700 with x1869355196733952 ext(0->1048575) 00002000:00010000:1.0:1782758100.182265:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171bdef4700 00000100:00100000:1.0:1782758100.182303:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1782758100.182313:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196733952:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:1.0:1782758100.233173:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196733952:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 50850us (51116us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1782758100.233188:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00002000:00100000:1.0:1782758100.233201:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9171bdef4700 x1869355196733952/t4294967352(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:16/0 lens 488/448 e 0 to 0 dl 1782758111 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1782758100.233212:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171bdef4700 with x1869355196733952 ext(0->1048575) 00002000:00010000:1.0:1782758100.233219:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171bdef4700 00000100:00100000:2.0:1782758100.240034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758100.240161:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734080 00000100:00100000:0.0:1782758100.240173:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734080 00000100:00100000:0.0:1782758100.240242:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 877 00000100:00100000:0.0:1782758100.240253:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49322:x1869355196734080:12345-192.168.204.31@tcp:44:dd.60003 00000100:00100000:1.0:1782758100.279026:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49322:x1869355196734080:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 38760us (38990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758100.279040:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 877 00000001:00080000:3.0:1782758100.279268:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967637 is committed 00000100:00100000:3.0:1782758100.286094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758100.286299:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734208 00000100:00100000:0.0:1782758100.286310:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734208 00000100:00100000:0.0:1782758100.286377:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 483 00000100:00100000:0.0:1782758100.286389:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196734208:12345-192.168.204.31@tcp:16:dd.60003 00000001:00080000:3.0:1782758100.353308:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000100:00100000:1.0:1782758100.359072:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196734208:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 72667us (72973us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758100.359085:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 483 00000100:00100000:0.0:1782758100.361717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758100.361862:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734464 00000100:00100000:3.0:1782758100.361872:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734464 00000100:00100000:3.0:1782758100.361935:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:3.0:1782758100.361946:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49322:x1869355196734464:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:3.0:1782758100.362783:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49322:x1869355196734464:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 835us (1317us total) trans 4294967638 rc 0/0 00000100:00100000:3.0:1782758100.362792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:1.0:1782758100.396855:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758100.396882:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758100.396963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758100.401118:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581696 00000100:00100000:0.0:1782758100.401134:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581696 00000100:00100000:0.0:1782758100.401236:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1782758100.401248:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211581696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758100.401296:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758100.401407:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758100.401416:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1782758100.401480:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211581696:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782758100.402261:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758100.524140:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758101.555039:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758102.026891:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:2.0:1782758102.026916:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000001:00080000:2.0:1782758102.029802:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967638 is committed 00010000:00010000:2.0:1782758102.572101:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758102.956379:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758102.956403:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211581824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758102.956490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758102.956556:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581824 00000100:00100000:0.0:1782758102.956564:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581824 00000100:00100000:0.0:1782758102.956615:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1782758102.956626:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211581824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758102.956662:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758102.956722:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211581824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758102.956729:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00080000:0.0:1782758102.956749:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758102.956784:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211581824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758103.597665:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758103.663683:0:83977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2172066857767ns, next at 2145930721207ns, rc = 0 00000004:00080000:2.0:1782758103.663792:0:83977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2172066968867ns, next at 2166708610353ns, rc = 0 00000004:00080000:3.0:1782758103.670507:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00000004:00080000:3.0:1782758103.670536:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00000100:00100000:2.0:1782758104.256479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758104.256523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758104.256555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758104.256600:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758104.256629:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734848 00000100:00100000:2.0:1782758104.256638:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734848 00000100:00100000:2.0:1782758104.256698:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734976 00000100:00100000:2.0:1782758104.256701:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734976 00000100:00100000:2.0:1782758104.256718:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1162 00000100:00100000:2.0:1782758104.256727:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196734848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758104.256794:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196734848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758104.256801:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1162 00000100:00100000:2.0:1782758104.256816:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000100:00100000:2.0:1782758104.256853:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196734976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758104.256874:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196734976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758104.256880:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000100:00100000:1.0:1782758104.256963:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734592 00000100:00100000:1.0:1782758104.256967:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734592 00000100:00100000:1.0:1782758104.256999:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1220 00000100:00100000:1.0:1782758104.257005:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196734592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758104.257029:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196734592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758104.257035:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1220 00000100:00100000:0.0:1782758104.257184:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196734720 00000100:00100000:0.0:1782758104.257201:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196734720 00000100:00100000:0.0:1782758104.257237:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1535 00000100:00100000:0.0:1782758104.257246:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196734720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758104.257275:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196734720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758104.257281:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1535 00000100:00080000:0.0:1782758104.257296:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758104.257300:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758104.257302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758104.621746:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758105.004751:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211581952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005204:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211582464:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758105.005266:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582336:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005328:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211582080:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005372:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211582592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005414:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758105.005419:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211582208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.005473:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211581952 00000100:00100000:0.0:1782758105.005495:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211581952 00000100:00100000:0.0:1782758105.005558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1782758105.005569:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005627:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211581952:12345-0@lo:400:kworker.0 Request processed in 60us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.005635:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1782758105.005687:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582464 00000100:00100000:0.0:1782758105.005690:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582464 00000100:00100000:0.0:1782758105.005724:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582080 00000100:00100000:0.0:1782758105.005726:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582080 00000100:00100000:0.0:1782758105.005746:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582208 00000100:00100000:0.0:1782758105.005749:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582208 00000100:00100000:0.0:1782758105.005765:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1782758105.005770:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211582464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005801:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211582464:12345-0@lo:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.005808:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1782758105.005848:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:0.0:1782758105.005856:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005890:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211582080:12345-0@lo:400:kworker.0 Request processed in 36us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.005897:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:0.0:1782758105.005908:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:0.0:1782758105.005914:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211582208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.005938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211582208:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.005944:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:0.0:1782758105.005964:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582336 00000100:00100000:0.0:1782758105.005967:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582336 00000100:00100000:0.0:1782758105.005995:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582592 00000100:00100000:0.0:1782758105.005998:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582592 00000100:00100000:0.0:1782758105.006017:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1782758105.006022:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211582336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006054:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211582336:12345-0@lo:400:kworker.0 Request processed in 32us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.006063:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1782758105.006074:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1782758105.006079:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211582592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006104:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211582592:12345-0@lo:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.006110:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:0.0:1782758105.006142:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758105.006146:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758105.006149:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758105.006193:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211582208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006206:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211582080:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006215:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:0.0:1782758105.006221:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7dd4000, transno 4294967351 00000100:00100000:0.0:1782758105.006233:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211582592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006728:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582336:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006744:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211582464:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.006755:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211581952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758105.517442:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758105.517473:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211582720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758105.517609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758105.517715:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582720 00000100:00100000:0.0:1782758105.517727:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582720 00000100:00100000:0.0:1782758105.517790:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1782758105.517802:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211582720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758105.517878:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758105.517935:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211582720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758105.517943:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1782758105.518185:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211582720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758105.645798:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758105.991650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758105.991703:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735104 00000100:00100000:3.0:1782758105.991716:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735104 00000100:00100000:3.0:1782758105.991786:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 878 00000100:00100000:3.0:1782758105.991798:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735104:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758105.991946:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735104:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 149us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758105.991955:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 878 00000100:00100000:3.0:1782758105.996643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758105.996693:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735232 00000100:00100000:3.0:1782758105.996706:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735232 00000100:00100000:3.0:1782758105.996772:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 484 00000100:00100000:3.0:1782758105.996785:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49516:x1869355196735232:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758106.000172:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49516:x1869355196735232:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 3375us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758106.000191:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 484 00000100:00100000:3.0:1782758106.002925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758106.002972:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735360 00000100:00100000:3.0:1782758106.002984:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735360 00000100:00100000:3.0:1782758106.003072:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 485 00000100:00100000:3.0:1782758106.003084:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49516:x1869355196735360:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758106.003647:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49516:x1869355196735360:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 563us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758106.003657:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 485 00000100:00080000:3.0:1782758106.003698:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758106.005665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758106.005706:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735488 00000100:00100000:3.0:1782758106.005716:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735488 00000100:00100000:3.0:1782758106.005783:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 879 00000100:00100000:3.0:1782758106.005795:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735488:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758106.007843:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735488:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2022us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758106.007859:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 879 00000100:00080000:3.0:1782758106.007931:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758106.020338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758106.020434:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735616 00000100:00100000:0.0:1782758106.020447:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735616 00000100:00100000:0.0:1782758106.020523:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 880 00000100:00100000:0.0:1782758106.020536:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735616:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758106.020688:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196735616:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 155us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758106.020697:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 880 00000100:00100000:3.0:1782758106.022928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758106.023242:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735744 00000100:00100000:1.0:1782758106.023254:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735744 00000100:00080000:3.0:1782758106.023397:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758106.023419:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 486 00000100:00100000:1.0:1782758106.023432:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49516:x1869355196735744:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758106.023992:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49516:x1869355196735744:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 561us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758106.025148:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 486 00000100:00100000:1.0:1782758106.026686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758106.027146:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196735872 00000100:00100000:3.0:1782758106.027157:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196735872 00000100:00100000:3.0:1782758106.027221:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 487 00000100:00100000:3.0:1782758106.027233:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49516:x1869355196735872:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758106.028087:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49516:x1869355196735872:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 853us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758106.028100:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 487 00000100:00100000:3.0:1782758106.033031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758106.033524:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736000 00000100:00100000:0.0:1782758106.033547:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736000 00000100:00100000:0.0:1782758106.033644:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 881 00000100:00100000:0.0:1782758106.033657:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196736000:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758106.035472:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49516:x1869355196736000:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1809us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758106.035488:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 881 00000100:00100000:0.0:1782758106.098142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758106.098347:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736256 00000100:00100000:3.0:1782758106.098360:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736256 00000100:00100000:3.0:1782758106.098436:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 882 00000100:00100000:3.0:1782758106.098449:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49520:x1869355196736256:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782758106.098543:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758106.098580:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777da9a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a83 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.098779:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758106.098796:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758106.098902:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.098920:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.098931:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.099017:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.099025:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.099033:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.100617:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.100652:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.100665:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758106.102975:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:2.0:1782758106.102993:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2174506169701ns, next at 2175506165912ns, rc = 0 00010000:00010000:2.0:1782758106.103408:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103555:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103570:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103581:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103589:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103594:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103635:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758106.103672:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103679:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103687:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103694:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758106.103699:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103707:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.103709:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758106.103780:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758106.103785:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758106.103791:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103799:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777da9c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103884:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103892:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103898:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103904:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758106.103908:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103914:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103923:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758106.103926:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758106.103929:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758106.103934:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777da9b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758106.103948:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049f0774c reply state 00000000b6d05545 transno 4294967639 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758106.103960:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758106.104665:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.104678:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758106.104682:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.104691:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.104703:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782758106.104707:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758106.104710:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.104717:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777da9ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758106.104742:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758106.104745:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758106.104747:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758106.104885:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49520:x1869355196736256:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 6430us (6751us total) trans 4294967639 rc 0/0 00000100:00100000:2.0:1782758106.104897:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 882 00010000:00010000:0.0:1782758106.110676:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110700:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110710:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110722:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758106.110728:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110737:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110760:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff917191f75500) 00010000:00010000:0.0:1782758106.110764:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758106.110770:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758106.110777:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777da9c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758106.668194:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758107.692925:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758108.078470:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2176481644491ns, next at 2177481642189ns, rc = 0 00000100:00100000:3.0:1782758108.078493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758108.078517:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758108.078601:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758108.078721:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582848 00000100:00100000:0.0:1782758108.078728:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582848 00000100:00100000:0.0:1782758108.078791:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1782758108.078801:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211582848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758108.078864:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758108.078916:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211582848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758108.078924:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00080000:3.0:1782758108.078992:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758108.079027:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758108.718924:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758109.197711:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00000001:00080000:3.0:1782758109.197788:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967639 is committed 00000004:00080000:3.0:1782758109.197794:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00000100:00100000:0.0:1782758109.198430:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758109.198496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758109.198639:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211582976 00000100:00100000:1.0:1782758109.198647:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211582976 00000100:00100000:1.0:1782758109.198695:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1782758109.198703:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211582976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782758109.198729:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:1.0:1782758109.198752:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758109.198773:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758109.198781:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1782758109.198785:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758109.198790:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758109.198816:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758109.198862:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 5 pid: 6597 timeout: 2277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758109.198876:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211583104:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758109.200518:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782758109.211024:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211583104:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782758109.211058:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758109.211767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758109.211990:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736384 00000100:00100000:3.0:1782758109.211998:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736384 00010000:00010000:3.0:1782758109.212040:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 2277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758109.212072:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:3.0:1782758109.212081:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196736384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758109.212095:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758109.212101:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 2277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212114:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 2277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212138:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a364d6/0xdd99f5c4777da9b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a8a expref: 6 pid: 6597 timeout: 2277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212152:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758109.212156:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758109.212162:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212173:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212195:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758109.212237:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196736384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 157us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758109.212245:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00080000:3.0:1782758109.212263:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758109.212274:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212283:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212293:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212302:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.212317:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758109.212890:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211582976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14185us (14391us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782758109.212898:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:3.0:1782758109.212985:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758109.212993:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.213002:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758109.213007:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.213017:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.213030:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.213037:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ae12c3d/0xdd99f5c4777da9d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758109.213053:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758109.213055:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758109.213056:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758109.213087:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7766d80/2, rc 0, transno 4294967353 00000100:00100000:3.0:1782758109.213093:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211582976:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1782758109.273707:0:84125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2177676881577ns, next at 2177481642189ns, rc = 0 00000004:00080000:3.0:1782758109.275224:0:84125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2177678399274ns, next at 2166708610353ns, rc = 0 00000004:00080000:3.0:1782758109.280983:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000004:00080000:3.0:1782758109.281012:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000100:00100000:0.0:1782758109.377464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758109.377509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758109.377538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758109.377579:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736768 00000100:00100000:0.0:1782758109.377590:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736768 00000100:00100000:0.0:1782758109.377655:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1166 00000100:00100000:0.0:1782758109.377667:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196736768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758109.377742:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196736768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758109.377750:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1166 00000100:00100000:3.0:1782758109.379204:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736640 00000100:00100000:3.0:1782758109.379216:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736640 00000100:00100000:3.0:1782758109.379285:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1539 00000100:00100000:3.0:1782758109.379295:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196736640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758109.379366:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196736640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758109.379373:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1539 00000100:00080000:3.0:1782758109.379401:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758109.379406:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758109.379934:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736512 00000100:00100000:2.0:1782758109.379940:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736512 00000100:00100000:2.0:1782758109.379985:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00100000:2.0:1782758109.379993:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196736512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758109.380046:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196736512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758109.380053:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1222 00010000:00010000:2.0:1782758109.740077:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758110.133471:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758110.133495:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211583232:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.133579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758110.133648:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583232 00000100:00100000:1.0:1782758110.133658:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583232 00000100:00100000:1.0:1782758110.133700:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1782758110.133708:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211583232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.133760:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211583232:12345-0@lo:400:kworker.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758110.133769:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1782758110.133847:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211583232:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134103:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211583360:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758110.134165:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583360 00000100:00100000:1.0:1782758110.134168:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583360 00000100:00100000:1.0:1782758110.134200:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:1.0:1782758110.134206:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211583360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134244:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211583360:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758110.134251:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:1.0:1782758110.134282:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211583360:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134355:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758110.134363:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211583744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758110.134426:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211583872:0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758110.134479:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583872 00000100:00100000:1.0:1782758110.134483:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583872 00000100:00100000:1.0:1782758110.134517:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1782758110.134523:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211583872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758110.134572:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211583872:12345-0@lo:400:kworker.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758110.134578:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1782758110.134607:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211583872:0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.134716:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211583488:0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.134749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758110.134778:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758110.134784:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211583616:0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.134806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758110.134855:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583744 00000100:00100000:2.0:1782758110.135250:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583744 00000100:00100000:2.0:1782758110.135286:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583488 00000100:00100000:2.0:1782758110.135289:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583488 00000100:00100000:2.0:1782758110.135313:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1782758110.135319:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.135360:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211583744:12345-0@lo:400:kworker.0 Request processed in 42us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758110.135366:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1782758110.135380:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1782758110.135386:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.135415:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211583488:12345-0@lo:400:kworker.0 Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758110.135421:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1782758110.135441:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211583616 00000100:00100000:2.0:1782758110.135444:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211583616 00000100:00100000:2.0:1782758110.135466:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782758110.135472:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.135501:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211583616:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758110.135507:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782758110.135539:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211583616:0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.135564:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211583488:0@lo:400:kworker.0 00000100:00100000:2.0:1782758110.135589:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211583744:0@lo:400:kworker.0 00000100:00080000:3.0:1782758110.135681:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758110.135686:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758110.135688:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758110.637018:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211584000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758110.637100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758110.637869:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584000 00000100:00100000:0.0:1782758110.637879:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584000 00000100:00100000:0.0:1782758110.637929:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1782758110.637959:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211584000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758110.638006:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758110.638075:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211584000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758110.638081:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1782758110.641241:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211584000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758110.764458:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758111.290432:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00010000:00010000:3.0:1782758111.788106:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758112.814302:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758113.198225:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211584128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758113.198320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758113.198908:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584128 00000100:00100000:1.0:1782758113.198917:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584128 00000100:00100000:1.0:1782758113.198983:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1782758113.198993:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211584128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758113.199032:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758113.199092:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211584128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758113.199099:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1782758113.199144:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:1.0:1782758113.199150:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7766d80, transno 4294967353 00000100:00100000:1.0:1782758113.199169:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211584128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758113.204787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758113.836117:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758114.490788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758114.490869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758114.490916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758114.490950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758114.491047:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737024 00000100:00100000:1.0:1782758114.491058:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737024 00000100:00100000:1.0:1782758114.491136:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1543 00000100:00100000:1.0:1782758114.491147:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196737024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758114.491221:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196737024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758114.491228:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1543 00000100:00100000:3.0:1782758114.491376:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196736896 00000100:00100000:3.0:1782758114.491381:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196736896 00000100:00100000:3.0:1782758114.491415:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1224 00000100:00100000:3.0:1782758114.491422:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196736896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758114.491450:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196736896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758114.491471:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1224 00000100:00100000:2.0:1782758114.491493:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737280 00000100:00100000:2.0:1782758114.491497:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737280 00000100:00100000:2.0:1782758114.491532:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737152 00000100:00100000:2.0:1782758114.491534:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737152 00000100:00100000:2.0:1782758114.491557:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1169 00000100:00100000:2.0:1782758114.491563:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758114.491593:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758114.491599:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1169 00000100:00100000:2.0:1782758114.491611:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1170 00000100:00100000:2.0:1782758114.491617:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758114.491645:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758114.491651:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1170 00000100:00080000:0.0:1782758114.492559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758114.492565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758114.492569:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758114.864354:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758115.245544:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211584512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758115.245622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758115.245693:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758115.245700:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211584640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758115.245727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758115.245782:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584512 00000100:00100000:0.0:1782758115.245790:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584512 00000100:00100000:0.0:1782758115.245880:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1782758115.245908:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211584512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758115.245971:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211584512:12345-0@lo:400:kworker.0 Request processed in 69us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758115.245979:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1782758115.246006:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584640 00000100:00100000:0.0:1782758115.246010:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584640 00000100:00100000:0.0:1782758115.246038:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1782758115.246240:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211584640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758115.246278:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211584640:12345-0@lo:400:kworker.0 Request processed in 42us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758115.246284:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:0.0:1782758115.246303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758115.246308:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758115.246348:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211584640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758115.246360:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211584512:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247241:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211584384:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758115.247346:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211584896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758115.247400:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758115.247406:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211584256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758115.247463:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211584768:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758115.247512:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584384 00000100:00100000:1.0:1782758115.247517:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584384 00000100:00100000:1.0:1782758115.247553:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584768 00000100:00100000:1.0:1782758115.247556:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584768 00000100:00100000:1.0:1782758115.247579:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:1.0:1782758115.247586:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211584384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247632:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211584384:12345-0@lo:400:kworker.0 Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758115.247639:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:1.0:1782758115.247659:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1782758115.247665:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247688:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211584768:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758115.247694:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1782758115.247726:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211584768:0@lo:400:kworker.0 00000100:00100000:1.0:1782758115.247735:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211584384:0@lo:400:kworker.0 00000100:00100000:2.0:1782758115.249316:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584896 00000100:00100000:2.0:1782758115.249327:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584896 00000100:00100000:2.0:1782758115.249397:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1782758115.249407:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211584896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758115.249491:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211584896:12345-0@lo:400:kworker.0 Request processed in 85us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758115.249498:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1782758115.249521:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211584256 00000100:00100000:2.0:1782758115.249525:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211584256 00000100:00100000:2.0:1782758115.249551:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1782758115.249556:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211584256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758115.249586:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211584256:12345-0@lo:400:kworker.0 Request processed in 29us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758115.249591:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1782758115.249641:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211584256:0@lo:400:kworker.0 00000100:00100000:2.0:1782758115.249656:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211584896:0@lo:400:kworker.0 00000100:00080000:0.0:1782758115.251188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758115.251197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758115.758138:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211585024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758115.758218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758115.763914:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585024 00000100:00100000:0.0:1782758115.763940:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585024 00000100:00100000:0.0:1782758115.764019:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1782758115.764029:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211585024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758115.764086:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758115.764193:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211585024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758115.764201:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1782758115.764376:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211585024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758115.884159:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758116.908125:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758117.932248:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758118.316179:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758118.316259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758118.319613:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585152 00000100:00100000:0.0:1782758118.319631:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585152 00000100:00100000:0.0:1782758118.319752:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1782758118.319764:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211585152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758118.319820:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758118.319983:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211585152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758118.319991:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1782758118.320351:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211585152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758118.320460:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758118.956905:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758119.604031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758119.604088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758119.604128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758119.604215:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737408 00000100:00100000:1.0:1782758119.604225:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737408 00000100:00100000:1.0:1782758119.604284:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:1.0:1782758119.604294:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196737408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758119.604371:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196737408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758119.604379:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:2.0:1782758119.604573:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737536 00000100:00100000:2.0:1782758119.604578:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737536 00000100:00100000:2.0:1782758119.604630:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1547 00000100:00100000:2.0:1782758119.604637:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196737536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758119.604671:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196737536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758119.604678:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1547 00000100:00080000:0.0:1782758119.604773:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758119.604957:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737792 00000100:00100000:3.0:1782758119.604962:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737792 00000100:00100000:3.0:1782758119.605010:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1173 00000100:00100000:3.0:1782758119.605018:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758119.605048:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196737792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758119.605058:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1173 00000100:00080000:0.0:1782758119.605331:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758119.605429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758119.605692:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737664 00000100:00100000:1.0:1782758119.605698:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737664 00000100:00100000:1.0:1782758119.605741:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1174 00000100:00100000:1.0:1782758119.605759:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196737664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758119.605792:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196737664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758119.605798:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1174 00000100:00080000:0.0:1782758119.605972:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758119.980096:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758120.367203:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758120.373176:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211585408:0@lo:400:kworker.0 00000100:00100000:1.0:1782758120.374707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758120.375009:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211585280:0@lo:400:kworker.0 00000100:00100000:1.0:1782758120.375054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758120.375163:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585280 00000100:00100000:0.0:1782758120.375172:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585280 00000100:00100000:0.0:1782758120.375239:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1782758120.375248:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211585280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758120.375313:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211585280:12345-0@lo:400:kworker.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758120.375320:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1782758120.375384:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211585280:0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.375679:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585408 00000100:00100000:3.0:1782758120.375684:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585408 00000100:00100000:3.0:1782758120.375861:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1782758120.375871:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211585408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.375926:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211585408:12345-0@lo:400:kworker.0 Request processed in 58us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758120.375933:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1782758120.375996:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211585408:0@lo:400:kworker.0 00000100:00100000:1.0:1782758120.380160:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211585664:0@lo:400:kworker.0 00000100:00100000:2.0:1782758120.380173:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211585920:0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.380265:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211585792:0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.380320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758120.380320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758120.380404:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211585536:0@lo:400:kworker.0 00000100:00100000:0.0:1782758120.380434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758120.380598:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585920 00000100:00100000:3.0:1782758120.380607:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585920 00000100:00100000:3.0:1782758120.380667:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1782758120.380676:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211585920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.380727:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211585920:12345-0@lo:400:kworker.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758120.380734:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:3.0:1782758120.380944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758120.380967:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585792 00000100:00100000:3.0:1782758120.380973:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585792 00000100:00100000:3.0:1782758120.381001:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585536 00000100:00100000:3.0:1782758120.381004:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585536 00000100:00100000:3.0:1782758120.381028:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1782758120.381034:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211585792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.381071:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211585792:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758120.381078:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1782758120.381090:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1782758120.381096:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211585536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758120.381136:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211585536:12345-0@lo:400:kworker.0 Request processed in 40us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758120.381142:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00080000:3.0:1782758120.381160:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758120.381188:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211585792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758120.381292:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211585536:0@lo:400:kworker.0 00000100:00100000:1.0:1782758120.381409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758120.381516:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211585664 00000100:00100000:0.0:1782758120.381520:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211585664 00000100:00100000:0.0:1782758120.381609:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1782758120.381617:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211585664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758120.381658:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211585664:12345-0@lo:400:kworker.0 Request processed in 42us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758120.381664:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1782758120.381739:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211585664:0@lo:400:kworker.0 00000100:00080000:3.0:1782758120.381976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758120.388959:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211585920:0@lo:400:kworker.0 00000100:00100000:1.0:1782758120.876153:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758120.876180:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211586048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758120.876263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758120.876473:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586048 00000100:00100000:0.0:1782758120.876484:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586048 00000100:00100000:0.0:1782758120.876549:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1782758120.876559:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211586048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758120.876600:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758120.876667:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211586048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758120.876790:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1782758120.876896:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211586048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758121.004585:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758122.028288:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758123.052119:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758123.436594:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758123.436628:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211586176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758123.436699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758123.437320:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586176 00000100:00100000:1.0:1782758123.437329:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586176 00000100:00100000:1.0:1782758123.437409:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1782758123.437419:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211586176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758123.437455:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758123.437514:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211586176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758123.437522:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1782758123.437720:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211586176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758123.437788:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758123.956440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758123.956480:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196737920 00000100:00100000:1.0:1782758123.956489:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196737920 00000100:00100000:1.0:1782758123.956553:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 883 00000100:00100000:1.0:1782758123.956563:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196737920:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758123.956665:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196737920:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758123.956673:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 883 00000100:00080000:1.0:1782758123.956700:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758123.963021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758123.963061:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738048 00000100:00100000:3.0:1782758123.963071:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738048 00000100:00100000:3.0:1782758123.963128:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 489 00000100:00100000:3.0:1782758123.963138:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738048:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758123.963727:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738048:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 588us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758123.963735:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 489 00000100:00080000:1.0:1782758123.963924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758123.968646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758123.968765:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738176 00000100:00100000:0.0:1782758123.968775:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738176 00000100:00100000:0.0:1782758123.968868:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 490 00000100:00100000:0.0:1782758123.968882:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738176:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758123.969258:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738176:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 379us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758123.969267:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 490 00000100:00080000:3.0:1782758123.969687:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758123.982246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758123.982475:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738304 00000100:00100000:2.0:1782758123.982485:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738304 00000100:00100000:2.0:1782758123.982549:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 884 00000100:00100000:2.0:1782758123.982560:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738304:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758123.984495:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738304:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1930us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758123.984508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 884 00000100:00100000:0.0:1782758123.996135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758123.998786:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738432 00000100:00100000:3.0:1782758123.998802:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738432 00000100:00100000:3.0:1782758123.998917:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 885 00000100:00100000:3.0:1782758123.998928:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738432:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758123.999044:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738432:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 117us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758123.999053:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 885 00000100:00100000:3.0:1782758124.016308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758124.016338:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738560 00000100:00100000:3.0:1782758124.016347:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738560 00000100:00100000:3.0:1782758124.016393:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 491 00000100:00100000:3.0:1782758124.016403:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738560:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758124.019360:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738560:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 2948us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758124.019373:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 491 00000100:00100000:2.0:1782758124.026537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758124.027431:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738688 00000100:00100000:0.0:1782758124.027443:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738688 00000100:00100000:0.0:1782758124.027500:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 492 00000100:00100000:0.0:1782758124.027510:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738688:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758124.027934:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49698:x1869355196738688:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 424us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758124.027942:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 492 00000100:00100000:3.0:1782758124.036707:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758124.041200:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738816 00000100:00100000:1.0:1782758124.041214:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738816 00000100:00100000:1.0:1782758124.042688:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 886 00000100:00100000:1.0:1782758124.042705:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738816:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758124.044119:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49698:x1869355196738816:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1415us (7416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758124.044129:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 886 00010000:00010000:1.0:1782758124.076082:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758124.111077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758124.111120:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196738944 00000100:00100000:0.0:1782758124.111129:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196738944 00000100:00100000:0.0:1782758124.111183:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 887 00000100:00100000:0.0:1782758124.111193:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49699:x1869355196738944:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758124.111213:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758124.111235:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777da9dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a91 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111318:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111333:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111345:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758124.111535:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1782758124.111540:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758124.111621:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111646:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777da9dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a91 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111661:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a91 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758124.111669:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782758124.111672:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758124.111675:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51400, rc 0) 00000100:00100000:0.0:1782758124.111730:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49699:x1869355196738944:12345-192.168.204.31@tcp:101:rm.0 Request processed in 538us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758124.111736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 887 00000100:00100000:0.0:1782758124.132988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758124.133086:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196739200 00000100:00100000:2.0:1782758124.133096:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196739200 00000100:00100000:2.0:1782758124.133160:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 888 00000100:00100000:2.0:1782758124.133171:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49699:x1869355196739200:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758124.133192:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758124.133213:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a98 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758124.133492:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00010000:2.0:1782758124.133734:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da9ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a98 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758124.133749:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758124.133752:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782758124.133758:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777da9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a98 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758124.133769:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758124.133858:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49699:x1869355196739200:12345-192.168.204.31@tcp:101:rm.0 Request processed in 688us (876us total) trans 4294967640 rc 301/301 00000100:00100000:2.0:1782758124.133866:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 888 00000100:00100000:2.0:1782758124.138960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758124.139601:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196739328 00000100:00100000:3.0:1782758124.139612:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196739328 00000100:00100000:3.0:1782758124.140089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:3.0:1782758124.140101:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49699:x1869355196739328:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:2.0:1782758124.160211:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49699:x1869355196739328:12345-192.168.204.31@tcp:37:rm.0 Request processed in 20101us (21246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758124.160228:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:3.0:1782758124.167304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758124.169599:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196739584 00000100:00100000:2.0:1782758124.169613:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196739584 00000100:00100000:2.0:1782758124.169672:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:2.0:1782758124.169682:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49699:x1869355196739584:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:2.0:1782758124.170786:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49699:x1869355196739584:12345-192.168.204.31@tcp:35:rm.0 Request processed in 1103us (3487us total) trans 4294967641 rc 0/0 00000100:00100000:2.0:1782758124.170796:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:2.0:1782758124.176688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758124.176934:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196739840 00000100:00100000:3.0:1782758124.176944:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196739840 00000100:00100000:3.0:1782758124.177000:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 889 00000100:00100000:3.0:1782758124.177010:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49699:x1869355196739840:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758124.177069:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782758124.177097:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777da9e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a91 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177128:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777da988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a7c expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177140:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782758124.177158:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777da694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf649c6 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177170:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758124.177178:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758124.177202:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177216:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177226:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177254:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177263:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758124.177528:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.188246:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.188279:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.188291:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758124.209409:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00010000:1.0:1782758124.209436:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209446:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209452:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209458:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758124.209462:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209469:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209482:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758124.209485:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758124.209488:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209494:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777daa06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209516:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209521:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209526:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209530:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758124.209532:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209538:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209544:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75c00) 00010000:00010000:1.0:1782758124.209546:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758124.209549:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.209554:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777da9f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758124.209565:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000019821ae reply state 00000000c79a2259 transno 4294967642 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758124.209574:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758124.209665:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49699:x1869355196739840:12345-192.168.204.31@tcp:36:rm.0 Request processed in 32653us (32983us total) trans 4294967642 rc 0/0 00000100:00100000:1.0:1782758124.209674:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 889 00010000:00010000:1.0:1782758124.224480:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224496:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224503:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224509:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758124.224514:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224521:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224538:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75900) 00010000:00010000:1.0:1782758124.224542:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758124.224547:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758124.224553:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777da9ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758124.727591:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758124.727698:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196739968 00000100:00100000:1.0:1782758124.727709:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196739968 00000100:00100000:1.0:1782758124.727769:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1228 00000100:00100000:1.0:1782758124.727780:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196739968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758124.727879:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196739968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758124.727886:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1228 00000001:00080000:1.0:1782758125.081494:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967642 is committed 00010000:00010000:2.0:1782758125.100038:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758125.495162:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211586560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758125.495222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758125.495283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758125.495288:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211586688:0@lo:400:kworker.0 00000100:00100000:1.0:1782758125.495309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758125.495339:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586688 00000100:00100000:1.0:1782758125.495345:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586688 00000100:00100000:1.0:1782758125.495392:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1782758125.495399:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211586688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758125.495442:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211586688:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758125.495447:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:1.0:1782758125.495467:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758125.495494:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211586688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495566:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211586304:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758125.495634:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211586816:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758125.495676:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758125.495682:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211586432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758125.495716:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211586944:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758125.495775:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586560 00000100:00100000:3.0:1782758125.495779:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586560 00000100:00100000:3.0:1782758125.495805:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586816 00000100:00100000:3.0:1782758125.495808:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586816 00000100:00100000:3.0:1782758125.495856:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586432 00000100:00100000:3.0:1782758125.495859:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586432 00000100:00100000:3.0:1782758125.495872:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1782758125.495876:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211586560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495907:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211586560:12345-0@lo:400:kworker.0 Request processed in 30us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758125.495912:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1782758125.495931:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1782758125.495935:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211586816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.495960:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211586816:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758125.495965:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1782758125.495979:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1782758125.495985:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211586432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.496013:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211586432:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758125.496020:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1782758125.496044:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211586432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758125.496054:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211586816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758125.496216:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586944 00000100:00100000:0.0:1782758125.496221:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586944 00000100:00100000:0.0:1782758125.496260:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1782758125.496270:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211586944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758125.496313:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211586944:12345-0@lo:400:kworker.0 Request processed in 46us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758125.496319:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1782758125.496354:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211586944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758125.496432:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211586304 00000100:00100000:1.0:1782758125.496437:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211586304 00000100:00100000:1.0:1782758125.496463:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1782758125.496470:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211586304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758125.496503:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211586304:12345-0@lo:400:kworker.0 Request processed in 34us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758125.496509:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00080000:1.0:1782758125.496540:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758125.496544:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758125.496559:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211586560:0@lo:400:kworker.0 00000100:00100000:0.0:1782758125.496618:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211586304:0@lo:400:kworker.0 00000100:00100000:2.0:1782758126.004059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211587072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758126.004177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758126.004309:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587072 00000100:00100000:2.0:1782758126.004319:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587072 00000100:00100000:2.0:1782758126.004391:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1782758126.004406:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211587072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758126.004465:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758126.004536:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211587072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758126.004545:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1782758126.004610:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211587072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758126.130275:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758127.149036:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758127.792751:0:84390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeab6ffad0 20000000:00000080:0.0:1782758127.792772:0:84390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082ca8000 uarg=0000000000000000 00010000:00010000:0.0:1782758127.793485:0:84390:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758127.793502:0:84390:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758127.799399:0:84390:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758127.799438:0:84390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.799678:0:84390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.799689:0:84390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.799737:0:84390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.799752:0:84390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 18 pid: 5794 timeout: 2296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758127.799767:0:84390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84390:1869355211587200:0@lo:104: 00000100:00100000:0.0:1782758127.800193:0:84390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758127.800270:0:84390:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b5820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758127.800481:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587200 00000100:00100000:1.0:1782758127.800491:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587200 00000100:00100000:1.0:1782758127.800556:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782758127.800565:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:84390:x1869355211587200:12345-0@lo:104: 00010000:00010000:1.0:1782758127.800579:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758127.800652:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758127.800658:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:84390:x1869355211587200:12345-0@lo:104: Request processed in 94us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758127.800665:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:2.0:1782758127.800778:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758127.800786:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.800793:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758127.800797:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.800806:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758127.800813:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758127.800844:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758127.800876:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.800883:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758127.800909:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.800916:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777da67f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777da686 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.800930:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758127.800932:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758127.800934:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758127.800947:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211587328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758127.800980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758127.801020:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587328 00000100:00100000:2.0:1782758127.801025:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587328 00010000:00010000:2.0:1782758127.801044:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 2296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758127.801246:0:84390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84390:1869355211587200:0@lo:104: 00010000:00010000:0.0:1782758127.801271:0:84390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758127.816060:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782758127.816097:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211587328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758127.816118:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758127.816127:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 2296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816144:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 2296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816162:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777da686 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777da67f expref: 19 pid: 5794 timeout: 2296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816178:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816186:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816215:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816222:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816228:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816234:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816241:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758127.816245:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816253:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816273:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758127.816283:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758127.816364:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211587328:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (15381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758127.816372:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782758127.816434:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211587328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758127.816621:0:84390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.816631:0:84390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758127.816638:0:84390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777daa0d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758128.179700:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758128.578409:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758128.578437:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211587456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758128.578524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758128.578847:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587456 00000100:00100000:0.0:1782758128.578855:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587456 00000100:00100000:0.0:1782758128.578912:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1782758128.578923:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211587456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758128.578960:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758128.579011:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211587456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758128.579019:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:0.0:1782758128.579041:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758128.579076:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211587456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758129.197815:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758129.199181:0:84439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe324c0960 20000000:00000080:3.0:1782758129.199197:0:84439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d65400 uarg=0000000000000000 00010000:00010000:3.0:1782758129.199459:0:84439:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758129.199474:0:84439:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758129.200893:0:84439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758129.200919:0:84439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200937:0:84439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200950:0:84439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200956:0:84439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200963:0:84439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200970:0:84439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200976:0:84439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758129.200982:0:84439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.200989:0:84439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.201138:0:84439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.201149:0:84439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.201156:0:84439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777daa14 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758129.645185:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758129.645192:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758129.645197:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758129.645242:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.645254:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.645264:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758129.645289:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211587584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758129.645358:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758129.645406:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917184d113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758129.645425:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587584 00000100:00100000:3.0:1782758129.645432:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587584 00000100:00100000:3.0:1782758129.645477:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1782758129.645485:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211587584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758129.645498:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758129.647130:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daa1b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.647244:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.647255:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.647264:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758129.647330:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211587584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1844us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758129.647338:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1782758129.647407:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211587584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758129.647425:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.647434:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758129.647454:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758129.647460:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758129.647468:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758129.847341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758129.847393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758129.847433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758129.847479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758129.847525:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740480 00000100:00100000:3.0:1782758129.847534:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740480 00000100:00100000:3.0:1782758129.847598:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740352 00000100:00100000:3.0:1782758129.847602:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740352 00000100:00100000:3.0:1782758129.847628:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00100000:3.0:1782758129.847640:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758129.847718:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758129.847726:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00100000:3.0:1782758129.847749:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1180 00000100:00100000:3.0:1782758129.847756:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758129.847780:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758129.847786:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1180 00000100:00100000:0.0:1782758129.847939:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740096 00000100:00100000:0.0:1782758129.847944:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740096 00000100:00100000:0.0:1782758129.847976:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1231 00000100:00100000:0.0:1782758129.847983:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196740096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758129.848010:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196740096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758129.848016:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1231 00000100:00080000:0.0:1782758129.848069:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758129.848073:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758129.848298:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740224 00000100:00100000:2.0:1782758129.848303:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740224 00000100:00100000:2.0:1782758129.848348:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1554 00000100:00100000:2.0:1782758129.848355:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758129.848413:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196740224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 58us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758129.848420:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1554 00000100:00080000:0.0:1782758129.849180:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758130.229188:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758130.604104:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211587840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.604195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758130.604251:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211588352:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.604280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758130.604319:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758130.604326:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211587968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.604348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758130.604386:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587840 00000100:00100000:1.0:1782758130.604395:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587840 00000100:00100000:1.0:1782758130.604439:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587968 00000100:00100000:1.0:1782758130.604442:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587968 00000100:00100000:0.0:1782758130.604756:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211587712:0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.604791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758130.604820:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211588224:0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.604921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758130.604947:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758130.604953:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211588096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.604975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758130.605003:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588352 00000100:00100000:0.0:1782758130.605007:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588352 00000100:00100000:0.0:1782758130.605055:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588096 00000100:00100000:0.0:1782758130.605058:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588096 00000100:00100000:0.0:1782758130.605080:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1782758130.605088:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605484:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211588352:12345-0@lo:400:kworker.0 Request processed in 396us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758130.605492:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1782758130.605513:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1782758130.605520:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211588096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605554:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211588096:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758130.605560:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1782758130.605601:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211588096:0@lo:400:kworker.0 00000100:00080000:0.0:1782758130.605649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758130.605653:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758130.605656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758130.605672:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588224 00000100:00100000:0.0:1782758130.605675:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588224 00000100:00100000:0.0:1782758130.605707:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1782758130.605714:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605748:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211587840:12345-0@lo:400:kworker.0 Request processed in 34us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758130.605754:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1782758130.605772:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1782758130.605778:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211588224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605810:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211588224:12345-0@lo:400:kworker.0 Request processed in 33us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758130.605816:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00080000:0.0:1782758130.605860:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758130.605877:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211588224:0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605906:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211587712 00000100:00100000:0.0:1782758130.605909:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211587712 00000100:00100000:0.0:1782758130.605934:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1782758130.605939:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211587712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758130.605973:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211587712:12345-0@lo:400:kworker.0 Request processed in 33us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758130.605979:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1782758130.606014:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211587712:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.606414:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1782758130.606423:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211587968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.606536:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211587968:12345-0@lo:400:kworker.0 Request processed in 113us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758130.606543:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1782758130.606576:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211587968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.606588:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211587840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758130.606599:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211588352:0@lo:400:kworker.0 00000100:00100000:3.0:1782758131.117284:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211588480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758131.117365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758131.117442:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588480 00000100:00100000:3.0:1782758131.117449:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588480 00000100:00100000:3.0:1782758131.119648:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1782758131.119663:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211588480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758131.119711:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758131.119804:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211588480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758131.119811:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1782758131.119903:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211588480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758131.244286:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758132.268101:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758133.245369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758133.245488:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740608 00000100:00100000:0.0:1782758133.245498:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740608 00000100:00100000:0.0:1782758133.245584:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 890 00000100:00100000:0.0:1782758133.245596:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49814:x1869355196740608:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758133.245630:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758133.245653:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64a9f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782758133.245925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758133.245997:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.246012:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.246025:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758133.246246:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758133.246251:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758133.246333:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.246360:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a9f expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.246376:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a9f expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.246384:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758133.246388:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758133.246391:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758133.246454:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49814:x1869355196740608:12345-192.168.204.31@tcp:101:rm.0 Request processed in 861us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758133.246461:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 890 00000100:00100000:2.0:1782758133.249714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758133.249817:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740736 00000100:00100000:1.0:1782758133.249860:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740736 00000100:00100000:1.0:1782758133.249920:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 891 00000100:00100000:1.0:1782758133.249929:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49814:x1869355196740736:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758133.249949:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758133.249968:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daa37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64aa6 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250024:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250038:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250049:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250063:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250071:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250077:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250368:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250377:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250384:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250390:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758133.250395:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250402:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250430:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:1.0:1782758133.250434:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758133.250439:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250444:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250457:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250462:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250468:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250473:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758133.250476:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250482:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250489:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758133.250491:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758133.250494:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250500:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250529:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daa37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aa6 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250539:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:1.0:1782758133.250541:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758133.250545:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daa37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aa6 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.250555:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782758133.250617:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49814:x1869355196740736:12345-192.168.204.31@tcp:101:rm.0 Request processed in 689us (911us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758133.250625:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 891 00010000:00010000:0.0:1782758133.292115:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758133.302730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758133.302879:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196740864 00000100:00100000:0.0:1782758133.302890:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196740864 00000100:00100000:0.0:1782758133.302949:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 892 00000100:00100000:0.0:1782758133.302959:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196740864:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782758133.303003:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782758133.303071:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196740864:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758133.303079:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 892 00000100:00100000:3.0:1782758133.305459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758133.305609:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741120 00000100:00100000:0.0:1782758133.305618:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741120 00000100:00100000:0.0:1782758133.305681:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 893 00000100:00100000:0.0:1782758133.305691:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49818:x1869355196741120:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782758133.305745:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758133.305775:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777daa30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64a9f expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.305793:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758133.305803:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758133.306138:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.306152:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.306163:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.306176:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.306188:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.306195:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758133.307243:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00010000:00010000:0.0:1782758133.307256:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307265:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307272:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307279:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758133.307284:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307292:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307305:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758133.307309:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758133.307313:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.307319:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758133.307340:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063fc5166 reply state 00000000798bff96 transno 4294967643 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758133.307349:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758133.307442:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49818:x1869355196741120:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1751us (1990us total) trans 4294967643 rc 0/0 00000100:00100000:0.0:1782758133.307451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 893 00010000:00010000:0.0:1782758133.309722:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309738:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309745:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309752:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758133.309756:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309764:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309779:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758133.309782:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758133.309787:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.309794:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa53 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758133.372097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758133.372203:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741248 00000100:00100000:0.0:1782758133.372212:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741248 00000100:00100000:0.0:1782758133.372286:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 894 00000100:00100000:0.0:1782758133.372297:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49822:x1869355196741248:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782758133.372322:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758133.372346:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64aad expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372413:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372427:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372439:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758133.372503:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758133.372507:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758133.372531:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372554:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777daa5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aad expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372573:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aad expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758133.372582:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758133.372587:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758133.372591:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758133.372652:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49822:x1869355196741248:12345-192.168.204.31@tcp:101:chown.0 Request processed in 356us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758133.372660:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 894 00000100:00100000:2.0:1782758133.375907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758133.376051:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741376 00000100:00100000:1.0:1782758133.376061:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741376 00000100:00100000:1.0:1782758133.376125:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 895 00000100:00100000:1.0:1782758133.376136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49822:x1869355196741376:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782758133.376156:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758133.376175:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daa68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ab4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376231:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376244:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376256:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376368:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376378:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376386:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376595:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376603:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376610:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758133.376648:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00000004:00200000:1.0:1782758133.376653:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758133.376677:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376691:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376696:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376702:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376708:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758133.376712:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376719:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376730:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:1.0:1782758133.376733:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758133.376737:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376743:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daa6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376756:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376762:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376772:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376776:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758133.376779:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376785:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376794:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758133.376796:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758133.376799:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.376804:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daa76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.377542:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daa68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ab4 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.377562:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ab4 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.377570:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758133.377573:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758133.377575:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782758133.377645:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49822:x1869355196741376:12345-192.168.204.31@tcp:101:chown.0 Request processed in 1511us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758133.377657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 895 00000100:00100000:3.0:1782758133.381705:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758133.383362:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741632 00000100:00100000:1.0:1782758133.383373:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741632 00000100:00100000:1.0:1782758133.383598:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 896 00000100:00100000:1.0:1782758133.383608:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49822:x1869355196741632:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782758133.383665:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758133.383692:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daa7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ab4 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.383712:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758133.383731:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758133.383754:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.383766:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758133.383775:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758133.411002:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967643 is committed 00000001:00080000:3.0:1782758133.411021:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967644 is committed 00000004:00010000:1.0:1782758133.411742:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000239ee43a reply state 000000001d709b4f transno 4294967644 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758133.411758:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758133.411974:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00080000:1.0:1782758133.412068:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758133.412141:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49822:x1869355196741632:12345-192.168.204.31@tcp:36:chown.0 Request processed in 28529us (30438us total) trans 4294967644 rc 0/0 00000100:00100000:1.0:1782758133.412150:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 896 00010000:00010000:3.0:1782758133.412981:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.412994:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.413001:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.413007:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758133.413011:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.413018:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.413033:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:3.0:1782758133.413037:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758133.413043:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758133.413049:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daa84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758133.677067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758133.677097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211588608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758133.677163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758133.677265:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588608 00000100:00100000:0.0:1782758133.677273:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588608 00000100:00100000:0.0:1782758133.677332:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1782758133.677342:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211588608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758133.677376:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758133.677419:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211588608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758133.677425:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00080000:1.0:1782758133.677574:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758133.677609:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211588608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758134.321950:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758134.419059:0:84635:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd63850210 20000000:00000080:3.0:1782758134.419092:0:84635:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d65c00 uarg=0000000000000000 00010000:00010000:3.0:1782758134.419728:0:84635:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758134.419762:0:84635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:3.0:1782758134.419766:0:84635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758134.419777:0:84635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daa61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aad expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.419798:0:84635:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758134.419815:0:84635:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758134.419859:0:84635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.419873:0:84635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.419881:0:84635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.419919:0:84635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.419935:0:84635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 18 pid: 5796 timeout: 2302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758134.419951:0:84635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84635:1869355211588736:0@lo:104: 00000100:00100000:3.0:1782758134.420017:0:84635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758134.420085:0:84635:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782758134.420126:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588736 00000100:00100000:1.0:1782758134.420134:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588736 00000100:00100000:1.0:1782758134.420185:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782758134.420194:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:84635:x1869355211588736:12345-0@lo:104: 00010000:00010000:1.0:1782758134.420207:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758134.420275:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758134.420282:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:84635:x1869355211588736:12345-0@lo:104: Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758134.420291:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1782758134.420294:0:84635:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84635:1869355211588736:0@lo:104: 00010000:00010000:3.0:1782758134.420317:0:84635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.420737:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758134.420745:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.420754:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758134.420758:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.420767:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758134.420786:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758134.420793:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758134.420853:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.420861:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758134.420891:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.420899:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777daa1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daa22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758134.420908:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1782758134.420916:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758134.420920:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758134.420923:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211588864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758134.420923:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758134.420958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758134.421141:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588864 00000100:00100000:0.0:1782758134.421147:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588864 00010000:00010000:0.0:1782758134.421170:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 2302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758134.421203:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782758134.421211:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211588864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758134.421222:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758134.421228:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 2302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421237:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 2302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421251:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777daa22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daa1b expref: 19 pid: 5796 timeout: 2302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421266:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421278:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421291:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421297:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421303:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421309:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421314:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758134.421318:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421325:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421341:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758134.421351:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758134.421367:0:84635:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.421377:0:84635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758134.421384:0:84635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daa8b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758134.421401:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211588864:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758134.421410:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1782758134.421526:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211588864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758134.964949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758134.964988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758134.965016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758134.965040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758134.965083:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742016 00000100:00100000:3.0:1782758134.965093:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742016 00000100:00100000:3.0:1782758134.965157:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742144 00000100:00100000:3.0:1782758134.965160:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742144 00000100:00100000:3.0:1782758134.965185:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:3.0:1782758134.965195:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758134.965268:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758134.965277:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:3.0:1782758134.965307:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1184 00000100:00100000:3.0:1782758134.965315:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758134.965341:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758134.965347:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1184 00000100:00100000:3.0:1782758134.965367:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741888 00000100:00100000:3.0:1782758134.965371:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741888 00000100:00100000:3.0:1782758134.965397:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1558 00000100:00100000:3.0:1782758134.965416:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196741888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758134.965450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196741888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758134.965468:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1558 00000100:00080000:3.0:1782758134.965490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758134.965495:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758134.965849:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196741760 00000100:00100000:1.0:1782758134.965854:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196741760 00000100:00100000:1.0:1782758134.965896:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1233 00000100:00100000:1.0:1782758134.965904:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196741760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758134.965937:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196741760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758134.965944:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1233 00010000:00010000:1.0:1782758135.346372:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758135.727722:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211589120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.727787:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.727860:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211589632:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.727889:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.727914:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758135.727920:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211588992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.727946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.727970:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211589504:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.727993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.728017:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211589248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.728038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.728071:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758135.728077:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211589376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.728099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758135.728134:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589120 00000100:00100000:0.0:1782758135.728141:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589120 00000100:00100000:0.0:1782758135.728181:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589504 00000100:00100000:0.0:1782758135.728184:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589504 00000100:00100000:0.0:1782758135.728208:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589248 00000100:00100000:0.0:1782758135.728211:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589248 00000100:00100000:0.0:1782758135.728228:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1782758135.728235:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211589120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.728300:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211589120:12345-0@lo:400:kworker.0 Request processed in 64us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.728307:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1782758135.728323:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1782758135.728330:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211589504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.728373:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211589504:12345-0@lo:400:kworker.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.728380:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1782758135.729553:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:0.0:1782758135.729564:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.729617:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211589248:12345-0@lo:400:kworker.0 Request processed in 56us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.729624:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:0.0:1782758135.729649:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589632 00000100:00100000:0.0:1782758135.729654:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589632 00000100:00100000:0.0:1782758135.729695:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589376 00000100:00100000:0.0:1782758135.729698:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589376 00000100:00100000:0.0:1782758135.729720:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1782758135.729726:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211589632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.729759:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211589632:12345-0@lo:400:kworker.0 Request processed in 33us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.729765:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1782758135.729775:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1782758135.729781:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211589376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.729809:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211589376:12345-0@lo:400:kworker.0 Request processed in 28us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.729814:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1782758135.729852:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211588992 00000100:00100000:0.0:1782758135.729856:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211588992 00000100:00100000:0.0:1782758135.729884:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1782758135.729891:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211588992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.729924:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211588992:12345-0@lo:400:kworker.0 Request processed in 34us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758135.729930:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00080000:0.0:1782758135.729968:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758135.729973:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758135.729976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758135.730013:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211589376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.730026:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211589248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.730078:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211588992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.730089:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211589504:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.730099:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211589120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758135.730108:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211589632:0@lo:400:kworker.0 00000020:00000080:1.0:1782758135.818426:0:84684:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6acd8260 20000000:00000080:1.0:1782758135.818441:0:84684:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917187966800 uarg=0000000000000000 00010000:00010000:1.0:1782758135.819037:0:84684:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758135.819061:0:84684:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758135.819073:0:84684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758135.819091:0:84684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819164:0:84684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819176:0:84684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819183:0:84684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819189:0:84684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819195:0:84684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819201:0:84684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758135.819204:0:84684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819211:0:84684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819223:0:84684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819229:0:84684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758135.819236:0:84684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777daa92 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758136.044065:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758136.044074:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758136.044080:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758136.044128:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758136.044141:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758136.044153:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758136.044186:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211589760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758136.044257:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758136.045090:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782758136.045192:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589760 00000100:00100000:0.0:1782758136.045201:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589760 00000100:00100000:0.0:1782758136.045294:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1782758136.045304:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211589760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758136.045319:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758136.045335:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daa99 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758136.045359:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758136.045369:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758136.045382:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758136.045547:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211589760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758136.045554:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1782758136.045695:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211589760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758136.045711:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758136.045720:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758136.045739:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758136.045744:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758136.045751:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758136.236084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758136.236118:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211589888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758136.236195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758136.236298:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211589888 00000100:00100000:2.0:1782758136.236306:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211589888 00000100:00100000:2.0:1782758136.236368:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1782758136.236377:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211589888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758136.236412:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758136.236461:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211589888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758136.236468:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1782758136.236711:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211589888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758136.371883:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758137.388078:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758138.414517:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758138.798411:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211590016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758138.798517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758138.798613:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590016 00000100:00100000:1.0:1782758138.798622:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590016 00000100:00100000:1.0:1782758138.798687:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1782758138.798696:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211590016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758138.798742:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758138.798794:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211590016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758138.798801:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:1.0:1782758138.798846:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758138.798887:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211590016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758139.436024:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758140.113458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758140.113501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758140.113538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758140.113574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758140.113690:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742272 00000100:00100000:0.0:1782758140.113699:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742272 00000100:00100000:0.0:1782758140.113755:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1236 00000100:00100000:0.0:1782758140.113765:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196742272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758140.113857:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196742272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.113864:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1236 00000100:00100000:0.0:1782758140.113893:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742528 00000100:00100000:0.0:1782758140.113896:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742528 00000100:00100000:0.0:1782758140.113923:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742656 00000100:00100000:0.0:1782758140.113925:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742656 00000100:00100000:0.0:1782758140.113940:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1187 00000100:00100000:0.0:1782758140.113946:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758140.113985:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196742528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.113991:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1187 00000100:00100000:0.0:1782758140.114002:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1188 00000100:00100000:0.0:1782758140.114007:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196742656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758140.114090:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196742656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.114097:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1188 00000100:00100000:1.0:1782758140.114401:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742400 00000100:00100000:1.0:1782758140.114406:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742400 00000100:00100000:1.0:1782758140.114437:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1562 00000100:00100000:1.0:1782758140.114443:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196742400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758140.114479:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196742400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758140.114486:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1562 00000100:00080000:1.0:1782758140.114507:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758140.114511:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758140.114513:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758140.157930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758140.158234:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742784 00000100:00100000:2.0:1782758140.158245:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742784 00000100:00100000:2.0:1782758140.158380:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1782758140.158391:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5584:x1869355196742784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758140.158409:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758140.158412:0:5785:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777daa61) 00010000:00010000:2.0:1782758140.158414:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758140.159095:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5584:x1869355196742784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 703us (1173us total) trans 0 rc 116/116 00000100:00100000:2.0:1782758140.159104:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00010000:00010000:3.0:1782758140.460078:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758140.844033:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211590400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.844098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758140.844150:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758140.844155:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211590528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.844175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758140.844206:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590400 00000100:00100000:0.0:1782758140.844211:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590400 00000100:00100000:0.0:1782758140.844276:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1782758140.844284:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211590400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.844328:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211590400:12345-0@lo:400:kworker.0 Request processed in 45us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.844335:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1782758140.844355:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590528 00000100:00100000:0.0:1782758140.844358:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590528 00000100:00100000:0.0:1782758140.844380:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1782758140.844385:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211590528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.844410:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211590528:12345-0@lo:400:kworker.0 Request processed in 25us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.844415:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:0.0:1782758140.844427:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758140.844430:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758140.844479:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211590528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.844489:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211590400:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.844767:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211590144:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.844798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758140.844847:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211590656:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.844867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758140.844882:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758140.844887:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211590272:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.844903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758140.844922:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211590784:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.844959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758140.844989:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590784 00000100:00100000:2.0:1782758140.844994:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590784 00000100:00100000:2.0:1782758140.845025:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1782758140.845030:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211590784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.845064:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211590784:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758140.845069:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1782758140.845106:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211590784:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.845136:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590656 00000100:00100000:2.0:1782758140.845139:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590656 00000100:00100000:2.0:1782758140.845158:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590272 00000100:00100000:2.0:1782758140.845161:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590272 00000100:00100000:2.0:1782758140.845172:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1782758140.845178:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211590656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.845207:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211590656:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758140.845213:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1782758140.845224:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1782758140.845229:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211590272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.845251:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211590272:12345-0@lo:400:kworker.0 Request processed in 22us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758140.845257:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1782758140.845289:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211590272:0@lo:400:kworker.0 00000100:00100000:2.0:1782758140.845298:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211590656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.846452:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590144 00000100:00100000:0.0:1782758140.846461:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590144 00000100:00100000:0.0:1782758140.846526:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1782758140.846534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758140.846604:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211590144:12345-0@lo:400:kworker.0 Request processed in 70us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758140.846611:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00080000:0.0:1782758140.846647:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758140.846652:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758140.846785:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211590144:0@lo:400:kworker.0 00000100:00100000:2.0:1782758141.375985:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211590912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758141.376130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758141.376259:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211590912 00000100:00100000:1.0:1782758141.376267:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211590912 00000100:00100000:1.0:1782758141.376318:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1782758141.376328:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211590912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758141.376366:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758141.376417:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211590912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758141.376424:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1782758141.376470:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211590912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758141.495751:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758141.757513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758141.757649:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196742912 00000100:00100000:0.0:1782758141.757662:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196742912 00000100:00100000:0.0:1782758141.757736:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 897 00000100:00100000:0.0:1782758141.757747:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:49928:x1869355196742912:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758141.757776:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758141.757806:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777daaa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64abb expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.757922:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.757947:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.757963:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758141.758239:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758141.758244:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758141.758333:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.758367:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777daaa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64abb expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.758387:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64abb expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758141.758396:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758141.758399:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758141.758403:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758141.758497:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49928:x1869355196742912:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 751us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758141.758505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 897 00000100:00100000:0.0:1782758141.763515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758141.764198:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196743040 00000100:00100000:2.0:1782758141.764211:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196743040 00000100:00100000:2.0:1782758141.764288:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 898 00000100:00100000:2.0:1782758141.764302:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49928:x1869355196743040:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758141.764330:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758141.764354:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777daab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ac2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764435:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764464:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764478:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764496:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764503:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764509:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.764998:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765009:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765017:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758141.765123:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1782758141.765128:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758141.765200:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765216:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765223:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765230:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765236:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758141.765241:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765249:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765263:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:2.0:1782758141.765268:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758141.765273:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765280:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777daabc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765292:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765298:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765304:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765310:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758141.765313:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765319:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765325:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917182dd1f00) 00010000:00010000:2.0:1782758141.765327:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758141.765330:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765335:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765384:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777daab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac2 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765403:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac2 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.765411:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782758141.765414:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758141.765416:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758141.765495:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49928:x1869355196743040:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1196us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758141.765503:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 898 00000100:00100000:0.0:1782758141.770499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758141.770603:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196743296 00000100:00100000:1.0:1782758141.770617:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196743296 00000100:00100000:1.0:1782758141.770696:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 899 00000100:00100000:1.0:1782758141.770709:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49928:x1869355196743296:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758141.770790:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758141.770856:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777daaca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac2 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.770881:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758141.770907:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758141.770952:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.770972:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.770983:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758141.823618:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004176ce44 reply state 000000007e2e9ef6 transno 4294967645 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758141.823645:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758141.823933:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:1.0:1782758141.824105:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49928:x1869355196743296:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 53390us (53614us total) trans 4294967645 rc 0/0 00000100:00100000:1.0:1782758141.824117:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 899 00000001:00080000:1.0:1782758141.824195:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967645 is committed 00010000:00010000:3.0:1782758141.829248:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829275:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829284:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829292:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758141.829299:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829309:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829334:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:3.0:1782758141.829339:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758141.829346:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.829353:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daad1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758141.951447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758141.951581:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196743424 00000100:00100000:1.0:1782758141.951677:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196743424 00000100:00100000:1.0:1782758141.951762:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 900 00000100:00100000:1.0:1782758141.951776:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49932:x1869355196743424:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758141.952550:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758141.952580:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ac9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952705:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952723:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952740:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952756:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952763:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.952768:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953381:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953392:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953399:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758141.953474:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1782758141.953478:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758141.953550:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953566:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953574:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953586:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953726:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758141.953734:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953744:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953761:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:1.0:1782758141.953764:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758141.953770:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953776:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daadf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953794:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953800:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953807:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953812:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758141.953815:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953856:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953865:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3a200) 00010000:00010000:1.0:1782758141.953867:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758141.953870:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953876:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777daae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953931:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777daad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac9 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953949:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac9 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.953956:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758141.953958:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758141.953960:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758141.954069:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49932:x1869355196743424:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2295us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758141.954079:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 900 00000100:00100000:0.0:1782758141.962154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758141.962275:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196743680 00000100:00100000:2.0:1782758141.962290:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196743680 00000100:00100000:2.0:1782758141.962380:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 901 00000100:00100000:2.0:1782758141.962395:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49932:x1869355196743680:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758141.962428:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758141.962459:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777daaf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ad0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.962959:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.962981:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.962997:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.965453:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.965482:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.965496:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758141.970949:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:2.0:1782758141.972753:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dab09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972776:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dab09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972789:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dab09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972860:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972868:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972875:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972882:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758141.972886:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972894:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972912:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758141.972915:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758141.972931:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.972938:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777daafb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758141.972958:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4c5279c reply state 0000000055fd8f59 transno 4294967646 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758141.972968:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758141.973020:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777daaf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad0 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.973036:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dab09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad0 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758141.973043:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782758141.973046:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758141.973049:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758141.973149:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49932:x1869355196743680:12345-192.168.204.31@tcp:101:touch.0 Request processed in 10757us (11011us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1782758141.973158:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 901 00010000:00010000:3.0:1782758141.982496:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982524:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982534:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982547:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758141.982553:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982562:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982583:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1f00) 00010000:00010000:3.0:1782758141.982587:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758141.982591:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.982598:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dab02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758141.982879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758141.983098:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196743936 00000100:00100000:1.0:1782758141.983112:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196743936 00000100:00100000:1.0:1782758141.983192:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 902 00000100:00100000:1.0:1782758141.983205:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49932:x1869355196743936:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782758141.983281:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758141.983301:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dab09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad0 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.983313:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff917182dd1000) 00010000:00010000:1.0:1782758141.983320:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758141.983367:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.983381:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.983391:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758141.983538:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1d2a71b reply state 000000006a54bf97 transno 4294967647 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758141.983548:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758141.983643:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49932:x1869355196743936:12345-192.168.204.31@tcp:36:touch.0 Request processed in 440us (769us total) trans 4294967647 rc 0/0 00000100:00100000:1.0:1782758141.983650:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 902 00010000:00010000:3.0:1782758141.988095:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988118:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988126:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988133:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758141.988139:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988148:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988174:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9171a0e3a200) 00010000:00010000:3.0:1782758141.988178:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758141.988183:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758141.988191:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dab17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758141.989398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758141.989479:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744064 00000100:00100000:1.0:1782758141.989491:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744064 00000100:00100000:1.0:1782758141.989557:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 903 00000100:00100000:1.0:1782758141.989569:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49932:x1869355196744064:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758141.989596:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758141.989618:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dab1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ad7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.989695:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dab1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad7 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.989711:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dab1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad7 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758141.989735:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782758141.989738:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758141.989741:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758141.989813:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49932:x1869355196744064:12345-192.168.204.31@tcp:101:touch.0 Request processed in 246us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758141.989858:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 903 00000100:00100000:0.0:1782758142.005782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758142.005912:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744192 00000100:00100000:2.0:1782758142.005935:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744192 00000100:00100000:2.0:1782758142.006012:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 493 00000100:00100000:2.0:1782758142.006023:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196744192:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:2.0:1782758142.006584:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196744192:12345-192.168.204.31@tcp:2:touch.0 Request processed in 561us (811us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1782758142.006594:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 493 00000100:00080000:0.0:1782758142.009537:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758142.011436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758142.011642:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744448 00000100:00100000:2.0:1782758142.011653:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744448 00000100:00100000:2.0:1782758142.011741:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00100000:2.0:1782758142.011759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49932:x1869355196744448:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:2.0:1782758142.012207:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49932:x1869355196744448:12345-192.168.204.31@tcp:35:touch.0 Request processed in 450us (787us total) trans 4294967648 rc 0/0 00000100:00100000:2.0:1782758142.012218:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00080000:0.0:1782758142.012936:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758142.119723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758142.119874:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744576 00000100:00100000:2.0:1782758142.119886:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744576 00000100:00100000:2.0:1782758142.119959:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 904 00000100:00100000:2.0:1782758142.119971:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49936:x1869355196744576:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758142.120000:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758142.120022:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ade expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120084:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120099:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120112:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120128:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120136:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120143:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120260:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120269:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120276:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758142.120312:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 0 00000004:00200000:2.0:1782758142.120316:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758142.120338:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120350:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120358:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120364:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120370:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120381:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758142.120386:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120393:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120405:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758142.120408:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758142.120413:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120418:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120431:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120437:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120442:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120446:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758142.120448:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120454:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120464:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1900) 00010000:00010000:2.0:1782758142.120467:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758142.120469:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120474:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120504:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ade expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120517:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ade expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.120525:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:2.0:1782758142.120527:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758142.120529:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758142.120603:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49936:x1869355196744576:12345-192.168.204.31@tcp:101:rm.0 Request processed in 635us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758142.120610:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 904 00000100:00100000:3.0:1782758142.127057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758142.128024:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744704 00000100:00100000:2.0:1782758142.128039:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744704 00000100:00100000:2.0:1782758142.128101:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 494 00000100:00100000:2.0:1782758142.128112:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196744704:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758142.128131:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758142.128152:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ae5 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758142.128188:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x6a42bafd, atime: 0x6a42bafd, ctime: 0x6a42bafd, blocks: 0x1 00010000:00010000:2.0:1782758142.128209:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=2210s v=(0 0) 00010000:00010000:2.0:1782758142.128214:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758142.128224:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.128244:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.128257:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782758142.128338:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196744704:12345-192.168.204.31@tcp:101:rm.0 Request processed in 228us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758142.128346:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 494 00000100:00100000:3.0:1782758142.132631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758142.132737:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196744960 00000100:00100000:2.0:1782758142.132747:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196744960 00000100:00100000:2.0:1782758142.132807:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 905 00000100:00100000:2.0:1782758142.132817:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49936:x1869355196744960:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782758142.132902:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758142.132941:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dab3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ade expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.132964:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dab1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ad7 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.132981:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:2.0:1782758142.132992:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758142.133012:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133024:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133034:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133048:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133055:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133062:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133166:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133175:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133182:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758142.133691:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:2.0:1782758142.133702:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2210536878521ns, next at 2211536876153ns, rc = 0 00010000:00010000:2.0:1782758142.133757:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133768:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133775:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133783:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133790:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133797:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133810:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758142.133881:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133889:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133895:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133901:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758142.133906:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133913:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133935:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782758142.133938:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758142.133942:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133949:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dab56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133963:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133969:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133975:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133980:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758142.133983:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133989:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.133995:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758142.133997:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758142.134000:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758142.134006:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dab48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758142.134019:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000116be6ea reply state 00000000361f6846 transno 4294967649 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758142.134028:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758142.134098:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49936:x1869355196744960:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1280us (1475us total) trans 4294967649 rc 0/0 00000100:00100000:2.0:1782758142.134106:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 905 00010000:00010000:0.0:1782758142.134400:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758142.134407:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758142.134414:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758142.134417:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758142.134427:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758142.134437:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:0.0:1782758142.134440:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758142.134443:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758142.134448:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dab5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758142.134461:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758142.134463:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758142.134465:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758142.147284:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147303:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147310:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147316:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758142.147322:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147330:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147353:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1900) 00010000:00010000:1.0:1782758142.147356:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758142.147362:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758142.147369:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dab4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758142.510352:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758143.370807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.370919:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196745088 00000100:00100000:1.0:1782758143.370934:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196745088 00000100:00100000:1.0:1782758143.371076:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 906 00000100:00100000:1.0:1782758143.371089:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49951:x1869355196745088:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758143.371189:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758143.371758:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64aec expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.371870:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.371888:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.371916:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758143.372072:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1782758143.372077:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758143.372109:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.373412:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aec expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.373443:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aec expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.373454:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758143.373457:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758143.373552:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758143.373936:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49951:x1869355196745088:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2845us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758143.373947:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 906 00000100:00100000:3.0:1782758143.386798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.387358:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196745344 00000100:00100000:1.0:1782758143.387374:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196745344 00000100:00100000:1.0:1782758143.387499:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 907 00000100:00100000:1.0:1782758143.387513:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49951:x1869355196745344:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758143.387582:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758143.387619:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64aec expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.388791:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777daaed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ac9 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.388807:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758143.388837:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758143.388879:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.388909:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.388922:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758143.485558:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063fc5166 reply state 0000000034894ea0 transno 4294967650 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758143.485580:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758143.485745:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:1.0:1782758143.485918:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49951:x1869355196745344:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 98403us (99126us total) trans 4294967650 rc 0/0 00000100:00100000:1.0:1782758143.485928:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 907 00000001:00080000:1.0:1782758143.485979:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967650 is committed 00000004:00080000:1.0:1782758143.485993:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00010000:00010000:1.0:1782758143.486017:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486025:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486033:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486039:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.486044:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486052:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486068:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782758143.486072:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758143.486077:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486083:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758143.486333:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211591040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782758143.486387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758143.486452:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591040 00000100:00100000:1.0:1782758143.486459:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591040 00000100:00100000:1.0:1782758143.486502:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1782758143.486512:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211591040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782758143.486537:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:28 count 1 00010000:00010000:1.0:1782758143.486556:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486573:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486582:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782758143.486586:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758143.486590:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486614:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.486628:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 6 pid: 9120 timeout: 2311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758143.486641:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211591168:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758143.486676:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c66c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782758143.486687:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758143.496026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758143.496371:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211591168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758143.496405:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758143.497059:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196745472 00000100:00100000:0.0:1782758143.497068:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196745472 00010000:00010000:0.0:1782758143.497106:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 2311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758143.497144:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 388 00000100:00100000:0.0:1782758143.497155:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196745472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758143.497170:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758143.497176:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 2311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.497189:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 2311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.497228:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab1e905/0xdd99f5c4777dab41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ae5 expref: 7 pid: 9120 timeout: 2311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.497245:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758143.497249:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758143.497254:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.497264:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.497298:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758143.497351:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196745472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 198us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758143.497359:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 388 00010000:00010000:3.0:1782758143.497654:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.497664:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.497674:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.497682:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.497708:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758143.498303:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211591040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11790us (11913us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782758143.498313:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000004:00080000:3.0:1782758143.498363:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082208380/2, rc 0, transno 4294967353 00000100:00100000:3.0:1782758143.498370:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211591040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782758143.498535:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758143.498542:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.498551:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758143.498555:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.498565:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.498589:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.498597:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777dab79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758143.498614:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758143.498616:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758143.498617:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758143.532097:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758143.545760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.545967:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196745600 00000100:00100000:1.0:1782758143.545983:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196745600 00000100:00100000:1.0:1782758143.546121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 908 00000100:00100000:1.0:1782758143.546132:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49955:x1869355196745600:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758143.546158:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758143.546178:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64af3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546234:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546248:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546259:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546273:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546280:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546289:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546725:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546734:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.546742:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758143.546922:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1782758143.546927:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758143.547006:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547019:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547025:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547032:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547038:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.547042:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547049:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547062:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:1.0:1782758143.547064:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.547069:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547075:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dab87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547086:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547091:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547096:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547101:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.547103:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547108:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547115:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9171a0e3a700) 00010000:00010000:1.0:1782758143.547116:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.547119:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547125:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dab8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547159:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dab80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64af3 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547172:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64af3 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.547179:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758143.547181:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758143.547183:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782758143.547255:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49955:x1869355196745600:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1124us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758143.547263:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 908 00000100:00100000:0.0:1782758143.553700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758143.555096:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196745856 00000100:00100000:2.0:1782758143.555115:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196745856 00000100:00100000:2.0:1782758143.555199:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 909 00000100:00100000:2.0:1782758143.555210:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49955:x1869355196745856:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758143.555232:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758143.555256:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dab9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64afa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555571:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555586:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555597:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555615:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555622:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.555627:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758143.556545:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:2.0:1782758143.559217:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dabb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559242:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dabb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559255:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dabb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559307:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559320:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559326:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559333:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758143.559337:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559349:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559365:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758143.559369:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758143.559373:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559382:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777daba3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758143.559398:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e41bbff8 reply state 00000000c1b67cf3 transno 4294967651 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758143.559408:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758143.559447:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dab9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64afa expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559461:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dabb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64afa expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.559469:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff917182dd1100) 00010000:00010000:2.0:1782758143.559472:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758143.559474:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758143.559633:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49955:x1869355196745856:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4424us (5949us total) trans 4294967651 rc 0/0 00000100:00100000:2.0:1782758143.559642:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 909 00010000:00010000:1.0:1782758143.571236:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571254:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571262:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571268:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.571273:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571281:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571297:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1500) 00010000:00010000:1.0:1782758143.571302:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.571307:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.571313:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dabaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758143.585659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.585761:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746112 00000100:00100000:1.0:1782758143.585770:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746112 00000100:00100000:1.0:1782758143.585868:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 910 00000100:00100000:1.0:1782758143.585877:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49955:x1869355196746112:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782758143.585946:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758143.585972:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dabb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64afa expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.585992:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff917182dd1100) 00010000:00010000:1.0:1782758143.586013:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758143.586056:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.586069:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.586078:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758143.586216:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed373df3 reply state 00000000b6ab23da transno 4294967652 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758143.586227:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758143.586312:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49955:x1869355196746112:12345-192.168.204.31@tcp:36:touch.0 Request processed in 436us (662us total) trans 4294967652 rc 0/0 00000100:00100000:1.0:1782758143.586319:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 910 00010000:00010000:1.0:1782758143.594927:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594945:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594952:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594958:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.594963:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594969:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594985:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782758143.594988:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.594993:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.594999:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dabbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758143.600191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.600274:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746240 00000100:00100000:1.0:1782758143.600283:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746240 00000100:00100000:1.0:1782758143.600337:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 911 00000100:00100000:1.0:1782758143.600346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49955:x1869355196746240:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758143.600372:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758143.600394:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dabc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b01 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.600451:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dabc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b01 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.600466:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dabc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b01 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.600484:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782758143.600487:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758143.600490:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758143.600549:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49955:x1869355196746240:12345-192.168.204.31@tcp:101:touch.0 Request processed in 204us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758143.600555:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 911 00000100:00100000:3.0:1782758143.603804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758143.603956:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746368 00000100:00100000:2.0:1782758143.603970:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746368 00000100:00100000:2.0:1782758143.604062:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 496 00000100:00100000:2.0:1782758143.604076:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196746368:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:1.0:1782758143.604309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758143.605120:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196746368:12345-192.168.204.31@tcp:2:touch.0 Request processed in 1041us (1324us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1782758143.605133:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 496 00000100:00100000:3.0:1782758143.611077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.611269:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746624 00000100:00100000:1.0:1782758143.611283:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746624 00000100:00100000:1.0:1782758143.611360:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:1.0:1782758143.611372:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:49955:x1869355196746624:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782758143.611901:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49955:x1869355196746624:12345-192.168.204.31@tcp:35:touch.0 Request processed in 520us (827us total) trans 4294967653 rc 0/0 00000100:00100000:1.0:1782758143.611911:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:0.0:1782758143.679414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758143.679531:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746752 00000100:00100000:2.0:1782758143.679545:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746752 00000100:00100000:2.0:1782758143.679620:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 912 00000100:00100000:2.0:1782758143.679632:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49959:x1869355196746752:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758143.679665:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758143.679692:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dabcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b08 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.679772:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.679790:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.679803:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.679819:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680003:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680012:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680152:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680162:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680170:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758143.680215:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00000004:00200000:2.0:1782758143.680221:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758143.680246:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.680259:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681082:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681091:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681099:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681106:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758143.681110:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681119:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681137:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758143.681140:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758143.681146:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681153:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dabd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681169:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681176:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681183:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681189:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758143.681192:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681198:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681218:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1700) 00010000:00010000:2.0:1782758143.681220:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758143.681224:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.681230:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dabdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.682170:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dabcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b08 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.682193:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b08 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758143.682355:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:2.0:1782758143.682358:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758143.682361:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758143.682526:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49959:x1869355196746752:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2894us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758143.682537:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 912 00000100:00100000:3.0:1782758143.691868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.692086:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196746880 00000100:00100000:1.0:1782758143.692101:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196746880 00000100:00100000:1.0:1782758143.692180:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 497 00000100:00100000:1.0:1782758143.692195:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196746880:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758143.692233:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758143.692260:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b0f expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758143.692295:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x6a42bafe, atime: 0x6a42bafe, ctime: 0x6a42bafe, blocks: 0x1 00010000:00010000:1.0:1782758143.692320:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2212s v=(0 0) 00010000:00010000:1.0:1782758143.692325:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758143.692337:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.692360:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.692376:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758143.692443:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196746880:12345-192.168.204.31@tcp:101:rm.0 Request processed in 251us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758143.692451:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 497 00000100:00100000:0.0:1782758143.698776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758143.699134:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747136 00000100:00100000:1.0:1782758143.699150:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747136 00000100:00100000:1.0:1782758143.699338:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 913 00000100:00100000:1.0:1782758143.699362:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49959:x1869355196747136:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:1.0:1782758143.699442:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758143.699482:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dabe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b08 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699517:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dabc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b01 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699528:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782758143.699542:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758143.699570:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699586:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699597:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699611:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699617:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.699623:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.700190:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.700395:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.700406:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782758143.707764:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:1.0:1782758143.707784:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2212110960544ns, next at 2213110956719ns, rc = 0 00010000:00010000:1.0:1782758143.711744:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711775:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711789:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711800:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711807:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711814:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711867:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758143.711925:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711932:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711938:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711946:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.711952:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711960:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711976:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:1.0:1782758143.711980:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758143.711986:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.711993:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dabfe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712020:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712027:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712032:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712038:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.712041:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712047:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712056:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758143.712058:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.712062:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.712067:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dabf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758143.712078:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000609943b3 reply state 0000000088600e07 transno 4294967654 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758143.712088:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758143.715710:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758143.715730:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.715743:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758143.715748:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.715762:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.715786:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:3.0:1782758143.715790:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758143.715795:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.715801:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dac05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758143.715868:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758143.715870:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758143.715872:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758143.716014:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49959:x1869355196747136:12345-192.168.204.31@tcp:36:rm.0 Request processed in 12844us (13442us total) trans 4294967654 rc 0/0 00000100:00100000:1.0:1782758143.716028:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 913 00010000:00010000:1.0:1782758143.719708:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719735:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719745:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719753:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758143.719759:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719770:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719807:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758143.719811:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758143.719817:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758143.719859:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dabf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758143.917753:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211591296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758143.917880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758143.923253:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591296 00000100:00100000:2.0:1782758143.923276:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591296 00000100:00100000:2.0:1782758143.923410:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1782758143.923423:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211591296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758143.923479:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758143.923603:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211591296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758143.923612:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1782758143.923784:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211591296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758143.924497:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758144.556226:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758145.159424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.160383:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747264 00000100:00100000:2.0:1782758145.160399:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747264 00000100:00100000:2.0:1782758145.160498:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 914 00000100:00100000:2.0:1782758145.160511:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49973:x1869355196747264:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758145.160545:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758145.160572:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dac0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b16 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.160655:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.160673:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.160689:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782758145.160982:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782758145.161598:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1782758145.161605:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758145.161639:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.161678:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dac0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b16 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.161704:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b16 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.161715:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758145.161727:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758145.161731:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758145.163565:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49973:x1869355196747264:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 3044us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.163581:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 914 00000100:00100000:0.0:1782758145.177165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.177389:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747520 00000100:00100000:2.0:1782758145.177404:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747520 00000100:00100000:2.0:1782758145.177481:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 915 00000100:00100000:2.0:1782758145.177494:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49973:x1869355196747520:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758145.177574:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758145.177613:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dac13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b16 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.177638:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dab95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64af3 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.177651:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:2.0:1782758145.177664:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758145.177697:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.177712:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.177722:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758145.178089:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb57834b reply state 00000000fcd1f944 transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758145.178101:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758145.178119:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:2.0:1782758145.178492:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49973:x1869355196747520:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 998us (1341us total) trans 4294967655 rc 0/0 00000100:00100000:2.0:1782758145.178502:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 915 00010000:00010000:1.0:1782758145.182258:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182283:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182292:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182300:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758145.182307:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182316:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182338:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782758145.182342:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758145.182348:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.182354:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dac1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758145.216506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.216547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.216574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.216607:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747904 00000100:00100000:1.0:1782758145.216620:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747904 00000100:00100000:1.0:1782758145.216694:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747776 00000100:00100000:1.0:1782758145.216698:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747776 00000100:00100000:1.0:1782758145.216988:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00100000:1.0:1782758145.217001:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196747904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758145.217104:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196747904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 106us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.217113:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00100000:1.0:1782758145.217138:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1192 00000100:00100000:1.0:1782758145.217144:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196747776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758145.217563:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196747648 00000100:00100000:3.0:1782758145.217570:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196747648 00000100:00100000:3.0:1782758145.217621:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00100000:3.0:1782758145.217629:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196747648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758145.217660:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196747648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758145.217666:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00100000:1.0:1782758145.219061:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196747776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.219075:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1192 00000100:00080000:1.0:1782758145.219121:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758145.219128:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758145.328059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.328172:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748032 00000100:00100000:2.0:1782758145.328242:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748032 00000100:00100000:2.0:1782758145.328325:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 916 00000100:00100000:2.0:1782758145.328337:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748032:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758145.328571:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748032:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 234us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.328581:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 916 00000100:00100000:0.0:1782758145.331108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.331303:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748160 00000100:00100000:2.0:1782758145.331314:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748160 00000100:00100000:2.0:1782758145.331374:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 498 00000100:00100000:2.0:1782758145.331384:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49985:x1869355196748160:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758145.331798:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49985:x1869355196748160:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 413us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.331808:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 498 00000100:00100000:0.0:1782758145.335573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.336389:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748288 00000100:00100000:1.0:1782758145.336404:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748288 00000100:00100000:0.0:1782758145.336527:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 499 00000100:00100000:0.0:1782758145.336539:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49985:x1869355196748288:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758145.337110:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49985:x1869355196748288:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 571us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758145.337121:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 499 00000100:00100000:3.0:1782758145.339363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.339424:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748416 00000100:00100000:2.0:1782758145.339436:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748416 00000100:00100000:2.0:1782758145.339500:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 917 00000100:00100000:2.0:1782758145.339511:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748416:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758145.340229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748416:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 717us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.340239:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 917 00000100:00100000:3.0:1782758145.343955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.344010:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748544 00000100:00100000:2.0:1782758145.344023:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748544 00000100:00100000:2.0:1782758145.344361:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:2.0:1782758145.344374:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748544:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758145.344759:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748544:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 386us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.344773:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:0.0:1782758145.349054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.349218:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748672 00000100:00100000:2.0:1782758145.349231:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748672 00000100:00100000:2.0:1782758145.349344:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 500 00000100:00100000:2.0:1782758145.349357:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49985:x1869355196748672:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758145.350220:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49985:x1869355196748672:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 861us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758145.350232:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 500 00000100:00100000:3.0:1782758145.353757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.353983:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748800 00000100:00100000:1.0:1782758145.353997:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748800 00000100:00100000:2.0:1782758145.354183:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 501 00000100:00100000:2.0:1782758145.354198:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49985:x1869355196748800:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758145.354696:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49985:x1869355196748800:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 500us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.354706:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 501 00000100:00100000:0.0:1782758145.357195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.357281:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196748928 00000100:00100000:1.0:1782758145.357293:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196748928 00000100:00100000:1.0:1782758145.357359:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 919 00000100:00100000:1.0:1782758145.357371:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748928:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758145.358584:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49985:x1869355196748928:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1208us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.358602:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 919 00000100:00100000:2.0:1782758145.426795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758145.426924:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749056 00000100:00100000:0.0:1782758145.426938:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749056 00000100:00100000:0.0:1782758145.427024:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 920 00000100:00100000:0.0:1782758145.427037:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49989:x1869355196749056:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782758145.427065:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758145.427091:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dac21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b1d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427415:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427435:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427460:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427477:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427485:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427492:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427988:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.427999:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428510:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758145.428567:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758145.428572:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758145.428604:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428618:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428624:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428631:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428638:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758145.428642:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428651:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428668:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758145.428672:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758145.428677:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428689:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dac28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428707:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428713:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428719:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428724:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758145.428728:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428734:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428741:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff91718bcfdf00) 00010000:00010000:0.0:1782758145.428744:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758145.428748:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428753:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dac2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428794:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dac21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b1d expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428811:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b1d expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.428876:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758145.428880:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758145.428883:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782758145.429111:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49989:x1869355196749056:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2075us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758145.429121:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 920 00000100:00100000:3.0:1782758145.435432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.436481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749312 00000100:00100000:2.0:1782758145.436562:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749312 00000100:00100000:2.0:1782758145.436658:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 921 00000100:00100000:2.0:1782758145.436671:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:49989:x1869355196749312:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782758145.436702:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758145.436729:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dac3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b24 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.436960:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.436980:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.436993:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.437012:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.437020:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.437027:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758145.439010:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1782758145.439744:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dac52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439765:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dac52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439779:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dac52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439949:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439958:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439966:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439972:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758145.439977:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.439989:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.440005:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:2.0:1782758145.440009:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758145.440014:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.440021:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dac44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758145.440036:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc296ceb reply state 000000008221afa5 transno 4294967656 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758145.440047:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758145.440162:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dac3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b24 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.440608:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dac52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b24 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.440620:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782758145.440623:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758145.440626:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758145.440936:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+15:49989:x1869355196749312:12345-192.168.204.31@tcp:101:dd.0 Request processed in 4264us (5518us total) trans 4294967656 rc 0/0 00000100:00100000:2.0:1782758145.440947:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 921 00010000:00010000:1.0:1782758145.449339:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449357:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449366:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449372:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758145.449377:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449384:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449403:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917182dd1e00) 00010000:00010000:1.0:1782758145.449407:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758145.449412:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.449419:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dac4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758145.452647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.453734:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749440 00000100:00100000:1.0:1782758145.453751:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749440 00000100:00100000:1.0:1782758145.453818:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 502 00000100:00100000:1.0:1782758145.453861:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:49989:x1869355196749440:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758145.453880:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758145.453902:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b2b expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758145.453940:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782758145.453960:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=2213s v=(0 0) 00010000:00010000:1.0:1782758145.453964:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758145.453973:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.453991:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758145.454003:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758145.454077:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:49989:x1869355196749440:12345-192.168.204.31@tcp:101:dd.0 Request processed in 228us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.454085:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 502 00000100:00100000:2.0:1782758145.480368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.480552:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749568 00000100:00100000:1.0:1782758145.480566:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749568 00002000:00100000:1.0:1782758145.480637:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9171b33c0380 x1869355196749568/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:61/0 lens 488/0 e 0 to 0 dl 1782758156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782758145.480651:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b33c0380 with x1869355196749568 ext(0->1048575) 00002000:00010000:1.0:1782758145.480658:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b33c0380 00000100:00100000:1.0:1782758145.480699:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1782758145.480711:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196749568:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:1.0:1782758145.531127:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196749568:12345-192.168.204.31@tcp:4:dd.0 Request processed in 50394us (50750us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1782758145.531148:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00002000:00100000:1.0:1782758145.531177:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9171b33c0380 x1869355196749568/t4294967354(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:61/0 lens 488/448 e 0 to 0 dl 1782758156 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782758145.531188:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b33c0380 with x1869355196749568 ext(0->1048575) 00002000:00010000:1.0:1782758145.531195:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b33c0380 00000100:00100000:2.0:1782758145.535966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758145.536081:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749696 00000100:00100000:1.0:1782758145.536091:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749696 00000100:00100000:1.0:1782758145.536145:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 922 00000100:00100000:1.0:1782758145.536154:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+14:49989:x1869355196749696:12345-192.168.204.31@tcp:44:dd.0 00010000:00010000:2.0:1782758145.590815:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758145.661080:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967654 is committed 00000004:00080000:3.0:1782758145.661104:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00000100:00100000:3.0:1782758145.665891:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211591424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758145.665999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758145.666284:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591424 00000100:00100000:2.0:1782758145.666295:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591424 00000100:00100000:2.0:1782758145.666382:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1782758145.666393:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211591424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782758145.666433:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:2.0:1782758145.666476:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.666505:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.666515:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782758145.666520:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758145.666526:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.666571:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758145.666587:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 6 pid: 6599 timeout: 2314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758145.666602:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211591552:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758145.666677:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198b499c0 going to sleep for 11 seconds 00000100:00080000:3.0:1782758145.668115:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758145.675061:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:49989:x1869355196749696:12345-192.168.204.31@tcp:44:dd.0 Request processed in 138888us (139084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758145.675080:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 922 00000001:00080000:3.0:1782758145.680420:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967656 is committed 00000100:00100000:2.0:1782758145.680933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758145.681165:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749824 00000100:00100000:3.0:1782758145.681177:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749824 00010000:00010000:3.0:1782758145.681229:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 7 pid: 6599 timeout: 2314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758145.681271:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 389 00000100:00100000:3.0:1782758145.681284:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196749824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758145.681305:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758145.681312:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 7 pid: 6599 timeout: 2314 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.681329:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 7 pid: 6599 timeout: 2314 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.681366:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758145.681372:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758145.681379:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.681391:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.681416:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758145.681495:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196749824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 213us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758145.681507:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 389 00010000:00010000:0.0:1782758145.685194:0:9120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a35a0083/0xdd99f5c4777dabe9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b0f expref: 6 pid: 6599 timeout: 2314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758145.685231:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211591552:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758145.685272:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.685288:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.685297:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.685311:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.685326:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758145.685360:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782758145.689583:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211591424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23179us (23572us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1782758145.689600:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000004:00080000:1.0:1782758145.690586:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b33c2d80/2, rc 0, transno 4294967355 00000100:00100000:1.0:1782758145.690600:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211591424:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782758145.692635:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758145.692651:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.692668:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758145.692674:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.692690:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.692718:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758145.692726:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ab1e905/0xdd99f5c4777dac67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758145.694422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758145.695646:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196749952 00000100:00100000:0.0:1782758145.695661:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196749952 00000100:00100000:0.0:1782758145.695740:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 504 00000100:00100000:0.0:1782758145.695752:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2364:x1869355196749952:12345-192.168.204.31@tcp:16:dd.0 00010000:00010000:3.0:1782758145.707611:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758145.707622:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758145.707626:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758145.834639:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000001:00080000:2.0:1782758145.834676:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000100:00100000:1.0:1782758145.834884:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196749952:12345-192.168.204.31@tcp:16:dd.0 Request processed in 139125us (140465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.834899:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 504 00000100:00100000:0.0:1782758145.846066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758145.846405:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750208 00000100:00100000:2.0:1782758145.846419:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750208 00000100:00100000:2.0:1782758145.846505:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:2.0:1782758145.846517:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:49989:x1869355196750208:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:2.0:1782758145.847250:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:49989:x1869355196750208:12345-192.168.204.31@tcp:35:dd.0 Request processed in 733us (1198us total) trans 4294967657 rc 0/0 00000100:00100000:2.0:1782758145.847260:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:3.0:1782758145.965742:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758145.965865:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758145.965894:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211591808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758145.965988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758145.966094:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591808 00000100:00100000:2.0:1782758145.966104:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591808 00000100:00100000:2.0:1782758145.968287:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1782758145.968317:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211591808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758145.968517:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211591808:12345-0@lo:400:kworker.0 Request processed in 214us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.968526:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:0.0:1782758145.968934:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211591808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758145.975532:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211591680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758145.976149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758145.977646:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591680 00000100:00100000:2.0:1782758145.977659:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591680 00000100:00100000:0.0:1782758145.980455:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758145.980483:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211592192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758145.980573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758145.980652:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592192 00000100:00100000:0.0:1782758145.980660:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592192 00000100:00100000:0.0:1782758145.980733:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1782758145.980744:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758145.980807:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211592192:12345-0@lo:400:kworker.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.981070:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211591936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758145.981136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758145.981141:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211592064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758145.981196:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211591936 00000100:00100000:1.0:1782758145.981200:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211591936 00000100:00100000:1.0:1782758145.981233:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592064 00000100:00100000:1.0:1782758145.981236:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592064 00000100:00100000:1.0:1782758145.981257:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1782758145.981264:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211591936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981304:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211591936:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.981311:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1782758145.981335:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1782758145.981340:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211592064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981367:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211592064:12345-0@lo:400:kworker.0 Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758145.981373:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1782758145.981441:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211592064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981454:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211591936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758145.981512:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:1.0:1782758145.981519:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082208380, transno 4294967353 00000100:00100000:1.0:1782758145.981529:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211592192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758145.982284:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:3.0:1782758145.982526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758145.982532:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758145.984348:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1782758145.984374:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211591680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758145.988873:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211591680:12345-0@lo:400:kworker.0 Request processed in 4456us (12669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758145.988895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1782758145.989657:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211591680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758146.486240:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758146.486275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211592320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758146.486397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758146.486616:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592320 00000100:00100000:2.0:1782758146.486627:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592320 00000100:00100000:2.0:1782758146.486701:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1782758146.486713:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211592320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758146.486742:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782758146.487246:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211592320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 534us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758146.487256:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1782758146.493896:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211592320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758146.608701:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758147.121676:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000001:00080000:3.0:1782758147.121702:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00010000:00010000:2.0:1782758147.628035:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758147.724595:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967657 is committed 00010000:00010000:3.0:1782758148.652209:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758149.037948:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758149.037969:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211592448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758149.038044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758149.038110:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592448 00000100:00100000:0.0:1782758149.038118:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592448 00000100:00100000:0.0:1782758149.038170:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1782758149.038179:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211592448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758149.038226:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758149.038270:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211592448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758149.038278:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00080000:0.0:1782758149.038299:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758149.038325:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:0.0:1782758149.038329:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b33c2d80, transno 4294967355 00000100:00100000:0.0:1782758149.038347:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211592448:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1782758149.164597:0:85076:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2217567772022ns, next at 2213110956719ns, rc = 0 00000004:00080000:1.0:1782758149.164767:0:85076:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2217567943713ns, next at 2211536876153ns, rc = 0 00000004:00080000:0.0:1782758149.202619:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00000004:00080000:0.0:1782758149.202643:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00010000:00010000:0.0:1782758149.676711:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758150.326110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758150.326156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758150.326194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758150.326232:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758150.326262:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750336 00000100:00100000:2.0:1782758150.326280:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750336 00000100:00100000:2.0:1782758150.326330:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1240 00000100:00100000:2.0:1782758150.326340:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196750336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758150.326413:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196750336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758150.326420:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1240 00000100:00100000:2.0:1782758150.326453:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750720 00000100:00100000:2.0:1782758150.326457:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750720 00000100:00100000:2.0:1782758150.326487:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750592 00000100:00100000:2.0:1782758150.326489:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750592 00000100:00100000:2.0:1782758150.326507:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:2.0:1782758150.326514:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196750720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758150.326547:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196750720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758150.326554:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:2.0:1782758150.326566:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1195 00000100:00100000:2.0:1782758150.326572:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196750592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758150.326592:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196750592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758150.326598:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1195 00000100:00100000:0.0:1782758150.327006:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750464 00000100:00100000:0.0:1782758150.327012:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750464 00000100:00100000:0.0:1782758150.327053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1569 00000100:00100000:0.0:1782758150.327063:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196750464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758150.327112:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196750464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758150.327121:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1569 00000100:00080000:0.0:1782758150.327262:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758150.327267:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758150.327281:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758150.715498:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758151.085651:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211592960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758151.085661:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211592832:0@lo:400:kworker.0 00000100:00100000:0.0:1782758151.085703:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211592576:0@lo:400:kworker.0 00000100:00100000:1.0:1782758151.093704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758151.093798:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758151.093812:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211592704:0@lo:400:kworker.0 00000100:00100000:1.0:1782758151.093868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758151.093893:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211593216:0@lo:400:kworker.0 00000100:00100000:1.0:1782758151.093917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758151.094604:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592832 00000100:00100000:2.0:1782758151.094613:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592832 00000100:00100000:2.0:1782758151.094664:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592704 00000100:00100000:2.0:1782758151.094667:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592704 00000100:00100000:2.0:1782758151.094687:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:2.0:1782758151.094695:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211592832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.094769:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211592832:12345-0@lo:400:kworker.0 Request processed in 73us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.094777:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:2.0:1782758151.094804:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1782758151.094810:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211592704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.094855:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211592704:12345-0@lo:400:kworker.0 Request processed in 44us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.094861:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1782758151.094880:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593216 00000100:00100000:2.0:1782758151.094884:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593216 00000100:00100000:2.0:1782758151.094910:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1782758151.094915:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.094964:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211593216:12345-0@lo:400:kworker.0 Request processed in 49us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.094969:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00080000:2.0:1782758151.094987:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758151.094992:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758151.095038:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211592704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.095048:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211593216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.095071:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211592832:0@lo:400:kworker.0 00000100:00100000:0.0:1782758151.099566:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758151.099629:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211593088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758151.099661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758151.101817:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593088 00000100:00100000:2.0:1782758151.101845:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593088 00000100:00100000:2.0:1782758151.101914:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:2.0:1782758151.101924:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211593088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.102041:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211593088:12345-0@lo:400:kworker.0 Request processed in 118us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.102049:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1782758151.102185:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592576 00000100:00100000:1.0:1782758151.102190:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592576 00000100:00100000:1.0:1782758151.102223:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1782758151.102230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211592576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758151.102281:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211592576:12345-0@lo:400:kworker.0 Request processed in 52us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758151.102288:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:2.0:1782758151.102490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758151.102523:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211592576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.102539:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211593088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758151.105574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758151.107470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758151.109546:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211592960 00000100:00100000:2.0:1782758151.109558:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211592960 00000100:00100000:2.0:1782758151.109627:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1782758151.109637:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211592960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758151.109728:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211592960:12345-0@lo:400:kworker.0 Request processed in 93us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.109736:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1782758151.109790:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750848 00000100:00100000:2.0:1782758151.109794:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750848 00000100:00100000:2.0:1782758151.109837:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 923 00000100:00100000:2.0:1782758151.109844:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196750848:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758151.109909:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196750848:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 66us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.109916:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 923 00000100:00080000:0.0:1782758151.113541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758151.115481:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211592960:0@lo:400:kworker.0 00000100:00100000:0.0:1782758151.120862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758151.120964:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196750976 00000100:00100000:2.0:1782758151.120976:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196750976 00000100:00100000:2.0:1782758151.121036:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 505 00000100:00100000:2.0:1782758151.121046:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50182:x1869355196750976:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758151.121724:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50182:x1869355196750976:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 677us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.121732:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 505 00000100:00100000:0.0:1782758151.138395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758151.138652:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751104 00000100:00100000:3.0:1782758151.138662:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751104 00000100:00100000:3.0:1782758151.138715:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 506 00000100:00100000:3.0:1782758151.138725:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50182:x1869355196751104:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758151.139362:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50182:x1869355196751104:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 634us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758151.139370:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 506 00000100:00100000:0.0:1782758151.148901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758151.153870:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751232 00000100:00100000:3.0:1782758151.153884:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751232 00000100:00100000:3.0:1782758151.153964:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 924 00000100:00100000:3.0:1782758151.153973:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751232:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758151.154445:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751232:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 471us (5553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758151.154454:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 924 00000100:00100000:0.0:1782758151.160584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758151.161419:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751360 00000100:00100000:1.0:1782758151.161430:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751360 00000100:00100000:1.0:1782758151.161496:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 925 00000100:00100000:1.0:1782758151.161506:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751360:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758151.161602:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751360:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 97us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758151.161611:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 925 00000100:00100000:0.0:1782758151.164923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758151.164995:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751488 00000100:00100000:3.0:1782758151.165006:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751488 00000100:00100000:3.0:1782758151.165061:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 507 00000100:00100000:3.0:1782758151.165071:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50182:x1869355196751488:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758151.165602:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50182:x1869355196751488:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 530us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758151.165611:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 507 00000100:00100000:1.0:1782758151.178193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758151.178460:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751616 00000100:00100000:3.0:1782758151.178470:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751616 00000100:00100000:3.0:1782758151.178530:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 508 00000100:00100000:3.0:1782758151.178541:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50182:x1869355196751616:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758151.178922:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50182:x1869355196751616:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 382us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758151.178931:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 508 00000100:00100000:0.0:1782758151.190987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758151.191582:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196751744 00000100:00100000:2.0:1782758151.191592:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196751744 00000100:00100000:2.0:1782758151.191668:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00100000:2.0:1782758151.191678:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751744:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758151.195146:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50182:x1869355196751744:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 3453us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.195165:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00100000:3.0:1782758151.289038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758151.289090:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752000 00000100:00100000:3.0:1782758151.289099:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752000 00000100:00100000:3.0:1782758151.289148:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 927 00000100:00100000:3.0:1782758151.289157:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50186:x1869355196752000:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758151.289208:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758151.289251:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dac52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b24 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289268:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782758151.289287:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758151.289309:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289322:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289330:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289350:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289357:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289363:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289723:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289732:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.289749:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758151.290540:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:3.0:1782758151.290550:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2219693726675ns, next at 2220693724643ns, rc = 0 00010000:00010000:3.0:1782758151.290649:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290660:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290668:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290676:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290687:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290692:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290708:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758151.290728:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290734:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290752:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290758:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758151.290762:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290770:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290780:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758151.290783:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758151.290787:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290792:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dac7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290806:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290812:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290817:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290843:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758151.290846:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290852:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290859:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:3.0:1782758151.290861:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758151.290864:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.290870:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dac6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758151.290879:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c713ad34 reply state 00000000f0c045db transno 4294967658 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758151.290888:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758151.290970:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50186:x1869355196752000:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1810us (1939us total) trans 4294967658 rc 0/0 00000100:00100000:3.0:1782758151.290979:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 927 00010000:00010000:3.0:1782758151.291009:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758151.291014:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.291021:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758151.291025:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.291032:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.291040:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758151.291043:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758151.291046:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.291052:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dac83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758151.291065:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758151.291067:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758151.291069:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758151.301637:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301656:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301663:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301672:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758151.301677:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301684:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301701:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917191f75400) 00010000:00010000:2.0:1782758151.301704:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758151.301709:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758151.301715:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dac75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758151.596130:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211593344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758151.596203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758151.596552:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593344 00000100:00100000:2.0:1782758151.596560:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593344 00000100:00100000:2.0:1782758151.596609:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1782758151.596619:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211593344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758151.596655:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782758151.596714:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211593344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758151.596740:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1782758151.597007:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211593344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758151.725326:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758152.750720:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758153.772333:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758153.990229:0:85221:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2222393403448ns, next at 2213110956719ns, rc = 0 00000004:00080000:3.0:1782758153.990364:0:85221:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2222393540978ns, next at 2220693724643ns, rc = 0 00000004:00080000:0.0:1782758154.025151:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000004:00080000:0.0:1782758154.025182:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000001:00080000:0.0:1782758154.025199:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967658 is committed 00000004:00080000:0.0:1782758154.025204:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00000100:00100000:2.0:1782758154.025491:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211593472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758154.025563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758154.025736:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593472 00000100:00100000:1.0:1782758154.025744:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593472 00000100:00100000:1.0:1782758154.025809:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1782758154.025819:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211593472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782758154.025869:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:1.0:1782758154.025892:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758154.025918:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758154.025927:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1782758154.025931:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758154.025936:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758154.025964:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758154.025978:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 5 pid: 6597 timeout: 2322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758154.025990:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211593600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758154.026055:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb9163c0 going to sleep for 11 seconds 00000100:00080000:0.0:1782758154.026159:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758154.030567:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211593600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782758154.030604:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758154.032024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758154.032124:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752128 00000100:00100000:0.0:1782758154.032134:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752128 00010000:00010000:0.0:1782758154.032201:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 6 pid: 6597 timeout: 2322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758154.032250:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 390 00000100:00100000:0.0:1782758154.032260:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196752128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758154.032276:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758154.032282:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 6 pid: 6597 timeout: 2322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.032296:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 6 pid: 6597 timeout: 2322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.032321:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777dac60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b2b expref: 6 pid: 6597 timeout: 2322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.032340:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758154.032345:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758154.032352:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.032362:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.032399:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758154.032444:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196752128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 185us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758154.032452:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 390 00010000:00010000:3.0:1782758154.032620:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758154.032633:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758154.032644:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758154.032653:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758154.032677:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758154.033317:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211593472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7497us (7753us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782758154.033326:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:2.0:1782758154.033423:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1782758154.033463:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7765880/2, rc 0, transno 4294967355 00000100:00100000:2.0:1782758154.033484:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211593472:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782758154.034261:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758154.034270:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.034282:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758154.034287:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.034298:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.034316:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.034323:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dac8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758154.034345:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758154.034347:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758154.034348:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758154.155976:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211593728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758154.156049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758154.156123:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593728 00000100:00100000:0.0:1782758154.156131:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593728 00000100:00100000:0.0:1782758154.156182:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1782758154.156193:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211593728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758154.156232:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758154.156280:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211593728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758154.156288:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1782758154.156335:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211593728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758154.158248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758154.796011:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758155.444510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758155.444560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758155.444596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758155.444627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758155.444669:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752384 00000100:00100000:3.0:1782758155.444681:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752384 00000100:00100000:0.0:1782758155.444698:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752256 00000100:00100000:0.0:1782758155.444706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752256 00000100:00100000:0.0:1782758155.444756:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:3.0:1782758155.444768:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1573 00000100:00100000:0.0:1782758155.444770:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196752256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758155.444782:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196752384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758155.444881:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196752256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 115us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758155.444890:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:1.0:1782758155.445045:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752512 00000100:00100000:1.0:1782758155.445050:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752512 00000100:00100000:1.0:1782758155.445080:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752640 00000100:00100000:1.0:1782758155.445083:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752640 00000100:00100000:1.0:1782758155.445101:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1198 00000100:00100000:1.0:1782758155.445108:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196752512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758155.446253:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196752384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1468us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758155.446264:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1573 00000100:00080000:3.0:1782758155.446297:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758155.446302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758155.446321:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1199 00000100:00100000:3.0:1782758155.446331:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196752640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758155.446366:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196752640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758155.446376:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1199 00000100:00100000:1.0:1782758155.451331:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196752512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 6207us (6755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758155.451349:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1198 00010000:00010000:3.0:1782758155.820702:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758156.207743:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594240:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.207846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758156.207913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758156.207920:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211594112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.207948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758156.207956:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211593984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.207987:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594240 00000100:00100000:2.0:1782758156.207995:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594240 00000100:00100000:1.0:1782758156.207995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758156.208020:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211594496:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.208063:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1782758156.208072:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.208128:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594240:12345-0@lo:400:kworker.0 Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758156.208135:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1782758156.208166:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594112 00000100:00100000:2.0:1782758156.208170:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594112 00000100:00100000:2.0:1782758156.208208:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593984 00000100:00100000:2.0:1782758156.208211:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593984 00000100:00100000:2.0:1782758156.208229:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:2.0:1782758156.208235:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211594112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.208281:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211594112:12345-0@lo:400:kworker.0 Request processed in 46us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758156.208288:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:2.0:1782758156.208313:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1782758156.208318:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211593984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.208347:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211593984:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758156.208356:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00080000:2.0:1782758156.208374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758156.208379:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758156.208418:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211594112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.208430:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594240:0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.208695:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211593856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.208732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758156.208766:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211594368:0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.208788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758156.208818:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594368 00000100:00100000:3.0:1782758156.208844:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594368 00000100:00100000:3.0:1782758156.208878:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1782758156.208885:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211594368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.208918:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211594368:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758156.208924:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00080000:3.0:1782758156.208942:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758156.208960:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211594368:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.209033:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211593856 00000100:00100000:2.0:1782758156.209037:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211593856 00000100:00100000:1.0:1782758156.209051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758156.209081:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1782758156.209091:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211593856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758156.209095:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211593984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758156.209135:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211593856:12345-0@lo:400:kworker.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758156.209144:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1782758156.209144:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211593856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.209671:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594496 00000100:00100000:3.0:1782758156.209677:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594496 00000100:00100000:3.0:1782758156.209720:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1782758156.209727:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211594496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758156.209776:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211594496:12345-0@lo:400:kworker.0 Request processed in 50us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758156.209782:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:2.0:1782758156.215445:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758156.215704:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211594496:0@lo:400:kworker.0 00000001:00080000:2.0:1782758156.322517:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967355 is committed 00000100:00100000:2.0:1782758156.729132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758156.729154:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758156.729227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758156.729299:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594624 00000100:00100000:2.0:1782758156.729307:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594624 00000100:00100000:2.0:1782758156.729353:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1782758156.729361:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758156.729396:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758156.729444:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758156.729451:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1782758156.729500:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:2.0:1782758156.729506:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7765880, transno 4294967355 00000100:00100000:2.0:1782758156.729523:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758156.857404:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758157.869493:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758158.892634:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758159.287270:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758159.287366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758159.288934:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594752 00000100:00100000:3.0:1782758159.288956:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594752 00000100:00100000:3.0:1782758159.289041:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1782758159.289052:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758159.289396:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758159.289673:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211594752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 622us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758159.289682:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1782758159.289766:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211594752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758159.291974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758159.916216:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758160.577223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758160.577292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758160.577331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758160.577466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752768 00000100:00100000:0.0:1782758160.577479:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752768 00000100:00100000:0.0:1782758160.577542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1244 00000100:00100000:0.0:1782758160.577552:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196752768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758160.577666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196752768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 115us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758160.577674:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1244 00000100:00100000:3.0:1782758160.578128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758160.580038:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196752896 00000100:00100000:2.0:1782758160.580056:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196752896 00000100:00100000:2.0:1782758160.580402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1577 00000100:00100000:2.0:1782758160.580416:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196752896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758160.580592:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196752896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 178us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758160.580601:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1577 00000100:00080000:0.0:1782758160.580917:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758160.581820:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753024 00000100:00100000:1.0:1782758160.581852:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753024 00000100:00100000:1.0:1782758160.581955:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753152 00000100:00100000:1.0:1782758160.581959:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753152 00000100:00100000:0.0:1782758160.582019:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00100000:0.0:1782758160.582033:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196753024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758160.582116:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196753024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (4787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758160.582123:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00100000:0.0:1782758160.582145:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1203 00000100:00100000:0.0:1782758160.582151:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196753152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758160.582173:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196753152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758160.582180:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1203 00000100:00080000:2.0:1782758160.582232:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758160.582236:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758160.943963:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758161.324188:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211595008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.324305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758161.324393:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211595520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.324431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758161.324462:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758161.324468:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211594880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.324498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758161.324520:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211595392:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.324539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758161.324585:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595520 00000100:00100000:0.0:1782758161.324594:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595520 00000100:00080000:1.0:1782758161.324647:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758161.324670:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1782758161.324684:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.324767:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211595520:12345-0@lo:400:kworker.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758161.324779:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1782758161.324893:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211595520:0@lo:400:kworker.0 00000100:00100000:2.0:1782758161.325878:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595008 00000100:00100000:2.0:1782758161.325888:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595008 00000100:00100000:2.0:1782758161.325945:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595392 00000100:00100000:2.0:1782758161.325948:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595392 00000100:00100000:2.0:1782758161.325987:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1782758161.325996:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211595008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758161.326023:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758161.326073:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:1.0:1782758161.326085:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211595392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.326116:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211595264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.326158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758161.326211:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211595392:12345-0@lo:400:kworker.0 Request processed in 128us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758161.326219:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:1.0:1782758161.326262:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211595136:0@lo:400:kworker.0 00000100:00100000:1.0:1782758161.326294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758161.326470:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211595008:12345-0@lo:400:kworker.0 Request processed in 474us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758161.326478:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1782758161.326491:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595136 00000100:00100000:2.0:1782758161.326495:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595136 00000100:00100000:2.0:1782758161.326532:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1782758161.326539:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211595136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758161.326582:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211595136:12345-0@lo:400:kworker.0 Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758161.326589:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:1.0:1782758161.327030:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211595136:0@lo:400:kworker.0 00000100:00080000:1.0:1782758161.327056:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758161.327078:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211595392:0@lo:400:kworker.0 00000100:00100000:1.0:1782758161.327455:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211595008:0@lo:400:kworker.0 00000100:00100000:1.0:1782758161.327507:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211594880 00000100:00100000:1.0:1782758161.327513:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211594880 00000100:00100000:1.0:1782758161.327567:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1782758161.327574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211594880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758161.327643:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211594880:12345-0@lo:400:kworker.0 Request processed in 69us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758161.327649:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1782758161.327701:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211594880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.328189:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595264 00000100:00100000:0.0:1782758161.328196:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595264 00000100:00100000:0.0:1782758161.328242:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1782758161.328251:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211595264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758161.328304:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211595264:12345-0@lo:400:kworker.0 Request processed in 56us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758161.328312:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00080000:0.0:1782758161.328346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758161.328428:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211595264:0@lo:400:kworker.0 00000100:00100000:1.0:1782758161.836730:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211595648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758161.837051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758161.837167:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595648 00000100:00100000:2.0:1782758161.837253:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595648 00000100:00100000:2.0:1782758161.837480:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1782758161.837493:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211595648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758161.837554:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758161.837618:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211595648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758161.837626:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1782758161.839655:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211595648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758161.965247:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758162.990813:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758164.012292:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758164.396152:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211595776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758164.396244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758164.403526:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595776 00000100:00100000:3.0:1782758164.403544:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595776 00000100:00100000:3.0:1782758164.403857:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1782758164.403869:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211595776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758164.403960:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758164.404072:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211595776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (7828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758164.404081:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1782758164.404166:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211595776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758164.406112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758165.037604:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758165.686640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758165.686773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758165.686934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758165.686965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758165.687087:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753408 00000100:00100000:3.0:1782758165.687101:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753408 00000100:00100000:3.0:1782758165.687185:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1581 00000100:00100000:3.0:1782758165.687198:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196753408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758165.687332:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196753408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 136us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758165.687340:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1581 00000100:00080000:3.0:1782758165.687382:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758165.687652:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753280 00000100:00100000:0.0:1782758165.687659:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753280 00000100:00100000:0.0:1782758165.687702:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:0.0:1782758165.687710:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196753280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758165.687765:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196753280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758165.687778:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:1.0:1782758165.688357:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753536 00000100:00100000:1.0:1782758165.688365:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753536 00000100:00100000:0.0:1782758165.688524:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753664 00000100:00100000:0.0:1782758165.688530:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753664 00000100:00100000:0.0:1782758165.688632:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1206 00000100:00100000:0.0:1782758165.688641:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196753664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758165.688694:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196753664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 54us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758165.688702:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1206 00000100:00080000:1.0:1782758165.688905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758165.688911:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758165.689120:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1207 00000100:00100000:2.0:1782758165.689131:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196753536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758165.689180:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196753536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758165.689186:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1207 00010000:00010000:0.0:1782758166.063081:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758166.450576:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211596032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758166.450577:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211596160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.450714:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211595904:0@lo:400:kworker.0 00000100:00100000:1.0:1782758166.451016:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.451559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758166.451620:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211596544:0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.451652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758166.451695:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596032 00000100:00100000:2.0:1782758166.451703:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596032 00000100:00100000:2.0:1782758166.451773:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1782758166.451784:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211596032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.451859:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211596032:12345-0@lo:400:kworker.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758166.451868:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1782758166.451910:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596544 00000100:00100000:2.0:1782758166.451915:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596544 00000100:00100000:2.0:1782758166.451952:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1782758166.451958:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211596544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.451988:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211596544:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758166.451994:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00080000:2.0:1782758166.452013:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758166.452047:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211596032:0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.452057:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211596544:0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.461703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758166.461819:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211595904 00000100:00100000:0.0:1782758166.461855:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211596416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.461881:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211595904 00000100:00100000:0.0:1782758166.461932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758166.461957:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1782758166.461972:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211595904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.461988:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596416 00000100:00100000:0.0:1782758166.461994:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596416 00000100:00100000:2.0:1782758166.462046:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211595904:12345-0@lo:400:kworker.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758166.462056:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1782758166.462060:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:0.0:1782758166.462070:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211596416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.462119:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211596416:12345-0@lo:400:kworker.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758166.462126:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00080000:2.0:1782758166.462160:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758166.463188:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211595904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.463209:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211596416:0@lo:400:kworker.0 00000100:00100000:3.0:1782758166.466723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758166.466723:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758166.466865:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596288 00000100:00100000:0.0:1782758166.466877:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596288 00000100:00100000:0.0:1782758166.466968:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1782758166.466980:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758166.467066:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596288:12345-0@lo:400:kworker.0 Request processed in 89us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758166.467073:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1782758166.467122:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596288:0@lo:400:kworker.0 00000100:00080000:2.0:1782758166.467249:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758166.473102:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596160 00000100:00100000:2.0:1782758166.473122:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596160 00000100:00100000:2.0:1782758166.473230:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1782758166.473242:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211596160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758166.473389:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211596160:12345-0@lo:400:kworker.0 Request processed in 148us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758166.473398:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1782758166.473495:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211596160:0@lo:400:kworker.0 00000100:00080000:3.0:1782758166.475898:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758166.956184:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758166.956224:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758166.956318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758166.956469:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596672 00000100:00100000:2.0:1782758166.956480:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596672 00000100:00100000:2.0:1782758166.956542:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1782758166.956552:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758166.956597:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758166.956655:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758166.956663:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1782758166.956907:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758167.084700:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758167.884427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758167.884551:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753792 00000100:00100000:2.0:1782758167.884564:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753792 00000100:00100000:2.0:1782758167.884692:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 928 00000100:00100000:2.0:1782758167.884706:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196753792:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758167.884854:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196753792:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 150us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758167.884862:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 928 00000100:00080000:0.0:1782758167.892591:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758167.903516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758167.909682:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196753920 00000100:00100000:3.0:1782758167.909706:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196753920 00000100:00100000:2.0:1782758167.910040:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 510 00000100:00100000:2.0:1782758167.910056:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196753920:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:3.0:1782758167.910184:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758167.910675:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196753920:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 620us (7172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758167.910690:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 510 00000100:00100000:3.0:1782758167.918981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758167.919459:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754048 00000100:00100000:0.0:1782758167.919472:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754048 00000100:00100000:0.0:1782758167.919599:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 511 00000100:00100000:0.0:1782758167.919612:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754048:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758167.920135:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754048:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 511us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758167.920145:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 511 00000100:00080000:3.0:1782758167.921405:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758167.927103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758167.927270:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754176 00000100:00100000:3.0:1782758167.927284:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754176 00000100:00100000:3.0:1782758167.927361:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 929 00000100:00100000:3.0:1782758167.927373:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754176:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758167.929091:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754176:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1711us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758167.929106:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 929 00000100:00100000:3.0:1782758167.935848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758167.935892:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754304 00000100:00100000:3.0:1782758167.935903:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754304 00000100:00100000:3.0:1782758167.935975:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 930 00000100:00100000:3.0:1782758167.935989:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754304:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758167.936111:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754304:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 124us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758167.936124:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 930 00000100:00100000:2.0:1782758167.946062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758167.946175:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754432 00000100:00100000:0.0:1782758167.946189:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754432 00000100:00100000:0.0:1782758167.946268:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 512 00000100:00100000:0.0:1782758167.946280:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754432:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758167.949447:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754432:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 3149us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758167.949466:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 512 00000100:00100000:2.0:1782758167.968774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758167.968853:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754560 00000100:00100000:2.0:1782758167.968867:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754560 00000100:00100000:2.0:1782758167.968940:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 513 00000100:00100000:2.0:1782758167.968953:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754560:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758167.969492:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50364:x1869355196754560:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 539us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758167.969502:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 513 00000100:00100000:2.0:1782758167.986950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758167.988886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754688 00000100:00100000:0.0:1782758167.988906:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754688 00000100:00100000:0.0:1782758167.988988:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 931 00000100:00100000:0.0:1782758167.989001:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754688:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758167.989580:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50364:x1869355196754688:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 579us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758167.989591:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 931 00010000:00010000:3.0:1782758168.117493:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758169.133069:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758169.523066:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758169.523186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758169.523610:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596800 00000100:00100000:1.0:1782758169.523622:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596800 00000100:00100000:1.0:1782758169.523709:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1782758169.523721:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758169.523770:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758169.523877:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211596800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758169.523884:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00080000:0.0:1782758169.523971:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758169.524031:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758169.653567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758169.653653:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196754816 00000100:00100000:0.0:1782758169.653664:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196754816 00000100:00100000:0.0:1782758169.653776:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 932 00000100:00100000:0.0:1782758169.653789:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50378:x1869355196754816:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758169.653811:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758169.653851:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dac91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b32 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782758169.653864:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758169.653918:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.653932:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.653944:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758169.654135:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758169.654139:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758169.654233:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.654260:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dac91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b32 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.654290:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b32 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.654300:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758169.654303:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758169.654307:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:0.0:1782758169.654374:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50378:x1869355196754816:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 589us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758169.654391:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 932 00000100:00100000:0.0:1782758169.658959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758169.659583:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755072 00000100:00100000:2.0:1782758169.659593:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755072 00000100:00100000:2.0:1782758169.659655:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 933 00000100:00100000:2.0:1782758169.659668:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50378:x1869355196755072:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758169.659723:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758169.659750:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dac98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b32 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.659768:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dac36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b1d expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.659779:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:2.0:1782758169.659790:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758169.659812:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.660178:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.660192:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758169.690668:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7ca39f7 reply state 0000000080cd6eb5 transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758169.690692:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758169.690922:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:2.0:1782758169.691028:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50378:x1869355196755072:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 31360us (32072us total) trans 4294967659 rc 0/0 00000100:00100000:2.0:1782758169.691037:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 933 00000001:00080000:3.0:1782758169.692675:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967659 is committed 00010000:00010000:1.0:1782758169.692759:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692772:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692779:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692785:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758169.692789:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692798:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692813:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782758169.692816:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758169.692844:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758169.692856:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dac9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758169.805420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758169.806165:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755200 00000100:00100000:2.0:1782758169.806176:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755200 00000100:00100000:2.0:1782758169.806252:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 934 00000100:00100000:2.0:1782758169.806264:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50382:x1869355196755200:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782758169.806291:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758169.806311:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777daca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b39 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806507:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806524:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806536:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806553:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806560:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758169.806566:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.807584:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.807598:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.807608:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758169.807924:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758169.807929:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758169.808094:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808108:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808115:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808122:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808127:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758169.808132:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808138:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808151:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758169.808154:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758169.808159:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808165:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dacad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808179:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808185:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808190:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808194:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758169.808197:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808208:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808216:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917182dd1500) 00010000:00010000:0.0:1782758169.808219:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758169.808222:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808227:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dacb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808264:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777daca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b39 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808278:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b39 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758169.808285:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758169.808288:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758169.808290:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50200, rc 0) 00000100:00100000:0.0:1782758169.808445:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50382:x1869355196755200:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2174us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758169.808456:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 934 00010000:00010000:0.0:1782758170.156100:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758170.817099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758170.817152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758170.817183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758170.817210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758170.817241:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755712 00000100:00100000:1.0:1782758170.817250:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755712 00000100:00100000:1.0:1782758170.817312:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755584 00000100:00100000:1.0:1782758170.817315:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755584 00000100:00100000:1.0:1782758170.817342:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1210 00000100:00100000:1.0:1782758170.817352:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196755712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758170.817442:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196755712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758170.817450:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1210 00000100:00100000:1.0:1782758170.817472:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1211 00000100:00100000:1.0:1782758170.817479:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196755584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758170.817504:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196755584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758170.817510:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1211 00000100:00100000:1.0:1782758170.817538:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755328 00000100:00100000:1.0:1782758170.817542:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755328 00000100:00100000:1.0:1782758170.817568:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1248 00000100:00100000:1.0:1782758170.817574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196755328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758170.817602:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196755328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758170.817613:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1248 00000100:00080000:1.0:1782758170.817640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758170.817644:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758170.824501:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755456 00000100:00100000:3.0:1782758170.824518:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755456 00000100:00100000:3.0:1782758170.833389:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1585 00000100:00100000:3.0:1782758170.833409:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196755456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758170.833554:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196755456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 152us (16465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758170.833563:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1585 00000100:00100000:1.0:1782758171.051883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.051980:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196755840 00000100:00100000:0.0:1782758171.051991:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196755840 00000100:00100000:0.0:1782758171.052061:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 935 00000100:00100000:0.0:1782758171.052071:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50401:x1869355196755840:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758171.052091:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758171.052114:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b40 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052181:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052196:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052209:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758171.052429:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758171.052434:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758171.052514:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052541:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b40 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052561:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b40 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.052570:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758171.052574:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758171.052578:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51400, rc 0) 00000100:00100000:0.0:1782758171.052634:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50401:x1869355196755840:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 563us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758171.052642:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 935 00000100:00080000:1.0:1782758171.053050:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758171.063194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.063307:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756096 00000100:00100000:0.0:1782758171.063320:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756096 00000100:00100000:0.0:1782758171.063399:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 936 00000100:00100000:0.0:1782758171.063410:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50401:x1869355196756096:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758171.063479:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758171.063510:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dacc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b40 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.063533:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b39 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.063546:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758171.063556:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758171.063582:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.063594:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.063604:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758171.164472:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060a1f3e6 reply state 0000000016e0ec46 transno 4294967660 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758171.164493:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758171.164705:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:0.0:1782758171.164841:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50401:x1869355196756096:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 101408us (101636us total) trans 4294967660 rc 0/0 00000100:00100000:0.0:1782758171.164851:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 936 00000001:00080000:3.0:1782758171.165083:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967660 is committed 00010000:00010000:0.0:1782758171.173344:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173374:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173382:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173388:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.173393:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173402:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173423:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782758171.173426:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758171.173432:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.173439:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.182556:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758171.288813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.290277:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756224 00000100:00100000:0.0:1782758171.290289:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756224 00000100:00100000:0.0:1782758171.290910:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 937 00000100:00100000:0.0:1782758171.290921:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50405:x1869355196756224:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782758171.290946:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758171.290967:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b47 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291041:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291056:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291068:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291084:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291090:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291096:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291573:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291582:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291590:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758171.291677:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758171.291681:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758171.291767:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291785:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291791:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291799:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291805:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.291809:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291816:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291874:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758171.291878:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758171.291883:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291889:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dacde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291902:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291909:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291915:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291921:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.291924:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291929:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291936:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff91718bcfd000) 00010000:00010000:0.0:1782758171.291938:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758171.291941:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291945:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dace5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291976:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dacd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b47 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291989:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b47 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.291995:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758171.291997:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758171.291999:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758171.292087:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50405:x1869355196756224:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1168us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758171.292095:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 937 00000100:00100000:0.0:1782758171.301304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.325499:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756480 00000100:00100000:0.0:1782758171.325516:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756480 00000100:00100000:0.0:1782758171.325607:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 938 00000100:00100000:0.0:1782758171.325618:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50405:x1869355196756480:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782758171.325641:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758171.325663:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dacf3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b4e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326068:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326084:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326097:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326112:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326119:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.326126:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758171.326999:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:0.0:1782758171.327322:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dad08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327334:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dad08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327343:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dad08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327397:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327405:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327411:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327416:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.327421:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327429:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327441:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758171.327444:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758171.327449:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327455:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dacfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758171.327468:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ebb39bc reply state 000000008defe63a transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758171.327477:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758171.327509:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dacf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b4e expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327523:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dad08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b4e expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.327530:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758171.327533:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758171.327535:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782758171.327614:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50405:x1869355196756480:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1997us (26318us total) trans 4294967661 rc 0/0 00000100:00100000:0.0:1782758171.327622:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 938 00010000:00010000:3.0:1782758171.343882:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343901:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343909:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343916:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758171.343920:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343928:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343946:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff91718bcfda00) 00010000:00010000:3.0:1782758171.343949:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758171.343954:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.343960:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dad01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758171.347025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758171.347109:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756736 00000100:00100000:1.0:1782758171.347120:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756736 00000100:00100000:1.0:1782758171.347181:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 939 00000100:00100000:1.0:1782758171.347191:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50405:x1869355196756736:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:1.0:1782758171.347248:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758171.347275:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dad08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b4e expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.347292:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:1.0:1782758171.347303:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758171.347362:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.347374:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.347383:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758171.347522:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6c6b0ce reply state 000000002c1751ba transno 4294967662 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758171.347535:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758171.347639:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50405:x1869355196756736:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 447us (622us total) trans 4294967662 rc 0/0 00000100:00100000:1.0:1782758171.347647:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 939 00010000:00010000:3.0:1782758171.360592:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360611:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360619:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360624:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758171.360629:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360636:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360654:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758171.360667:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758171.360673:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.360679:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758171.362970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758171.363530:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756864 00000100:00100000:3.0:1782758171.363541:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756864 00000100:00100000:3.0:1782758171.363654:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 940 00000100:00100000:3.0:1782758171.363678:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50405:x1869355196756864:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758171.363713:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758171.363736:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dad1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b55 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.363800:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dad1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b55 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.363817:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dad1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b55 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.363869:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782758171.363872:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782758171.363877:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758171.363944:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50405:x1869355196756864:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 280us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758171.363951:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 940 00000100:00100000:3.0:1782758171.369981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.372446:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196756992 00000100:00100000:0.0:1782758171.372461:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196756992 00000100:00100000:0.0:1782758171.372540:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 514 00000100:00100000:0.0:1782758171.372553:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196756992:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:0.0:1782758171.372987:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196756992:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 437us (3015us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1782758171.372997:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 514 00000100:00100000:1.0:1782758171.388322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758171.393640:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196757248 00000100:00100000:3.0:1782758171.393656:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196757248 00000100:00100000:1.0:1782758171.393982:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:1.0:1782758171.393997:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50405:x1869355196757248:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:0.0:1782758171.396447:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50405:x1869355196757248:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 2444us (8122us total) trans 4294967663 rc 0/0 00000100:00100000:0.0:1782758171.396463:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:0.0:1782758171.465860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758171.466020:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196757376 00000100:00100000:1.0:1782758171.466031:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196757376 00000100:00100000:1.0:1782758171.466088:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 941 00000100:00100000:1.0:1782758171.466099:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50409:x1869355196757376:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782758171.466123:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758171.466142:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dad24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466209:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466224:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466236:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466250:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466262:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466268:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466370:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466379:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466385:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758171.466419:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00000004:00200000:1.0:1782758171.466423:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758171.466441:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466451:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466459:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466465:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466471:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466481:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758171.466485:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466492:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466505:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:1.0:1782758171.466508:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758171.466513:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466519:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dad2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466533:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466538:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466544:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466549:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758171.466551:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466556:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466565:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9171a0e3a600) 00010000:00010000:1.0:1782758171.466567:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758171.466570:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466576:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dad32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466613:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dad24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b5c expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466626:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b5c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.466632:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff917191f75600) 00010000:00010000:1.0:1782758171.466634:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758171.466636:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758171.466751:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50409:x1869355196757376:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 653us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758171.466759:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 941 00000100:00100000:3.0:1782758171.473726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758171.473886:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196757504 00000100:00100000:1.0:1782758171.473896:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196757504 00000100:00100000:1.0:1782758171.473956:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 515 00000100:00100000:1.0:1782758171.473966:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196757504:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782758171.473985:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758171.474007:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b63 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758171.474039:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x6a42bb1a, atime: 0x6a42bb1a, ctime: 0x6a42bb1a, blocks: 0x1 00010000:00010000:1.0:1782758171.474059:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=2239s v=(0 0) 00010000:00010000:1.0:1782758171.474063:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758171.474071:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.474088:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.474101:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758171.474263:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196757504:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 297us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758171.474270:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 515 00000100:00100000:1.0:1782758171.489492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758171.489865:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196757760 00000100:00100000:0.0:1782758171.489875:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196757760 00000100:00100000:0.0:1782758171.489927:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 942 00000100:00100000:0.0:1782758171.489938:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50409:x1869355196757760:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:0.0:1782758171.489993:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758171.490022:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dad39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b5c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490045:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dad1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b55 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490055:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff917191f75600) 00010000:00010000:0.0:1782758171.490065:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758171.490087:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490100:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490108:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490122:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490129:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490135:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490238:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490251:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.490259:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758171.492261:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:0.0:1782758171.492275:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2239895451816ns, next at 2240895448625ns, rc = 0 00010000:00010000:0.0:1782758171.494080:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494101:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494112:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494120:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494126:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494133:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494160:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758171.494189:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494194:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494201:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494208:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.494211:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494218:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494229:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758171.494232:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758171.494236:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494242:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dad55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494262:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494268:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494274:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494279:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758171.494281:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494291:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494298:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758171.494300:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758171.494303:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758171.494308:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dad47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758171.494317:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd0fbce9 reply state 00000000542699ec transno 4294967664 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758171.494326:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758171.494607:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50409:x1869355196757760:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 4664us (5120us total) trans 4294967664 rc 0/0 00000100:00100000:0.0:1782758171.494616:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 942 00010000:00010000:1.0:1782758171.495447:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758171.495456:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.495465:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758171.495468:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.495477:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.495488:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:1.0:1782758171.495491:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758171.495495:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.495500:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dad5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758171.495519:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758171.495521:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758171.495522:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758171.527738:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527757:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527765:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527771:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758171.527776:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527784:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527801:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff91718bcfd000) 00010000:00010000:3.0:1782758171.527804:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758171.527809:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758171.527816:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dad4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758171.564239:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211597056:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758171.564380:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211597568:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758171.564433:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782758171.564439:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211596928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758171.564489:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211597440:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758171.564538:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597568 00000100:00100000:2.0:1782758171.564545:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597568 00000100:00100000:2.0:1782758171.564599:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1782758171.564612:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211597568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564664:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211597568:12345-0@lo:400:kworker.0 Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758171.564672:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1782758171.564693:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211596928 00000100:00100000:2.0:1782758171.564696:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211596928 00000100:00100000:2.0:1782758171.564721:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1782758171.564727:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211596928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.564757:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211596928:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758171.564763:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00080000:2.0:1782758171.564785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758171.565098:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211596928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.565114:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211597568:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.565139:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597056 00000100:00100000:2.0:1782758171.565143:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597056 00000100:00100000:2.0:1782758171.565166:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597440 00000100:00100000:2.0:1782758171.565168:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597440 00000100:00100000:2.0:1782758171.565190:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:2.0:1782758171.565196:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211597056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.565233:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211597056:12345-0@lo:400:kworker.0 Request processed in 37us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758171.565239:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:2.0:1782758171.565251:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:2.0:1782758171.565257:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211597440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.565282:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211597440:12345-0@lo:400:kworker.0 Request processed in 26us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758171.565288:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00080000:2.0:1782758171.565301:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758171.565319:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211597440:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.565329:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211597056:0@lo:400:kworker.0 00000100:00100000:3.0:1782758171.565477:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211597184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758171.565508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758171.565540:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758171.565546:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211597312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758171.565568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758171.565952:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597184 00000100:00100000:3.0:1782758171.565958:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597184 00000100:00100000:3.0:1782758171.565993:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:3.0:1782758171.566000:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211597184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758171.566038:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211597184:12345-0@lo:400:kworker.0 Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758171.566044:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00080000:3.0:1782758171.566060:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758171.566083:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211597184:0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.568238:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597312 00000100:00100000:2.0:1782758171.568248:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597312 00000100:00100000:2.0:1782758171.568323:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1782758171.568336:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211597312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758171.568436:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211597312:12345-0@lo:400:kworker.0 Request processed in 104us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758171.568443:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1782758171.568490:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211597312:0@lo:400:kworker.0 00000100:00080000:0.0:1782758171.568705:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782758171.662441:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000100:00100000:0.0:1782758172.076150:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758172.076174:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211597696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758172.076247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758172.076378:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597696 00000100:00100000:3.0:1782758172.076400:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597696 00000100:00100000:3.0:1782758172.076458:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1782758172.076467:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211597696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758172.076505:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758172.076566:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211597696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758172.076573:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:0.0:1782758172.076670:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211597696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758172.204132:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758173.132278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.132813:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196757888 00000100:00100000:3.0:1782758173.132851:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196757888 00000100:00100000:3.0:1782758173.132930:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00100000:3.0:1782758173.132943:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50428:x1869355196757888:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758173.132967:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758173.132988:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b6a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133053:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133068:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133081:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758173.133142:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1782758173.133147:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758173.133172:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133198:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b6a expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133220:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b6a expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.133228:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:3.0:1782758173.133231:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758173.133235:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758173.133309:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50428:x1869355196757888:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 370us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758173.133325:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00080000:1.0:1782758173.133605:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758173.141354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.141513:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758144 00000100:00100000:3.0:1782758173.141524:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758144 00000100:00100000:3.0:1782758173.141594:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 944 00000100:00100000:3.0:1782758173.141606:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50428:x1869355196758144:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758173.141680:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758173.141710:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b6a expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.141748:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dacec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b47 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.141759:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:3.0:1782758173.141779:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758173.141809:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.141844:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.141855:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758173.142121:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000603721b2 reply state 0000000097b6a2ec transno 4294967665 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758173.142131:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782758173.142146:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:3.0:1782758173.142243:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50428:x1869355196758144:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 638us (902us total) trans 4294967665 rc 0/0 00000100:00100000:3.0:1782758173.142251:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 944 00010000:00010000:3.0:1782758173.163748:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163766:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163773:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163780:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758173.163785:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163792:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163809:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758173.163812:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758173.163817:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.163838:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.232617:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758173.328290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758173.328379:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758272 00000100:00100000:0.0:1782758173.328390:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758272 00000100:00100000:0.0:1782758173.328452:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 945 00000100:00100000:0.0:1782758173.328464:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758272:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758173.328585:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758272:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758173.328594:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 945 00000100:00100000:0.0:1782758173.337037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.337202:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758400 00000100:00100000:2.0:1782758173.337212:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758400 00000100:00100000:2.0:1782758173.337292:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 516 00000100:00100000:2.0:1782758173.337316:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50440:x1869355196758400:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758173.337729:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50440:x1869355196758400:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 426us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.337737:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 516 00000100:00080000:1.0:1782758173.338372:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758173.339659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.339740:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758528 00000100:00100000:3.0:1782758173.339750:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758528 00000100:00100000:3.0:1782758173.339819:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 517 00000100:00100000:3.0:1782758173.339870:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50440:x1869355196758528:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:0.0:1782758173.340174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758173.340453:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50440:x1869355196758528:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 585us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758173.340461:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 517 00000100:00100000:3.0:1782758173.342585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.342684:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758656 00000100:00100000:2.0:1782758173.342694:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758656 00000100:00100000:2.0:1782758173.342750:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:2.0:1782758173.342761:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758656:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758173.343524:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758656:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 762us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.343539:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:0.0:1782758173.360238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.360342:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758784 00000100:00100000:3.0:1782758173.360354:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758784 00000100:00100000:3.0:1782758173.360416:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00100000:3.0:1782758173.360426:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758784:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758173.360534:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196758784:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758173.360542:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00100000:1.0:1782758173.366699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.366895:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196758912 00000100:00100000:2.0:1782758173.366906:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196758912 00000100:00100000:2.0:1782758173.366987:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 518 00000100:00100000:2.0:1782758173.366997:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50440:x1869355196758912:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758173.367413:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50440:x1869355196758912:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 416us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.367421:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 518 00000100:00100000:1.0:1782758173.373379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.373475:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759040 00000100:00100000:2.0:1782758173.373486:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759040 00000100:00100000:2.0:1782758173.373548:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 519 00000100:00100000:2.0:1782758173.373559:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50440:x1869355196759040:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758173.374172:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50440:x1869355196759040:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 613us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.374181:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 519 00000100:00100000:0.0:1782758173.392937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758173.393038:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759168 00000100:00100000:1.0:1782758173.393049:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759168 00000100:00100000:1.0:1782758173.393111:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 948 00000100:00100000:1.0:1782758173.393122:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196759168:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758173.393636:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50440:x1869355196759168:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 507us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758173.393646:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 948 00000100:00100000:2.0:1782758173.495212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.495380:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759296 00000100:00100000:3.0:1782758173.495391:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759296 00000100:00100000:3.0:1782758173.495459:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 949 00000100:00100000:3.0:1782758173.495471:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:50444:x1869355196759296:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782758173.495499:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758173.495525:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b71 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495607:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495809:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495862:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495880:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495888:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.495895:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496448:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496458:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496467:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758173.496495:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1782758173.496499:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758173.496527:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496545:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496551:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496558:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496564:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758173.496568:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496575:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496588:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:3.0:1782758173.496591:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758173.496595:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496602:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dad7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496614:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496952:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496957:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496963:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758173.496965:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496971:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.496989:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff917191f75f00) 00010000:00010000:3.0:1782758173.496992:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758173.496995:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.497000:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dad86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.497046:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dad78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b71 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.497060:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b71 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.497066:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758173.497068:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758173.497133:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:2.0:1782758173.499297:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50444:x1869355196759296:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 3815us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.499319:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 949 00000100:00100000:3.0:1782758173.505775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758173.506371:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759552 00000100:00100000:1.0:1782758173.506384:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759552 00000100:00100000:1.0:1782758173.506462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 950 00000100:00100000:1.0:1782758173.506474:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:50444:x1869355196759552:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:1.0:1782758173.506498:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758173.506522:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dad94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b78 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506675:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506692:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506704:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506719:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506726:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.506733:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758173.508137:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:1.0:1782758173.508344:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dada9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508359:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dada9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508370:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dada9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508415:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508421:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508427:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508433:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758173.508437:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508445:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508457:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75700) 00010000:00010000:1.0:1782758173.508461:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758173.508465:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508470:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dad9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758173.508483:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050223c0d reply state 00000000be9f02df transno 4294967666 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758173.508492:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758173.508523:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dad94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b78 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508541:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dada9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b78 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.508548:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758173.508550:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758173.508553:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758173.508623:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+15:50444:x1869355196759552:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 2150us (2858us total) trans 4294967666 rc 0/0 00000100:00100000:1.0:1782758173.508632:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 950 00010000:00010000:3.0:1782758173.511999:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512018:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512026:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512041:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758173.512046:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512055:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512081:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9171a0e3ad00) 00010000:00010000:3.0:1782758173.512085:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758173.512091:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.512097:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dada2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758173.519973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.520387:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759680 00000100:00100000:2.0:1782758173.520397:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759680 00000100:00100000:2.0:1782758173.520454:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 520 00000100:00100000:2.0:1782758173.520464:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50444:x1869355196759680:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758173.520485:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758173.520506:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b7f expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758173.520532:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782758173.520554:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=2241s v=(0 0) 00010000:00010000:2.0:1782758173.520560:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758173.520569:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758173.520586:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758173.520599:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758173.520676:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50444:x1869355196759680:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 213us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758173.520683:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 520 00000100:00100000:0.0:1782758173.571728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.571886:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759808 00000100:00100000:2.0:1782758173.571898:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759808 00002000:00100000:2.0:1782758173.571960:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff917082b4ea00 x1869355196759808/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:89/0 lens 488/0 e 0 to 0 dl 1782758184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782758173.571973:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4ea00 with x1869355196759808 ext(0->1048575) 00002000:00010000:2.0:1782758173.571992:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917082b4ea00 00000100:00100000:2.0:1782758173.572030:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:2.0:1782758173.572041:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196759808:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:2.0:1782758173.614238:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196759808:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 42186us (42507us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1782758173.614256:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00002000:00100000:2.0:1782758173.614270:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff917082b4ea00 x1869355196759808/t4294967356(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:89/0 lens 488/448 e 0 to 0 dl 1782758184 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782758173.614282:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4ea00 with x1869355196759808 ext(0->1048575) 00002000:00010000:2.0:1782758173.614289:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917082b4ea00 00000100:00100000:0.0:1782758173.620694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758173.621450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196759936 00000100:00100000:2.0:1782758173.621460:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196759936 00000100:00100000:2.0:1782758173.621536:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 951 00000100:00100000:2.0:1782758173.621547:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+14:50444:x1869355196759936:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:1.0:1782758173.705280:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967664 is committed 00000004:00080000:1.0:1782758173.705292:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00000001:00080000:1.0:1782758173.705320:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967666 is committed 00000100:00100000:1.0:1782758173.705512:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211597824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782758173.705576:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758173.705921:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50444:x1869355196759936:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 84372us (85231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758173.705932:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 951 00000100:00100000:0.0:1782758173.705938:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211597824 00000100:00100000:0.0:1782758173.705946:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211597824 00000100:00100000:0.0:1782758173.706015:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1782758173.706024:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211597824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782758173.706049:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:0.0:1782758173.706074:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758173.708640:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758173.708660:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782758173.708665:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758173.708670:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758173.708733:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758173.708757:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 5 pid: 6597 timeout: 2342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758173.708966:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211597952:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758173.709069:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643f00 going to sleep for 11 seconds 00000100:00080000:0.0:1782758173.709091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758173.709206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758173.711471:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760064 00000100:00100000:0.0:1782758173.711485:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760064 00000100:00100000:0.0:1782758173.711545:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:0.0:1782758173.711555:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196760064:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:0.0:1782758173.712255:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211597952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758173.712282:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758173.713374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758173.713732:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760192 00000100:00100000:3.0:1782758173.713741:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760192 00010000:00010000:3.0:1782758173.713780:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 6 pid: 6597 timeout: 2342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758173.713850:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 391 00000100:00100000:3.0:1782758173.713861:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196760192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758173.713876:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758173.713883:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 6 pid: 6597 timeout: 2342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.713897:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 6 pid: 6597 timeout: 2342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.713922:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dad40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b63 expref: 6 pid: 6597 timeout: 2342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.713939:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758173.713943:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758173.713950:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.713960:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758173.716043:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758173.716138:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758173.716189:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196760192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2324us (2815us total) trans 0 rc 0/0 00010000:00010000:3.0:1782758173.717288:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.717342:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.717351:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758173.717367:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758173.718573:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758173.718585:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.718596:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758173.718600:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.718622:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.718649:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.718656:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044ad0b2c/0xdd99f5c4777dadbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758173.718679:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758173.718680:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758173.718682:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758173.719642:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211597824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13613us (14061us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1782758173.719654:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000004:00080000:1.0:1782758173.720154:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082b4d180/2, rc 0, transno 4294967357 00000100:00100000:1.0:1782758173.720164:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211597824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782758173.722210:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 391 00000001:00080000:1.0:1782758173.782842:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000100:00100000:0.0:1782758173.782843:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196760064:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 71258us (73606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758173.782857:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:3.0:1782758173.787519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758173.794964:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760448 00000100:00100000:1.0:1782758173.794980:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760448 00000100:00100000:1.0:1782758173.795044:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:1.0:1782758173.795055:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50444:x1869355196760448:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:1.0:1782758173.795582:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50444:x1869355196760448:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 527us (8070us total) trans 4294967667 rc 0/0 00000100:00100000:1.0:1782758173.795591:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 97 00010000:00010000:0.0:1782758174.253256:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758174.638329:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758174.638356:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211598080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758174.638427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758174.638561:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598080 00000100:00100000:0.0:1782758174.638570:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598080 00000100:00100000:0.0:1782758174.638634:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1782758174.638644:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211598080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758174.638685:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758174.638748:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211598080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758174.638756:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1782758174.638887:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211598080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758175.276411:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758175.928044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758175.928092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758175.928220:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760704 00000100:00100000:2.0:1782758175.928235:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760704 00000100:00100000:2.0:1782758175.928330:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1589 00000100:00100000:2.0:1782758175.928347:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196760704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758175.928450:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196760704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 109us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758175.928459:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1589 00000100:00080000:1.0:1782758175.928643:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758175.929493:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760960 00000100:00100000:3.0:1782758175.929501:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760960 00000100:00100000:3.0:1782758175.929610:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00100000:3.0:1782758175.929620:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196760960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758175.929687:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196760960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758175.929694:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00080000:1.0:1782758175.929794:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758175.930134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758175.930198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758175.930330:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760832 00000100:00100000:0.0:1782758175.930335:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760832 00000100:00100000:0.0:1782758175.930384:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1215 00000100:00100000:0.0:1782758175.930392:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196760832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758175.930431:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196760832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758175.930438:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1215 00000100:00080000:2.0:1782758175.930501:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758175.932488:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196760576 00000100:00100000:1.0:1782758175.932502:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196760576 00000100:00100000:1.0:1782758175.932564:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000100:00100000:1.0:1782758175.932575:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196760576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758175.932683:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196760576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 109us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758175.932692:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000001:00080000:0.0:1782758175.970092:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967667 is committed 00010000:00010000:0.0:1782758176.305895:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758176.691180:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211598592:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691387:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758176.691395:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211598208:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691462:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211598720:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691526:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211598336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691568:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211598848:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691611:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758176.691617:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211598464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758176.691678:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598208 00000100:00100000:1.0:1782758176.691688:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598208 00000100:00100000:1.0:1782758176.691748:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1782758176.691760:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211598208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.691870:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211598208:12345-0@lo:400:kworker.0 Request processed in 64us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758176.691877:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1782758176.691956:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211598208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758176.693464:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598720 00000100:00100000:0.0:1782758176.693478:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598720 00000100:00100000:0.0:1782758176.693545:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598336 00000100:00100000:0.0:1782758176.693549:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598336 00000100:00100000:0.0:1782758176.693591:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598464 00000100:00100000:0.0:1782758176.693594:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598464 00000100:00100000:0.0:1782758176.693616:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1782758176.693626:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211598720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758176.693735:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211598720:12345-0@lo:400:kworker.0 Request processed in 109us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758176.693743:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1782758176.693762:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1782758176.693768:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211598336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758176.693804:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211598336:12345-0@lo:400:kworker.0 Request processed in 36us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758176.693812:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1782758176.693855:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1782758176.693863:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211598464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758176.693896:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211598464:12345-0@lo:400:kworker.0 Request processed in 34us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758176.693902:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00080000:0.0:1782758176.693932:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758176.694093:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211598720:0@lo:400:kworker.0 00000100:00100000:3.0:1782758176.694694:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598592 00000100:00100000:3.0:1782758176.694701:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598592 00000100:00100000:3.0:1782758176.694759:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598848 00000100:00100000:3.0:1782758176.694762:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598848 00000100:00100000:3.0:1782758176.694801:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1782758176.694811:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211598592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758176.694898:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211598592:12345-0@lo:400:kworker.0 Request processed in 89us (3602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758176.694905:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1782758176.694929:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1782758176.694945:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211598848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758176.694975:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211598848:12345-0@lo:400:kworker.0 Request processed in 40us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758176.694981:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1782758176.696280:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211598464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.696303:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211598336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758176.696319:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211598848:0@lo:400:kworker.0 00000100:00080000:0.0:1782758176.696539:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758176.696546:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758176.696590:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211598592:0@lo:400:kworker.0 00000001:00080000:1.0:1782758176.848359:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:2.0:1782758177.202419:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211598976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758177.202502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758177.202587:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211598976 00000100:00100000:2.0:1782758177.202597:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211598976 00000100:00100000:2.0:1782758177.202653:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1782758177.202661:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211598976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758177.202699:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782758177.202745:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211598976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758177.202753:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1782758177.202807:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211598976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758177.324014:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758177.475343:0:85587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2245878517267ns, next at 2240895448625ns, rc = 0 00000004:00080000:0.0:1782758177.475486:0:85587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2245878662305ns, next at 2220693724643ns, rc = 0 00000004:00080000:3.0:1782758177.477444:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000004:00080000:3.0:1782758177.477468:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00010000:00010000:0.0:1782758178.353051:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758179.373586:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758179.436613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758179.436737:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761088 00000100:00100000:0.0:1782758179.436747:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761088 00000100:00100000:0.0:1782758179.436852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 952 00000100:00100000:0.0:1782758179.436863:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761088:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758179.436969:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761088:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758179.436977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 952 00000100:00080000:2.0:1782758179.437348:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758179.449211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758179.449302:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761216 00000100:00100000:2.0:1782758179.449314:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761216 00000100:00100000:2.0:1782758179.449393:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 523 00000100:00100000:2.0:1782758179.449406:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50637:x1869355196761216:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758179.449746:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50637:x1869355196761216:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 343us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758179.449753:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 523 00000100:00080000:2.0:1782758179.449774:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758179.454873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758179.454909:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761344 00000100:00100000:3.0:1782758179.454919:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761344 00000100:00100000:3.0:1782758179.454980:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 524 00000100:00100000:3.0:1782758179.454990:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50637:x1869355196761344:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758179.455753:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50637:x1869355196761344:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 761us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758179.455762:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 524 00000100:00080000:3.0:1782758179.455790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758179.459854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758179.459899:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761472 00000100:00100000:3.0:1782758179.459909:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761472 00000100:00100000:3.0:1782758179.459968:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 953 00000100:00100000:3.0:1782758179.459978:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761472:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758179.462961:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761472:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2973us (3132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758179.462977:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 953 00000100:00100000:3.0:1782758179.472139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758179.475409:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761600 00000100:00100000:0.0:1782758179.475425:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761600 00000100:00100000:0.0:1782758179.475492:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 954 00000100:00100000:0.0:1782758179.475503:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761600:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758179.475641:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761600:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 139us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758179.475649:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 954 00000100:00100000:3.0:1782758179.491724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758179.491859:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761728 00000100:00100000:1.0:1782758179.491870:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761728 00000100:00100000:1.0:1782758179.491932:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:1.0:1782758179.491943:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50637:x1869355196761728:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758179.492364:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50637:x1869355196761728:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 421us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758179.492373:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:1.0:1782758179.499256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758179.499341:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761856 00000100:00100000:3.0:1782758179.499352:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761856 00000100:00100000:3.0:1782758179.499420:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 526 00000100:00100000:3.0:1782758179.499431:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50637:x1869355196761856:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758179.499784:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:50637:x1869355196761856:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 352us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758179.499792:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 526 00000100:00100000:0.0:1782758179.506412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758179.506494:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196761984 00000100:00100000:1.0:1782758179.506506:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196761984 00000100:00100000:1.0:1782758179.506561:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 955 00000100:00100000:1.0:1782758179.506573:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761984:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758179.507089:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50637:x1869355196761984:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 515us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758179.507098:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 955 00000100:00100000:2.0:1782758179.670623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758179.670889:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762240 00000100:00100000:3.0:1782758179.670900:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762240 00000100:00100000:3.0:1782758179.670966:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 956 00000100:00100000:3.0:1782758179.670977:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50641:x1869355196762240:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782758179.671035:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758179.671066:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dada9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b78 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671086:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:3.0:1782758179.671107:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758179.671132:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671148:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671159:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671204:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671212:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.671217:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.678375:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.678396:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.678407:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758179.685121:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:2.0:1782758179.685141:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2248088317479ns, next at 2249088313179ns, rc = 0 00010000:00010000:2.0:1782758179.685302:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685321:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685336:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685347:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685354:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685361:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685395:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758179.685431:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685438:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685447:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685454:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758179.685460:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685462:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758179.685470:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685472:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685494:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758179.685496:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782758179.685500:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758179.685505:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685506:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685523:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685525:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dadd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685546:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff917182dd1900) 00010000:00010000:1.0:1782758179.685550:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758179.685553:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685559:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dadda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685560:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685573:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685579:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758179.685581:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758179.685583:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758179.685586:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758179.685591:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758179.685594:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685604:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685613:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75700) 00010000:00010000:2.0:1782758179.685616:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758179.685619:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758179.685625:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dadc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758179.685636:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d542b45a reply state 00000000a0482749 transno 4294967668 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758179.685647:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758179.685761:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50641:x1869355196762240:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 14767us (15128us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1782758179.685771:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 956 00010000:00010000:3.0:1782758179.692588:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692606:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692615:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692620:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758179.692625:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692632:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692648:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff917191f75900) 00010000:00010000:3.0:1782758179.692652:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758179.692656:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758179.692662:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dadcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758179.756127:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758179.756149:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211599104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758179.756229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758179.756285:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599104 00000100:00100000:1.0:1782758179.756295:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599104 00000100:00100000:1.0:1782758179.756391:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1782758179.756402:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211599104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758179.756443:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758179.756497:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211599104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758179.756506:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1782758179.756555:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:0.0:1782758179.756566:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082b4d180, transno 4294967357 00000100:00100000:0.0:1782758179.756594:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211599104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758179.756862:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758180.397374:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758181.046874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758181.046915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758181.046950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758181.046968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758181.046996:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762368 00000100:00100000:2.0:1782758181.047005:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762368 00000100:00100000:2.0:1782758181.047055:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1252 00000100:00100000:2.0:1782758181.047066:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196762368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758181.047135:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196762368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758181.047143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1252 00000100:00100000:2.0:1782758181.047187:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762752 00000100:00100000:2.0:1782758181.047191:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762752 00000100:00100000:2.0:1782758181.047219:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762624 00000100:00100000:2.0:1782758181.047222:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762624 00000100:00100000:2.0:1782758181.047242:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:2.0:1782758181.047249:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196762752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758181.047277:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196762752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758181.047284:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:2.0:1782758181.047296:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1219 00000100:00100000:2.0:1782758181.047301:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196762624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758181.047326:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196762624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758181.047332:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1219 00000100:00080000:2.0:1782758181.047349:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758181.047353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758181.049515:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762496 00000100:00100000:3.0:1782758181.049532:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762496 00000100:00100000:3.0:1782758181.049615:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1593 00000100:00100000:3.0:1782758181.049626:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196762496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758181.049704:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196762496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758181.049711:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1593 00000100:00080000:2.0:1782758181.050538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758181.420210:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758181.808750:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211599232:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.808853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.808913:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211599744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.808939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.808964:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758181.808969:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211599616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.808993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.809020:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211599360:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.809059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211599872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.809098:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758181.809103:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211599488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758181.809166:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599232 00000100:00100000:0.0:1782758181.809174:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599232 00000100:00100000:0.0:1782758181.809222:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1782758181.809230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211599232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809282:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211599232:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809290:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1782758181.809323:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599616 00000100:00100000:0.0:1782758181.809327:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599616 00000100:00100000:0.0:1782758181.809364:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599872 00000100:00100000:0.0:1782758181.809366:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599872 00000100:00100000:0.0:1782758181.809384:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1782758181.809389:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211599616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809421:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211599616:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809427:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1782758181.809438:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1782758181.809443:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211599872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809472:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211599872:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809478:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1782758181.809493:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599744 00000100:00100000:0.0:1782758181.809496:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599744 00000100:00100000:0.0:1782758181.809516:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599360 00000100:00100000:0.0:1782758181.809519:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599360 00000100:00100000:0.0:1782758181.809533:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211599488 00000100:00100000:0.0:1782758181.809535:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211599488 00000100:00100000:0.0:1782758181.809548:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1782758181.809555:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211599744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809584:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211599744:12345-0@lo:400:kworker.0 Request processed in 30us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809590:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1782758181.809600:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1782758181.809605:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809631:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211599360:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809637:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1782758181.809647:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1782758181.809653:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211599488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809678:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211599488:12345-0@lo:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758181.809683:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00080000:0.0:1782758181.809708:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758181.809713:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758181.809715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758181.809747:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211599488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809758:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211599360:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809766:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211599872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809797:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211599616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809805:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211599232:0@lo:400:kworker.0 00000100:00100000:0.0:1782758181.809814:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211599744:0@lo:400:kworker.0 00000004:00080000:3.0:1782758182.327176:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2250730350790ns, next at 2251730348730ns, rc = 0 00000100:00100000:0.0:1782758182.331504:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211600000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758182.331584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758182.337516:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600000 00000100:00100000:3.0:1782758182.337535:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600000 00000100:00100000:3.0:1782758182.340969:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1782758182.341007:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211600000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758182.341053:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758182.341162:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211600000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (9578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758182.341170:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1782758182.341342:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211600000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758182.447607:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758182.923200:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000004:00080000:2.0:1782758182.923212:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000004:00080000:2.0:1782758182.923241:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000100:00100000:0.0:1782758182.924138:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758182.924161:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782758182.924231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758182.924443:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600128 00000100:00100000:2.0:1782758182.924451:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600128 00000100:00100000:2.0:1782758182.924504:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1782758182.924514:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211600128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782758182.924543:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:30 count 1 00010000:00010000:2.0:1782758182.924567:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.924590:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.924599:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1782758182.924604:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758182.924609:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.924653:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 5 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.924667:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 5 pid: 6598 timeout: 2351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758182.924678:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211600256:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758182.924746:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1782758182.932846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758182.932881:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196762880 00000100:00100000:2.0:1782758182.932889:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196762880 00010000:00010000:2.0:1782758182.932934:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 6 pid: 6598 timeout: 2351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758182.932974:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 392 00000100:00100000:2.0:1782758182.932984:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196762880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758182.932998:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758182.933004:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 6 pid: 6598 timeout: 2351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.933017:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 6 pid: 6598 timeout: 2351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.933043:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758182.933048:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758182.933054:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.933064:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758182.933086:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758182.933147:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196762880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 164us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758182.933156:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 392 00010000:00010000:1.0:1782758182.933876:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dadb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b7f expref: 5 pid: 6598 timeout: 2351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758182.933892:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211600256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782758182.933913:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758182.933930:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758182.933938:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758182.933948:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758182.933956:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758182.933983:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758182.934530:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211600128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10016us (10298us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1782758182.934538:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:3.0:1782758182.934748:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758182.934755:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758182.934765:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758182.934769:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758182.934780:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758182.934796:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758182.934804:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dade1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758182.934846:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758182.934848:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758182.934850:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758182.935067:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91708220ad80/2, rc 0, transno 4294967357 00000100:00100000:2.0:1782758182.935075:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600128:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782758183.468846:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758183.503635:0:85732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2251906810359ns, next at 2240895448625ns, rc = 0 00000004:00080000:1.0:1782758183.503789:0:85732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2251906965574ns, next at 2251730348730ns, rc = 0 00000004:00080000:2.0:1782758183.510001:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:2.0:1782758183.510029:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00000001:00080000:3.0:1782758184.469267:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:0.0:1782758184.492010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758184.888876:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758184.888982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758184.893352:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600384 00000100:00100000:3.0:1782758184.893369:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600384 00000100:00080000:2.0:1782758184.893423:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758184.893456:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1782758184.893467:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211600384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758184.893506:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758184.893591:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211600384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758184.893599:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:0.0:1782758184.893701:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758185.526931:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758186.168611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758186.168652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758186.168802:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763008 00000100:00100000:2.0:1782758186.168811:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763008 00000100:00100000:2.0:1782758186.168890:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00100000:2.0:1782758186.168901:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196763008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758186.168976:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196763008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758186.168984:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00100000:3.0:1782758186.185927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758186.186032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758186.186118:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763136 00000100:00100000:1.0:1782758186.186128:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763136 00000100:00100000:1.0:1782758186.186199:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1597 00000100:00100000:1.0:1782758186.186210:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196763136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758186.186290:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196763136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758186.186298:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1597 00000100:00080000:2.0:1782758186.188168:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758186.205240:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763264 00000100:00100000:0.0:1782758186.205255:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763264 00000100:00100000:0.0:1782758186.205350:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00100000:0.0:1782758186.205367:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196763264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758186.205443:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196763264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (36790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758186.205450:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00080000:2.0:1782758186.208235:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758186.209213:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763392 00000100:00100000:0.0:1782758186.209225:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763392 00000100:00100000:0.0:1782758186.209300:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1223 00000100:00100000:0.0:1782758186.209311:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196763392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758186.209393:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196763392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (23360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758186.209401:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1223 00000100:00080000:2.0:1782758186.209597:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758186.544587:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758186.947577:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211600512:0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.947668:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211600640:0@lo:400:kworker.0 00000100:00100000:3.0:1782758186.947726:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211600768:0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.959540:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.959618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758186.959712:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600896 00000100:00100000:1.0:1782758186.959721:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600896 00000100:00100000:1.0:1782758186.959775:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1782758186.959783:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211600896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.959872:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211600896:12345-0@lo:400:kworker.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758186.959880:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:1.0:1782758186.959901:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758186.959930:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211600896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758186.969007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758186.969143:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600768 00000100:00100000:1.0:1782758186.969153:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600768 00000100:00100000:1.0:1782758186.969221:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:1.0:1782758186.969231:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211600768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.969292:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211600768:12345-0@lo:400:kworker.0 Request processed in 62us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758186.969299:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:2.0:1782758186.969927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758186.969962:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211601152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758186.969994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782758186.970188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758186.970205:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600640 00000100:00100000:3.0:1782758186.970211:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600640 00000100:00100000:3.0:1782758186.970247:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1782758186.970255:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211600640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758186.970309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211600640:12345-0@lo:400:kworker.0 Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758186.970318:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1782758186.970363:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211600768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758186.970397:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211600640:0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.970506:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601152 00000100:00100000:1.0:1782758186.970511:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601152 00000100:00100000:1.0:1782758186.970555:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1782758186.970563:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211601152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758186.970611:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211601152:12345-0@lo:400:kworker.0 Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758186.970618:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00080000:1.0:1782758186.970635:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758186.970653:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:1.0:1782758186.970659:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91708220ad80, transno 4294967357 00000100:00100000:1.0:1782758186.970670:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211601152:0@lo:400:kworker.0 00000100:00100000:0.0:1782758186.988265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758186.988417:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211601024:0@lo:400:kworker.0 00000100:00100000:0.0:1782758186.988724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758186.989144:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211600512 00000100:00100000:2.0:1782758186.989152:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211600512 00000100:00100000:2.0:1782758186.989200:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1782758186.989209:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211600512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758186.989268:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211600512:12345-0@lo:400:kworker.0 Request processed in 60us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758186.989276:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1782758186.989353:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601024 00000100:00100000:3.0:1782758186.989358:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601024 00000100:00100000:3.0:1782758186.989407:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1782758186.989413:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211601024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758186.989450:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211601024:12345-0@lo:400:kworker.0 Request processed in 38us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758186.989457:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00080000:2.0:1782758186.989585:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758186.989659:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211600512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758186.989672:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211601024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758187.457361:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211601280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758187.457442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758187.457612:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601280 00000100:00100000:3.0:1782758187.457620:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601280 00000100:00100000:3.0:1782758187.457689:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1782758187.457699:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211601280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758187.457735:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758187.457788:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211601280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758187.457795:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1782758187.457873:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211601280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758187.568121:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758188.590552:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758189.621236:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758189.996484:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211601408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758189.996612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758189.997152:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601408 00000100:00100000:2.0:1782758189.997162:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601408 00000100:00100000:2.0:1782758189.997238:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1782758189.997269:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211601408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758189.997321:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758189.997410:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211601408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758189.997417:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00080000:1.0:1782758189.997691:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758189.997738:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211601408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758190.636296:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758191.288762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758191.289061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758191.289102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758191.289136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758191.289225:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763904 00000100:00100000:1.0:1782758191.289237:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763904 00000100:00100000:1.0:1782758191.289320:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763776 00000100:00100000:1.0:1782758191.289324:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763776 00000100:00100000:1.0:1782758191.289352:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:1.0:1782758191.289361:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196763904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758191.289438:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196763904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758191.289446:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:1.0:1782758191.289466:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1227 00000100:00100000:1.0:1782758191.289473:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196763776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758191.289499:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196763776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758191.289506:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1227 00000100:00100000:2.0:1782758191.290434:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763520 00000100:00100000:2.0:1782758191.290441:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763520 00000100:00100000:2.0:1782758191.290479:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1256 00000100:00100000:2.0:1782758191.290487:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196763520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758191.290518:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196763520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758191.290524:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1256 00000100:00080000:2.0:1782758191.290565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758191.290570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758191.290926:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196763648 00000100:00100000:0.0:1782758191.290931:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196763648 00000100:00100000:0.0:1782758191.290989:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1601 00000100:00100000:0.0:1782758191.290996:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196763648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758191.291029:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196763648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758191.291035:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1601 00000100:00080000:2.0:1782758191.291556:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758191.661137:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758192.046715:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211601536:0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.046806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758192.048089:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211602048:0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.048129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758192.048162:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758192.048169:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211601664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.048193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758192.048210:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211602176:0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.048235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758192.048335:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602048 00000100:00100000:1.0:1782758192.048345:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602048 00000100:00100000:0.0:1782758192.048350:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601536 00000100:00100000:0.0:1782758192.048357:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601536 00000100:00100000:1.0:1782758192.048406:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601664 00000100:00100000:1.0:1782758192.048411:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601664 00000100:00100000:0.0:1782758192.048411:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1782758192.048426:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211601536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.048440:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:1.0:1782758192.048448:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211602048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758192.048505:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211601536:12345-0@lo:400:kworker.0 Request processed in 83us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758192.048513:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1782758192.048563:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:3.0:1782758192.048573:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758192.048594:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602176 00000100:00100000:0.0:1782758192.048598:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602176 00000100:00100000:0.0:1782758192.048628:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1782758192.048635:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211602176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758192.051115:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758192.051125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758192.051282:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211601792:0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.051477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758192.051526:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758192.051533:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211601920:0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.051558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758192.052461:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601792 00000100:00100000:2.0:1782758192.052470:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601792 00000100:00100000:2.0:1782758192.052525:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:2.0:1782758192.052533:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211601792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.054903:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211601792:12345-0@lo:400:kworker.0 Request processed in 2360us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758192.054921:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:2.0:1782758192.055018:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211601792:0@lo:400:kworker.0 00000100:00080000:2.0:1782758192.055053:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758192.055102:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211601920 00000100:00100000:2.0:1782758192.055109:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211601920 00000100:00100000:2.0:1782758192.055154:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1782758192.055163:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211601920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.055227:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211601920:12345-0@lo:400:kworker.0 Request processed in 66us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758192.055234:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1782758192.055261:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211601920:0@lo:400:kworker.0 00000100:00080000:2.0:1782758192.055277:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758192.056295:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211601664:12345-0@lo:400:kworker.0 Request processed in 7718us (8094us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758192.056306:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:2.0:1782758192.059978:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211601664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758192.064959:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211602048:12345-0@lo:400:kworker.0 Request processed in 16488us (16805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758192.064978:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:0.0:1782758192.065160:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211602176:12345-0@lo:400:kworker.0 Request processed in 16523us (16921us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758192.065170:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1782758192.067373:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211602176:0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.067392:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211601536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.067404:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211602048:0@lo:400:kworker.0 00000100:00100000:2.0:1782758192.556422:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211602304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758192.556496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758192.556692:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602304 00000100:00100000:0.0:1782758192.556701:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602304 00000100:00100000:0.0:1782758192.556757:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1782758192.556767:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211602304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758192.556805:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758192.556882:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211602304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758192.556890:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1782758192.556948:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211602304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758192.690541:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758193.711649:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758194.737521:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758195.116152:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758195.116176:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211602432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758195.116248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758195.116413:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602432 00000100:00100000:3.0:1782758195.116421:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602432 00000100:00100000:3.0:1782758195.116490:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1782758195.116500:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211602432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758195.116536:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758195.116587:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211602432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758195.116594:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1782758195.116637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211602432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758195.116889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758195.759532:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758196.407593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758196.407637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758196.407674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758196.407703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758196.407728:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764160 00000100:00100000:1.0:1782758196.407737:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764160 00000100:00100000:1.0:1782758196.407794:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1605 00000100:00100000:1.0:1782758196.407804:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196764160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758196.407897:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196764160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758196.407904:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1605 00000100:00080000:1.0:1782758196.407927:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758196.408180:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764288 00000100:00100000:3.0:1782758196.408185:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764288 00000100:00100000:3.0:1782758196.408229:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764416 00000100:00100000:3.0:1782758196.408232:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764416 00000100:00100000:3.0:1782758196.408251:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:3.0:1782758196.408258:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196764288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758196.408287:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196764288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758196.408293:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:3.0:1782758196.408306:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1231 00000100:00100000:3.0:1782758196.408312:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196764416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758196.408334:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196764416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758196.408340:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1231 00000100:00100000:2.0:1782758196.410438:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764032 00000100:00100000:2.0:1782758196.410450:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764032 00000100:00100000:2.0:1782758196.410511:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00100000:2.0:1782758196.410521:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196764032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758196.410579:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196764032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758196.410590:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00080000:1.0:1782758196.415619:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758196.415628:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758196.780351:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758197.164590:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211602944:0@lo:400:kworker.0 00000100:00100000:3.0:1782758197.164658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.164934:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211602560:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.164976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.165042:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211603072:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.165095:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758197.165100:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211602688:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.165136:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211603200:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165175:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602560 00000100:00100000:2.0:1782758197.165182:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602560 00000100:00100000:2.0:1782758197.165226:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1782758197.165234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211602560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165281:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211602560:12345-0@lo:400:kworker.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758197.165288:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1782758197.165333:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603072 00000100:00100000:2.0:1782758197.165337:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603072 00000100:00100000:2.0:1782758197.165364:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602688 00000100:00100000:2.0:1782758197.165366:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602688 00000100:00100000:2.0:1782758197.165383:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1782758197.165388:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211603072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165419:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211603072:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758197.165425:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1782758197.165436:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1782758197.165442:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211602688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.165464:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211602688:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758197.165469:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00080000:2.0:1782758197.165482:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758197.165785:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211602816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758197.165814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758197.166288:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602944 00000100:00100000:0.0:1782758197.166294:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602944 00000100:00100000:0.0:1782758197.166340:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1782758197.166348:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211602944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758197.166384:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211602944:12345-0@lo:400:kworker.0 Request processed in 38us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758197.166407:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1782758197.166550:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211602816 00000100:00100000:1.0:1782758197.166555:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211602816 00000100:00100000:1.0:1782758197.166592:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1782758197.166598:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211602816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758197.166636:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211602816:12345-0@lo:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758197.166641:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1782758197.166684:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211602816:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.170025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.170096:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211602560:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.170113:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211603072:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.170137:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211602688:0@lo:400:kworker.0 00000100:00100000:0.0:1782758197.170272:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603200 00000100:00100000:0.0:1782758197.170280:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603200 00000100:00100000:0.0:1782758197.170340:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1782758197.170350:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211603200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758197.170427:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211603200:12345-0@lo:400:kworker.0 Request processed in 78us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758197.170434:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:3.0:1782758197.170697:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758197.170702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758197.170705:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758197.170731:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211602944:0@lo:400:kworker.0 00000100:00100000:2.0:1782758197.174964:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211603200:0@lo:400:kworker.0 00000100:00100000:0.0:1782758197.676319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758197.676350:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211603328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758197.676427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758197.676680:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603328 00000100:00100000:2.0:1782758197.676688:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603328 00000100:00100000:2.0:1782758197.676740:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1782758197.676749:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211603328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758197.676785:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758197.676870:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211603328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758197.676877:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1782758197.677052:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211603328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758197.808855:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758198.738475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758198.738666:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764544 00000100:00100000:2.0:1782758198.738677:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764544 00000100:00100000:2.0:1782758198.739065:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00100000:2.0:1782758198.739080:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196764544:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758198.739194:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196764544:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 120us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758198.739205:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00080000:3.0:1782758198.739851:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758198.746356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.746918:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764672 00000100:00100000:0.0:1782758198.746928:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764672 00000100:00080000:2.0:1782758198.746967:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758198.747008:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 528 00000100:00100000:0.0:1782758198.747018:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196764672:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758198.750006:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196764672:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 2980us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758198.750020:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 528 00000100:00100000:1.0:1782758198.757525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758198.757573:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764800 00000100:00100000:1.0:1782758198.757581:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764800 00000100:00100000:1.0:1782758198.757637:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 529 00000100:00100000:1.0:1782758198.757646:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196764800:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758198.758424:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196764800:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 776us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758198.758433:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 529 00000100:00080000:1.0:1782758198.758603:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758198.767434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758198.767548:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196764928 00000100:00100000:1.0:1782758198.767558:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196764928 00000100:00100000:1.0:1782758198.767606:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 958 00000100:00100000:1.0:1782758198.767616:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196764928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758198.768062:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196764928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 446us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758198.768071:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 958 00000100:00100000:0.0:1782758198.783333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.783371:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765056 00000100:00100000:0.0:1782758198.783380:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765056 00000100:00100000:0.0:1782758198.783428:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 959 00000100:00100000:0.0:1782758198.783438:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196765056:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758198.783535:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196765056:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758198.783542:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 959 00000100:00100000:0.0:1782758198.789434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758198.806308:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765184 00000100:00100000:3.0:1782758198.806323:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765184 00000100:00100000:3.0:1782758198.806374:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 530 00000100:00100000:3.0:1782758198.806383:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196765184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758198.806777:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196765184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 393us (17350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758198.806785:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 530 00000100:00100000:0.0:1782758198.836837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.836878:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765312 00000100:00100000:0.0:1782758198.836954:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765312 00000100:00100000:0.0:1782758198.837010:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 531 00000100:00100000:0.0:1782758198.837022:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196765312:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758198.837441:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:50819:x1869355196765312:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 420us (637us total) trans 0 rc 0/0 00010000:00010000:1.0:1782758198.838124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758198.839072:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 531 00000100:00100000:0.0:1782758198.845167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758198.847902:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765440 00000100:00100000:1.0:1782758198.847914:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765440 00000100:00100000:1.0:1782758198.847980:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 960 00000100:00100000:1.0:1782758198.847991:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196765440:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758198.848964:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50819:x1869355196765440:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 972us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758198.848973:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 960 00000100:00100000:3.0:1782758198.903253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.903347:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765568 00000100:00100000:0.0:1782758198.903358:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765568 00000100:00100000:0.0:1782758198.903419:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 961 00000100:00100000:0.0:1782758198.903432:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:50820:x1869355196765568:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758198.903455:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758198.903506:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dade8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b86 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.903591:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.903606:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.903623:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758198.904358:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1782758198.904366:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758198.904454:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.904483:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dade8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b86 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.904498:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b86 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.904506:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75700) 00010000:00010000:0.0:1782758198.904509:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758198.904512:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758198.904640:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50820:x1869355196765568:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1210us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758198.904648:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 961 00000100:00100000:0.0:1782758198.912076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.912124:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765824 00000100:00100000:0.0:1782758198.912134:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765824 00000100:00100000:0.0:1782758198.912187:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 962 00000100:00100000:0.0:1782758198.912197:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:50820:x1869355196765824:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758198.912217:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758198.912237:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dadf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b8d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758198.915261:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00010000:0.0:1782758198.915737:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dadf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b8d expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.915754:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758198.915757:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782758198.915763:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dadf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b8d expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.915774:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782758198.915962:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50820:x1869355196765824:12345-192.168.204.31@tcp:101:rm.0 Request processed in 3765us (3893us total) trans 4294967669 rc 301/301 00000100:00100000:0.0:1782758198.915972:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 962 00000100:00100000:0.0:1782758198.931978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758198.932106:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196765952 00000100:00100000:3.0:1782758198.932117:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196765952 00000100:00100000:3.0:1782758198.932208:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 98 00000100:00100000:3.0:1782758198.932218:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50820:x1869355196765952:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:0.0:1782758198.946039:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50820:x1869355196765952:12345-192.168.204.31@tcp:37:rm.0 Request processed in 13808us (14059us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758198.946057:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 98 00000100:00100000:1.0:1782758198.957741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.957768:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766208 00000100:00100000:0.0:1782758198.957778:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766208 00000100:00100000:0.0:1782758198.957850:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 99 00000100:00100000:0.0:1782758198.957860:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50820:x1869355196766208:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1782758198.958349:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50820:x1869355196766208:12345-192.168.204.31@tcp:35:rm.0 Request processed in 489us (615us total) trans 4294967670 rc 0/0 00000100:00100000:0.0:1782758198.958359:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 99 00000100:00100000:0.0:1782758198.972780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758198.972856:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766464 00000100:00100000:0.0:1782758198.972868:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766464 00000100:00100000:0.0:1782758198.972930:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 963 00000100:00100000:0.0:1782758198.972941:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:50820:x1869355196766464:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758198.973001:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782758198.973033:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dadef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b86 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973054:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dad8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b71 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973077:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff917191f75700) 00010000:00010000:0.0:1782758198.973095:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daaae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64abb expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973110:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:0.0:1782758198.973117:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758198.973141:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973154:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973163:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973197:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973205:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973212:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973585:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973595:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.973603:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758198.974618:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00010000:0.0:1782758198.974640:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974648:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974654:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974659:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758198.974663:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974669:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974681:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758198.974684:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758198.974689:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974694:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dae12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974714:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974720:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974725:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974730:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758198.974732:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974737:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974744:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758198.974746:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758198.974748:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758198.974753:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dae04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758198.974763:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcc11b44 reply state 00000000540417e0 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758198.974776:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758198.974910:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:50820:x1869355196766464:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1967us (2153us total) trans 4294967671 rc 0/0 00000100:00100000:0.0:1782758198.974919:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 963 00010000:00010000:3.0:1782758199.085565:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085584:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085592:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085598:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758199.085604:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085612:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085631:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff91718bcfd000) 00010000:00010000:3.0:1782758199.085635:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758199.085640:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758199.085645:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dae0b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758199.247468:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967671 is committed 00010000:00010000:0.0:1782758199.859307:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758200.237855:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758200.237883:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211603456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758200.237975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758200.238247:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603456 00000100:00100000:3.0:1782758200.238255:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603456 00000100:00100000:3.0:1782758200.238318:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1782758200.238329:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211603456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758200.238379:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758200.238851:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211603456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758200.238865:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1782758200.238921:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211603456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758200.239746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782758200.860261:0:85903:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa7c0f350 20000000:00000080:1.0:1782758200.860279:0:85903:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77e6c00 uarg=0000000000000000 00010000:00010000:0.0:1782758200.868078:0:85903:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758200.868112:0:85903:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758200.868168:0:85903:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758200.868188:0:85903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.868210:0:85903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.868219:0:85903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.868263:0:85903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.868280:0:85903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 18 pid: 5793 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758200.868295:0:85903:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85903:1869355211603584:0@lo:104: 00000100:00100000:0.0:1782758200.868369:0:85903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758200.868726:0:85903:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b697540 going to sleep for 11 seconds 00000100:00100000:0.0:1782758200.869598:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782758200.869616:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603584 00000100:00100000:0.0:1782758200.869624:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603584 00000100:00100000:0.0:1782758200.869670:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1782758200.869679:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:85903:x1869355211603584:12345-0@lo:104: 00010000:00010000:0.0:1782758200.869695:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.869915:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758200.869922:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:85903:x1869355211603584:12345-0@lo:104: Request processed in 244us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758200.869929:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:2.0:1782758200.870048:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758200.870056:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870065:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758200.870069:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870079:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758200.870086:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758200.870103:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758200.870147:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870154:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758200.870174:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870180:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690200/0xdd99f5c4777daa99 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daaa0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870194:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758200.870195:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758200.870198:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758200.870210:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211603712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758200.870244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758200.870288:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603712 00000100:00100000:2.0:1782758200.870292:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603712 00010000:00010000:2.0:1782758200.870311:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 19 pid: 5793 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758200.870332:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1782758200.870338:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211603712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758200.870349:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758200.870354:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 19 pid: 5793 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870364:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 19 pid: 5793 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870381:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870402:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870417:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870425:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870432:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870444:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870450:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758200.870454:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870462:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870470:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758200.870479:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758200.870506:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211603712:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758200.870513:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1782758200.870546:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211603712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758200.871565:0:85903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777daaa0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daa99 expref: 18 pid: 5793 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758200.871581:0:85903:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85903:1869355211603584:0@lo:104: 00010000:00010000:3.0:1782758200.871599:0:85903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758200.871609:0:85903:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758200.871616:0:85903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758200.871623:0:85903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dae19 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758200.879289:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758201.532314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758201.532394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758201.532473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758201.532529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758201.532583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766592 00000100:00100000:1.0:1782758201.532594:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766592 00000100:00100000:1.0:1782758201.532655:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1260 00000100:00100000:1.0:1782758201.532665:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196766592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758201.532738:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196766592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758201.532746:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1260 00000100:00100000:0.0:1782758201.533055:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766720 00000100:00100000:0.0:1782758201.533061:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766720 00000100:00100000:0.0:1782758201.533120:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1609 00000100:00100000:0.0:1782758201.533129:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758201.533178:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758201.533186:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1609 00000100:00080000:1.0:1782758201.533403:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758201.533976:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766976 00000100:00100000:3.0:1782758201.534160:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766976 00000100:00100000:3.0:1782758201.534252:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196766848 00000100:00100000:3.0:1782758201.534257:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196766848 00000100:00100000:2.0:1782758201.534310:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00100000:2.0:1782758201.534321:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758201.534421:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758201.534433:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00080000:1.0:1782758201.534508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758201.534512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758201.534813:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1235 00000100:00100000:3.0:1782758201.534840:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758201.534923:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196766848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758201.534931:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1235 00000020:00000080:1.0:1782758201.731233:0:85951:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbababe60 20000000:00000080:0.0:1782758201.731379:0:85951:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2f20800 uarg=0000000000000000 00010000:00010000:0.0:1782758201.731623:0:85951:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758201.731639:0:85951:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758201.731671:0:85951:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758201.731692:0:85951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731708:0:85951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731719:0:85951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731727:0:85951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731734:0:85951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731742:0:85951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731748:0:85951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758201.731763:0:85951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731772:0:85951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731785:0:85951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731792:0:85951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758201.731798:0:85951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae20 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758201.900564:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758202.229272:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758202.229282:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758202.229288:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758202.229341:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758202.229411:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758202.229424:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758202.229452:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211603840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758202.229522:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758202.230265:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1782758202.232890:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603840 00000100:00100000:0.0:1782758202.232906:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603840 00000100:00100000:0.0:1782758202.232975:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1782758202.232986:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211603840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758202.233004:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758202.233200:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dae27 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758202.233239:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758202.233251:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758202.233259:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782758202.233351:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211603840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758202.233359:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1782758202.233650:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211603840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758202.233667:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758202.233677:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758202.233698:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758202.233703:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758202.233711:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758202.287531:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211603968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.287605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758202.287662:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211604480:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.287690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758202.287714:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758202.287720:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211604352:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.287756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758202.287789:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211603968 00000100:00100000:1.0:1782758202.287797:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211603968 00000100:00100000:1.0:1782758202.287872:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604352 00000100:00100000:1.0:1782758202.287876:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604352 00000100:00100000:1.0:1782758202.287908:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1782758202.287917:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211603968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.287970:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211603968:12345-0@lo:400:kworker.0 Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758202.287977:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1782758202.287997:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1782758202.288005:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211604352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288033:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211604352:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758202.288039:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00080000:1.0:1782758202.288056:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758202.288229:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211604352:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288241:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211603968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288278:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211604224:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758202.288323:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758202.288328:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211604096:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758202.288370:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604480 00000100:00100000:1.0:1782758202.288374:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604480 00000100:00100000:1.0:1782758202.288403:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604224 00000100:00100000:1.0:1782758202.288405:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604224 00000100:00100000:1.0:1782758202.288425:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1782758202.288431:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211604480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288463:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211604480:12345-0@lo:400:kworker.0 Request processed in 33us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758202.288469:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1782758202.288481:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1782758202.288487:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211604224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288515:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211604224:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758202.288525:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1782758202.288541:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604096 00000100:00100000:1.0:1782758202.288545:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604096 00000100:00100000:1.0:1782758202.288569:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:1.0:1782758202.288575:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211604096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288603:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211604096:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758202.288609:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00080000:1.0:1782758202.288626:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758202.288630:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758202.288632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758202.288646:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211604096:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288656:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211604224:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.288683:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211604480:0@lo:400:kworker.0 00000100:00100000:1.0:1782758202.798631:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758202.798654:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758202.798747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758202.798869:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604608 00000100:00100000:3.0:1782758202.798880:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604608 00000100:00100000:3.0:1782758202.798937:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1782758202.798947:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211604608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758202.798984:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758202.799056:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211604608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758202.799063:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1782758202.799454:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211604608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758202.923968:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758203.128577:0:85999:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea385c100 20000000:00000080:3.0:1782758203.128596:0:85999:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7d82000 uarg=0000000000000000 00010000:00010000:3.0:1782758203.130311:0:85999:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758203.130331:0:85999:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758203.130351:0:85999:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758203.130369:0:85999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758203.130387:0:85999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758203.130396:0:85999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758203.130434:0:85999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758203.130449:0:85999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 18 pid: 5793 timeout: 2371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758203.130463:0:85999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85999:1869355211604736:0@lo:104: 00000100:00100000:3.0:1782758203.130527:0:85999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758203.130629:0:85999:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b697540 going to sleep for 11 seconds 00000100:00100000:2.0:1782758203.141415:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604736 00000100:00100000:2.0:1782758203.141430:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604736 00000100:00100000:2.0:1782758203.141495:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782758203.141507:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:85999:x1869355211604736:12345-0@lo:104: 00010000:00010000:2.0:1782758203.141525:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758203.141621:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758203.141627:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:85999:x1869355211604736:12345-0@lo:104: Request processed in 124us (11100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758203.141634:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:0.0:1782758203.141747:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758203.141754:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.141762:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758203.141766:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.141775:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758203.141782:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758203.141788:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758203.141850:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.141863:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758203.141886:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.141893:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694800/0xdd99f5c4777dae27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae2e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.141910:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758203.141912:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758203.141913:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758203.141921:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758203.141937:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211604864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758203.141977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758203.142286:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604864 00000100:00100000:1.0:1782758203.142292:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604864 00010000:00010000:1.0:1782758203.142318:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 19 pid: 5793 timeout: 2371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758203.142342:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1782758203.142348:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211604864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758203.142362:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758203.142367:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 19 pid: 5793 timeout: 2371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142378:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 19 pid: 5793 timeout: 2371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142395:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142404:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142420:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142427:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142434:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142440:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142445:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758203.142449:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142457:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142470:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142479:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758203.142513:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211604864:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758203.142520:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1782758203.142560:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211604864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758203.142597:0:85999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dae2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dae27 expref: 18 pid: 5793 timeout: 2371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758203.142609:0:85999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85999:1869355211604736:0@lo:104: 00010000:00010000:1.0:1782758203.142623:0:85999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142631:0:85999:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142638:0:85999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758203.142643:0:85999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dae35 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758203.950105:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758204.908404:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758204.908412:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758204.908417:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758204.908463:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758204.908475:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758204.908496:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758204.908522:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211604992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758204.908589:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758204.908653:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181254000 going to sleep for 11 seconds 00000100:00100000:1.0:1782758204.908902:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211604992 00000100:00100000:1.0:1782758204.908910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211604992 00000100:00100000:1.0:1782758204.909038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1782758204.909048:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211604992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758204.909062:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758204.909093:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dae3c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758204.909116:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758204.909127:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758204.909136:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758204.909180:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211604992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758204.909187:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1782758204.909369:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211604992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758204.909385:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758204.909394:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758204.909412:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758204.909417:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758204.909424:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758204.973717:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758205.371770:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758205.371793:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758205.371915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758205.371980:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605120 00000100:00100000:1.0:1782758205.371987:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605120 00000100:00100000:1.0:1782758205.372058:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1782758205.372068:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211605120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758205.372106:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758205.372151:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211605120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758205.372158:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00080000:1.0:1782758205.372182:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758205.372214:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211605120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758205.997037:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758206.654165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758206.664255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758206.664319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758206.665947:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767232 00000100:00100000:3.0:1782758206.665962:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767232 00000100:00100000:3.0:1782758206.666065:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1613 00000100:00100000:3.0:1782758206.666077:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196767232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758206.666155:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196767232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758206.666163:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1613 00000100:00080000:2.0:1782758206.667672:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758206.668138:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767360 00000100:00100000:2.0:1782758206.668151:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767360 00000100:00100000:2.0:1782758206.668235:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00100000:2.0:1782758206.668249:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196767360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758206.668326:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196767360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758206.668334:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00080000:3.0:1782758206.671641:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758206.673587:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767104 00000100:00100000:0.0:1782758206.673617:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767104 00000100:00100000:0.0:1782758206.673702:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1263 00000100:00100000:0.0:1782758206.673714:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196767104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758206.673856:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196767104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 145us (19700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758206.673864:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1263 00000100:00100000:0.0:1782758206.674021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758206.674117:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767488 00000100:00100000:0.0:1782758206.674121:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767488 00000100:00100000:0.0:1782758206.674157:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1239 00000100:00100000:0.0:1782758206.674163:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196767488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758206.674192:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196767488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758206.674198:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1239 00000100:00080000:0.0:1782758206.674213:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758207.025095:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758207.417353:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211605376:0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758207.417523:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605376 00000100:00100000:1.0:1782758207.417532:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605376 00000100:00100000:1.0:1782758207.417574:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:1.0:1782758207.417582:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211605376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417631:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211605376:12345-0@lo:400:kworker.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758207.417637:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:1.0:1782758207.417690:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211605376:0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417736:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211605504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758207.417787:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605504 00000100:00100000:1.0:1782758207.417791:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605504 00000100:00100000:1.0:1782758207.417819:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1782758207.417844:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211605504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417878:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211605504:12345-0@lo:400:kworker.0 Request processed in 36us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758207.417884:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00080000:1.0:1782758207.417900:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758207.417918:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211605504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.417968:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211605888:0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.418010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758207.418089:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605888 00000100:00100000:1.0:1782758207.418093:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605888 00000100:00100000:1.0:1782758207.418126:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1782758207.418134:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211605888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.418169:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211605888:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758207.418176:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:1.0:1782758207.418194:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758207.418212:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211605888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.418805:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211605632:0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.418882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758207.418912:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758207.418918:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211605248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.418946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758207.418978:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211605760:0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.419013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758207.419044:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605248 00000100:00100000:0.0:1782758207.419049:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605248 00000100:00100000:0.0:1782758207.419080:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1782758207.419087:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.419120:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211605248:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758207.419126:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1782758207.419153:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605760 00000100:00100000:0.0:1782758207.419157:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605760 00000100:00100000:0.0:1782758207.419186:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1782758207.419191:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211605760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.419220:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211605760:12345-0@lo:400:kworker.0 Request processed in 29us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758207.419226:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1782758207.419254:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211605248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758207.419265:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211605760:0@lo:400:kworker.0 00000100:00080000:0.0:1782758207.419289:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758207.420850:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211605632 00000100:00100000:1.0:1782758207.420861:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211605632 00000100:00100000:1.0:1782758207.420937:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1782758207.420946:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211605632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758207.421167:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211605632:12345-0@lo:400:kworker.0 Request processed in 221us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758207.421174:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1782758207.421285:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211605632:0@lo:400:kworker.0 00000100:00080000:0.0:1782758207.421312:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758207.921701:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758207.921725:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211606016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758207.921791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758207.922211:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606016 00000100:00100000:3.0:1782758207.922219:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606016 00000100:00100000:3.0:1782758207.922275:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1782758207.922284:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211606016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758207.922319:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758207.922371:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211606016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758207.922379:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1782758207.922423:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211606016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758208.051354:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758209.067997:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758209.519441:0:86197:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebbb8cdf0 20000000:00000080:0.0:1782758209.519459:0:86197:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2f20800 uarg=0000000000000000 00010000:00010000:0.0:1782758209.520341:0:86197:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758209.520358:0:86197:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758209.520376:0:86197:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758209.520394:0:86197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758209.520412:0:86197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758209.520426:0:86197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758209.520464:0:86197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758209.520646:0:86197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 18 pid: 5796 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758209.520662:0:86197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86197:1869355211606144:0@lo:104: 00000100:00100000:0.0:1782758209.520726:0:86197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758209.520870:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606144 00000100:00100000:2.0:1782758209.520878:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606144 00000100:00100000:0.0:1782758209.521062:0:86197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758209.521115:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782758209.521127:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86197:x1869355211606144:12345-0@lo:104: 00010000:00010000:2.0:1782758209.521139:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758209.521205:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758209.521212:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86197:x1869355211606144:12345-0@lo:104: Request processed in 89us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758209.521219:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1782758209.521298:0:86197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86197:1869355211606144:0@lo:104: 00010000:00010000:0.0:1782758209.521318:0:86197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521425:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758209.521434:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521442:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758209.521446:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521455:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758209.521462:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758209.521555:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758209.521638:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521645:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758209.521676:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521684:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dae3c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae43 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.521700:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758209.521702:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758209.521703:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758209.521753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758209.521766:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211606272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758209.521801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758209.522047:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606272 00000100:00100000:1.0:1782758209.522053:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606272 00010000:00010000:1.0:1782758209.522072:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758209.522103:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1782758209.522111:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211606272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758209.522122:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758209.522126:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522135:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522148:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dae43 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dae3c expref: 19 pid: 5796 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522162:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522169:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522182:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522188:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522194:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522200:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522205:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758209.522209:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522216:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522238:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758209.522248:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758209.522278:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211606272:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758209.522284:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1782758209.522347:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211606272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758209.522368:0:86197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758209.522376:0:86197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758209.522387:0:86197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51400/0xdd99f5c4777dae4a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758210.092921:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758210.484383:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758210.484405:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211606400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758210.484475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758210.488563:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606400 00000100:00100000:3.0:1782758210.488597:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606400 00000100:00100000:3.0:1782758210.488679:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1782758210.488689:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211606400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758210.488728:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758210.488807:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211606400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758210.488815:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00080000:1.0:1782758210.488904:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758210.489163:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211606400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758211.116415:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758211.436924:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758211.436932:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758211.436938:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758211.436982:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758211.436995:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758211.437005:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758211.437031:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211606528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758211.437106:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758211.437154:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782758211.437179:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606528 00000100:00100000:2.0:1782758211.437186:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606528 00000100:00100000:2.0:1782758211.437245:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1782758211.437253:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211606528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758211.437266:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758211.437278:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dae51 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758211.437673:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758211.437694:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758211.437703:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758211.437766:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211606528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 513us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758211.437773:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1782758211.438248:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211606528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758211.438265:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758211.438274:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758211.438294:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758211.438310:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758211.438318:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758211.770196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758211.770313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758211.770394:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768000 00000100:00100000:3.0:1782758211.770405:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768000 00000100:00100000:3.0:1782758211.770480:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:3.0:1782758211.770492:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196768000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758211.770579:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196768000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758211.770586:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00080000:0.0:1782758211.771197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758211.772222:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767744 00000100:00100000:1.0:1782758211.772232:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767744 00000100:00100000:3.0:1782758211.772772:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00100000:3.0:1782758211.772784:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196767744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758211.772894:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196767744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 112us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758211.772903:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00080000:0.0:1782758211.773242:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758211.777749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758211.779484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758211.779529:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767872 00000100:00100000:2.0:1782758211.779542:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767872 00000100:00100000:2.0:1782758211.779612:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1243 00000100:00100000:2.0:1782758211.779621:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196767872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758211.779703:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196767872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758211.779711:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1243 00000100:00100000:1.0:1782758211.780628:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196767616 00000100:00100000:1.0:1782758211.780637:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196767616 00000100:00100000:1.0:1782758211.780685:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1266 00000100:00100000:1.0:1782758211.780694:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196767616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758211.780746:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196767616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758211.780753:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1266 00000100:00080000:2.0:1782758211.781952:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758212.149764:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758212.524052:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211606784:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524170:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211607296:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524214:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758212.524219:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211606656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524264:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211607168:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524304:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211606912:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758212.524347:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211607040:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758212.524399:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606784 00000100:00100000:1.0:1782758212.524405:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606784 00000100:00100000:1.0:1782758212.524442:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607168 00000100:00100000:1.0:1782758212.524445:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607168 00000100:00100000:1.0:1782758212.524471:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606912 00000100:00100000:1.0:1782758212.524474:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606912 00000100:00100000:1.0:1782758212.524490:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1782758212.524497:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211606784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.524561:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211606784:12345-0@lo:400:kworker.0 Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758212.524568:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1782758212.524590:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1782758212.525007:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607296 00000100:00100000:3.0:1782758212.525012:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607296 00000100:00100000:3.0:1782758212.525040:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607040 00000100:00100000:3.0:1782758212.525043:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607040 00000100:00100000:3.0:1782758212.525064:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1782758212.525245:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211607296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758212.525287:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211607296:12345-0@lo:400:kworker.0 Request processed in 217us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758212.525295:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1782758212.525308:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1782758212.525314:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211607040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758212.525348:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211607040:12345-0@lo:400:kworker.0 Request processed in 35us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758212.525354:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1782758212.525372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:3.0:1782758212.525379:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211606912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758212.525407:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211606912:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758212.525413:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:3.0:1782758212.525470:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211607040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758212.525482:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211606912:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.525877:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211607168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.525916:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211607168:12345-0@lo:400:kworker.0 Request processed in 1320us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758212.525922:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1782758212.525944:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211606656 00000100:00100000:1.0:1782758212.525948:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211606656 00000100:00100000:1.0:1782758212.525978:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1782758212.525984:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211606656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.526013:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211606656:12345-0@lo:400:kworker.0 Request processed in 30us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758212.526018:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00080000:1.0:1782758212.526045:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758212.526049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758212.526052:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758212.526073:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211606656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.526085:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211607168:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.526096:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211606784:0@lo:400:kworker.0 00000100:00100000:1.0:1782758212.526105:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211607296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758213.036182:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758213.036207:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211607424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758213.036279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758213.036502:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607424 00000100:00100000:2.0:1782758213.036510:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607424 00000100:00100000:2.0:1782758213.036574:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1782758213.036592:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211607424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758213.036626:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758213.036683:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211607424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758213.036689:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1782758213.036979:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211607424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758213.164179:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758214.190786:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758215.212100:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758215.596261:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211607552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758215.596344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758215.596435:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607552 00000100:00100000:3.0:1782758215.596443:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607552 00000100:00100000:3.0:1782758215.596508:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1782758215.596518:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211607552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758215.596555:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758215.596601:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211607552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758215.596608:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00080000:2.0:1782758215.596667:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758215.596713:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211607552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758216.235992:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758216.890887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758216.890926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758216.890953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758216.890979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758216.891008:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768384 00000100:00100000:2.0:1782758216.891018:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768384 00000100:00100000:2.0:1782758216.891078:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768512 00000100:00100000:2.0:1782758216.891082:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768512 00000100:00100000:2.0:1782758216.891108:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:2.0:1782758216.891118:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758216.891197:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758216.891205:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:2.0:1782758216.891224:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1247 00000100:00100000:2.0:1782758216.891231:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758216.891256:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758216.891262:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1247 00000100:00100000:2.0:1782758216.891281:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768256 00000100:00100000:2.0:1782758216.891284:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768256 00000100:00100000:2.0:1782758216.891313:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00100000:2.0:1782758216.891319:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758216.891344:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196768256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758216.891350:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00080000:2.0:1782758216.891367:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758216.891371:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758216.891373:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758216.891555:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768128 00000100:00100000:3.0:1782758216.891560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768128 00000100:00100000:3.0:1782758216.891595:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1268 00000100:00100000:3.0:1782758216.891602:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196768128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758216.891643:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196768128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758216.891649:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1268 00010000:00010000:0.0:1782758217.261690:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758217.643997:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211607808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758217.644052:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211608064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.644073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758217.644125:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211607936:0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.644194:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211607680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758217.648947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758217.649001:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608064 00000100:00100000:2.0:1782758217.649009:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608064 00000100:00100000:2.0:1782758217.649063:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1782758217.649076:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211608064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758217.649150:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211608064:12345-0@lo:400:kworker.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758217.649158:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00080000:2.0:1782758217.649179:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758217.650455:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211608320:0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.650517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758217.650573:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607808 00000100:00100000:1.0:1782758217.650579:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607808 00000100:00100000:1.0:1782758217.650685:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1782758217.650695:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211607808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758217.650744:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211608064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.650755:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211607808:12345-0@lo:400:kworker.0 Request processed in 59us (6680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758217.650764:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1782758217.650797:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608320 00000100:00100000:1.0:1782758217.650801:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608320 00000100:00100000:0.0:1782758217.654091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758217.654381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758217.654422:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211608192:0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.654469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758217.654635:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607680 00000100:00100000:3.0:1782758217.654644:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607680 00000100:00100000:3.0:1782758217.654689:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1782758217.654698:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211607680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.654752:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211607680:12345-0@lo:400:kworker.0 Request processed in 54us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758217.654769:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1782758217.654803:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211607936 00000100:00100000:3.0:1782758217.654807:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211607936 00000100:00100000:3.0:1782758217.654853:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608192 00000100:00100000:3.0:1782758217.654857:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608192 00000100:00100000:3.0:1782758217.654879:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:3.0:1782758217.654885:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211607936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.654925:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211607936:12345-0@lo:400:kworker.0 Request processed in 40us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758217.654932:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:3.0:1782758217.654943:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1782758217.654949:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211608192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.654972:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211608192:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758217.654978:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1782758217.655014:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211607680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758217.655245:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211608192:0@lo:400:kworker.0 00000100:00080000:1.0:1782758217.656779:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758217.656788:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758217.656862:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211607808:0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.656941:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1782758217.656955:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211608320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.657037:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211608320:12345-0@lo:400:kworker.0 Request processed in 86us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758217.657046:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1782758217.657081:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211608320:0@lo:400:kworker.0 00000100:00100000:1.0:1782758217.657461:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211607936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758218.157363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758218.157391:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211608448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758218.157484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758218.157600:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608448 00000100:00100000:3.0:1782758218.157608:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608448 00000100:00100000:3.0:1782758218.157660:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1782758218.157668:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211608448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758218.157710:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758218.157764:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211608448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758218.157772:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1782758218.165571:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211608448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758218.287457:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758219.309026:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782758220.157889:0:86541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 14:36:57 (1782758217) 00010000:00010000:2.0:1782758220.333291:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758220.716942:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758220.716966:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211608576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758220.717054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758220.717283:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608576 00000100:00100000:0.0:1782758220.717291:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608576 00000100:00100000:0.0:1782758220.717367:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1782758220.717377:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211608576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758220.717425:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758220.717569:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211608576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758220.717577:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00080000:1.0:1782758220.717645:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758220.721424:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211608576:0@lo:13:osp-pre-0-0.0 00000004:00000400:2.0:1782758221.287499:0:86589:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1782758221.305800:0:86589:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1782758221.356687:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758222.009351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758222.009406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758222.009434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758222.009471:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768768 00000100:00100000:2.0:1782758222.009474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758222.009484:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768768 00000100:00100000:2.0:1782758222.009503:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768896 00000100:00100000:2.0:1782758222.009509:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768896 00000100:00100000:2.0:1782758222.009554:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769024 00000100:00100000:2.0:1782758222.009558:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769024 00000100:00100000:3.0:1782758222.009559:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000100:00100000:3.0:1782758222.009573:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196768768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758222.009587:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 532 00000100:00100000:2.0:1782758222.009596:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196768896:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1782758222.009620:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777da70b 00000100:00080000:2.0:1782758222.009631:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081aff800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782758222.009657:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196768768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758222.009666:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000001:00000004:2.0:1782758222.009670:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967357 00000100:00080000:3.0:1782758222.009701:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758222.009706:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758222.009709:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758222.009938:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196768896:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 343us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758222.009945:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 532 00000100:00100000:2.0:1782758222.009963:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 533 00000100:00100000:2.0:1782758222.009971:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196769024:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1782758222.009983:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777da7ba 00000100:00080000:2.0:1782758222.009988:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081af9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782758222.010019:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967357 00010000:00010000:3.0:1782758222.010163:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758222.010173:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196769024:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 202us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758222.010181:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 533 00010000:00010000:2.0:1782758222.010206:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758222.010384:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196768640 00000100:00100000:1.0:1782758222.010390:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196768640 00000100:00100000:1.0:1782758222.010422:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000100:00100000:1.0:1782758222.010428:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196768640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758222.010470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196768640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.010476:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000020:00000080:1.0:1782758222.186491:0:86638:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd868fd9b0 20000000:00000080:1.0:1782758222.186513:0:86638:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081255400 uarg=0000000000000000 10000000:01000000:0.0:1782758222.187505:0:86638:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758222.187525:0:86638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.187543:0:86638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.187553:0:86638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.187590:0:86638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.187606:0:86638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 18 pid: 5796 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758222.187620:0:86638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86638:1869355211608704:0@lo:104: 00000100:00100000:0.0:1782758222.187685:0:86638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758222.187777:0:86638:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643000 going to sleep for 11 seconds 00000100:00100000:2.0:1782758222.188166:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608704 00000100:00100000:2.0:1782758222.188175:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608704 00000100:00100000:2.0:1782758222.188264:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1782758222.188275:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86638:x1869355211608704:12345-0@lo:104: 00010000:00010000:2.0:1782758222.188289:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758222.188361:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758222.188367:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86638:x1869355211608704:12345-0@lo:104: Request processed in 96us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758222.188375:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:1.0:1782758222.188416:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758222.188424:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758222.188431:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758222.188435:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758222.188444:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758222.188451:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758222.188458:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758222.188489:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758222.188496:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758222.188516:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758222.188524:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777dae51 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae58 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758222.188539:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758222.188541:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758222.188542:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758222.188556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758222.188567:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211608832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758222.188601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758222.188688:0:86638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86638:1869355211608704:0@lo:104: 00010000:00010000:0.0:1782758222.188712:0:86638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758222.188776:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608832 00000100:00100000:3.0:1782758222.188780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608832 00010000:00010000:3.0:1782758222.188813:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758222.188864:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1782758222.188872:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211608832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758222.188882:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758222.188887:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188897:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188909:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dae58 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dae51 expref: 19 pid: 5796 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188921:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188929:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188942:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188949:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188957:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188965:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188970:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758222.188974:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188980:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.188993:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758222.189000:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758222.189204:0:86638:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.189213:0:86638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758222.189219:0:86638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dae5f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758222.191118:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211608832:12345-0@lo:103:ldlm_bl.0 Request processed in 2239us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758222.191133:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1782758222.191198:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211608832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758222.380000:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758222.764542:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211609344:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.764618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758222.764710:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758222.764717:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211608960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.764745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758222.764764:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211609472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.764789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758222.764817:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211609088:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.764865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758222.764882:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211609600:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.764917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758222.764978:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211608960 00000100:00100000:3.0:1782758222.764985:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211608960 00000100:00100000:3.0:1782758222.765028:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1782758222.765037:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211608960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758222.765091:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211608960:12345-0@lo:400:kworker.0 Request processed in 56us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758222.765102:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1782758222.765149:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211608960:0@lo:400:kworker.0 00000100:00100000:3.0:1782758222.765902:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211609216:0@lo:400:kworker.0 00000100:00100000:3.0:1782758222.765938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758222.766648:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609344 00000100:00100000:1.0:1782758222.766655:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609344 00000100:00100000:1.0:1782758222.766683:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609472 00000100:00100000:1.0:1782758222.766686:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609472 00000100:00100000:1.0:1782758222.766740:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609088 00000100:00100000:1.0:1782758222.766744:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609088 00000100:00100000:1.0:1782758222.766760:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609216 00000100:00100000:1.0:1782758222.766762:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609216 00000100:00100000:1.0:1782758222.766780:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1782758222.766787:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211609472:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758222.767009:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758222.767079:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211609472:12345-0@lo:400:kworker.0 Request processed in 291us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.767087:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1782758222.767108:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1782758222.767114:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758222.767147:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211609088:12345-0@lo:400:kworker.0 Request processed in 33us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.767153:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1782758222.767168:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:1.0:1782758222.767173:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758222.767205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211609216:12345-0@lo:400:kworker.0 Request processed in 32us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.767212:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:1.0:1782758222.767258:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609600 00000100:00100000:1.0:1782758222.767263:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609600 00000100:00100000:1.0:1782758222.767284:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1782758222.767290:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211609344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758222.767320:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211609344:12345-0@lo:400:kworker.0 Request processed in 30us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.767326:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1782758222.767338:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1782758222.767356:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211609600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758222.767383:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211609600:12345-0@lo:400:kworker.0 Request processed in 28us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758222.767389:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00080000:2.0:1782758222.767455:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758222.767458:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758222.767492:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211609472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.767505:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211609344:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.767538:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211609088:0@lo:400:kworker.0 00000100:00100000:2.0:1782758222.767548:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211609600:0@lo:400:kworker.0 00000100:00100000:3.0:1782758222.768076:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211609216:0@lo:400:kworker.0 00000020:00000080:0.0:1782758223.031811:0:86686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe567dfd50 20000000:00000080:0.0:1782758223.031968:0:86686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718bc13400 uarg=0000000000000000 10000000:01000000:0.0:1782758223.032214:0:86686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758223.032232:0:86686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032245:0:86686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032253:0:86686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032258:0:86686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032262:0:86686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032266:0:86686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032270:0:86686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758223.032273:0:86686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032278:0:86686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032288:0:86686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032292:0:86686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.032296:0:86686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dae66 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758223.277342:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758223.277350:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758223.277354:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758223.277400:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277411:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277423:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758223.277446:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758223.277513:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758223.277560:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643780 going to sleep for 11 seconds 00000100:00100000:0.0:1782758223.277584:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609728 00000100:00100000:0.0:1782758223.277590:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609728 00000100:00100000:0.0:1782758223.277639:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1782758223.277648:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758223.277669:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758223.277683:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dae6d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277709:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277721:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277737:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782758223.277775:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758223.277782:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1782758223.277850:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758223.277866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277874:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758223.277892:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758223.277897:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.277904:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758223.290200:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758223.291370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758223.291445:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609856 00000100:00100000:0.0:1782758223.291452:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609856 00000100:00100000:0.0:1782758223.291502:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1782758223.291511:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211609856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758223.291552:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758223.291602:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211609856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758223.291610:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1782758223.291687:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211609856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758223.406549:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758223.894418:0:86734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc84b72100 20000000:00000080:0.0:1782758223.894437:0:86734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917190482800 uarg=0000000000000000 10000000:01000000:0.0:1782758223.894659:0:86734:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758223.894682:0:86734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.894700:0:86734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.894708:0:86734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.894745:0:86734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.894759:0:86734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 18 pid: 5794 timeout: 2392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758223.894774:0:86734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86734:1869355211609984:0@lo:104: 00000100:00100000:0.0:1782758223.895027:0:86734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758223.895080:0:86734:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171907e7600 going to sleep for 11 seconds 00000100:00100000:1.0:1782758223.895081:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211609984 00000100:00100000:1.0:1782758223.895091:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211609984 00000100:00100000:1.0:1782758223.895144:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1782758223.895154:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86734:x1869355211609984:12345-0@lo:104: 00010000:00010000:1.0:1782758223.895168:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758223.895242:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758223.895249:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86734:x1869355211609984:12345-0@lo:104: Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758223.895256:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1782758223.895261:0:86734:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86734:1869355211609984:0@lo:104: 00010000:00010000:0.0:1782758223.895286:0:86734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895358:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758223.895366:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895374:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758223.895378:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895386:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758223.895394:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758223.895400:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758223.895467:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895474:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758223.895506:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895513:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dae6d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae74 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895528:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758223.895530:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758223.895532:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758223.895650:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211610112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758223.895686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758223.895762:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610112 00000100:00100000:2.0:1782758223.895767:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610112 00010000:00010000:2.0:1782758223.895790:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 2392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758223.895848:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1782758223.895857:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211610112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758223.895870:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758223.895875:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 2392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895885:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 2392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895898:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dae74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dae6d expref: 19 pid: 5794 timeout: 2392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895921:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895930:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895944:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895951:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895957:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895964:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895969:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758223.895973:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895980:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.895995:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758223.896004:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758223.896038:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211610112:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758223.896045:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1782758223.896098:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211610112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758223.896357:0:86734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.896371:0:86734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758223.896376:0:86734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dae7b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758224.433698:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758224.759003:0:86782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce9ca6d40 20000000:00000080:2.0:1782758224.759020:0:86782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c6c00 uarg=0000000000000000 10000000:01000000:2.0:1782758224.759232:0:86782:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758224.759258:0:86782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759275:0:86782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759286:0:86782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759298:0:86782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759317:0:86782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759324:0:86782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759331:0:86782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758224.759335:0:86782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759343:0:86782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759358:0:86782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759366:0:86782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758224.759372:0:86782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777dae82 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758225.388519:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758225.388531:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758225.388537:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758225.389851:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.389868:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.389881:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758225.389909:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211610240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758225.389977:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758225.390021:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067000 going to sleep for 11 seconds 00000100:00100000:3.0:1782758225.395971:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610240 00000100:00100000:3.0:1782758225.395987:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610240 00000100:00100000:3.0:1782758225.396041:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1782758225.396051:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211610240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758225.396071:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758225.396096:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dae89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758225.396125:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758225.396136:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758225.396145:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758225.396228:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211610240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (6250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758225.396236:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1782758225.396302:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211610240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758225.396321:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758225.396331:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758225.396352:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758225.396358:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758225.396365:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1782758225.403980:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758225.403992:0:7507:0:(genops.c:906:class_export_put()) final put ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758225.404015:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:2.0:1782758225.404090:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081af9800 for lustre-OST0001 00000001:00100000:1.0:1782758225.404513:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758225.404519:0:6622:0:(genops.c:906:class_export_put()) final put ffff917081afe800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758225.404570:0:37206:0:(genops.c:865:class_export_destroy()) destroying export ffff917081afe800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:2.0:1782758225.404591:0:37206:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081aff800 for lustre-OST0000 00010000:00010000:3.0:1782758225.454959:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758225.658645:0:86833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd210bd8c0 20000000:00000080:1.0:1782758225.658662:0:86833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081257c00 uarg=0000000000000000 10000000:01000000:1.0:1782758225.659109:0:86833:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758225.659131:0:86833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.659151:0:86833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.659161:0:86833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.659202:0:86833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.659215:0:86833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 18 pid: 5793 timeout: 2394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758225.659229:0:86833:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86833:1869355211610368:0@lo:104: 00000100:00100000:1.0:1782758225.659304:0:86833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758225.659355:0:86833:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171932a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758225.659630:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610368 00000100:00100000:2.0:1782758225.659638:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610368 00000100:00100000:2.0:1782758225.659695:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1782758225.659705:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86833:x1869355211610368:12345-0@lo:104: 00010000:00010000:2.0:1782758225.659720:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758225.659787:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758225.659794:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:86833:x1869355211610368:12345-0@lo:104: Request processed in 90us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758225.659801:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:0.0:1782758225.660087:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758225.660094:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660103:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758225.660108:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660117:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758225.660125:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758225.660131:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758225.660172:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660179:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758225.660199:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660206:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777dae89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dae90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660222:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758225.660224:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758225.660226:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758225.660233:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758225.660244:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211610496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758225.660277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758225.660320:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610496 00000100:00100000:0.0:1782758225.660324:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610496 00010000:00010000:0.0:1782758225.660342:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 19 pid: 5793 timeout: 2394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758225.660362:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1782758225.660369:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211610496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758225.660380:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758225.660385:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 19 pid: 5793 timeout: 2394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660395:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 19 pid: 5793 timeout: 2394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660411:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660420:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660434:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660448:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660456:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660463:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660469:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758225.660473:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660481:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660490:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758225.660500:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758225.660526:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211610496:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758225.660534:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1782758225.660568:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211610496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758225.661208:0:86833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dae90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dae89 expref: 18 pid: 5793 timeout: 2394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758225.661222:0:86833:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86833:1869355211610368:0@lo:104: 00010000:00010000:1.0:1782758225.661240:0:86833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.661250:0:86833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.661262:0:86833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758225.661269:0:86833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dae97 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758225.838898:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211610624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758225.838970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758225.839047:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610624 00000100:00100000:0.0:1782758225.839056:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610624 00000100:00100000:0.0:1782758225.839119:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1782758225.839128:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211610624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758225.839161:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758225.839206:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211610624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758225.839213:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00080000:0.0:1782758225.839232:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758225.839267:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211610624:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782758226.452172:0:86881:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd79029200 20000000:00000080:3.0:1782758226.452189:0:86881:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3612400 uarg=0000000000000000 10000000:01000000:3.0:1782758226.452410:0:86881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758226.452439:0:86881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452458:0:86881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452470:0:86881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452477:0:86881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452485:0:86881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452493:0:86881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452500:0:86881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758226.452504:0:86881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452512:0:86881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452526:0:86881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452534:0:86881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758226.452541:0:86881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dae9e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758226.475976:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758227.127864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758227.127912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758227.127986:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769152 00000100:00100000:0.0:1782758227.127998:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769152 00000100:00100000:0.0:1782758227.128066:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:1.0:1782758227.128069:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769280 00000100:00100000:1.0:1782758227.128075:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769280 00000100:00100000:0.0:1782758227.128080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196769152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758227.128126:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000100:00100000:1.0:1782758227.128135:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196769280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758227.128162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196769152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758227.128171:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196769280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758227.128174:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:1.0:1782758227.128184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000100:00080000:2.0:1782758227.128304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1782758227.371923:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758227.371932:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758227.371937:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758227.371986:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758227.371998:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758227.372013:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758227.372041:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211610752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758227.372109:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758227.372163:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183344540 going to sleep for 11 seconds 00000100:00100000:1.0:1782758227.372235:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610752 00000100:00100000:1.0:1782758227.372243:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610752 00000100:00100000:1.0:1782758227.372312:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1782758227.372321:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211610752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758227.372334:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758227.372347:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daea5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758227.372368:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758227.372378:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758227.372392:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782758227.372428:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211610752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758227.372434:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1782758227.372617:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211610752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758227.372630:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758227.372639:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758227.372723:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758227.372729:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758227.372737:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758227.500278:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758227.884871:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211610880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758227.884971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758227.885045:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211611008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758227.885050:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211611392:0@lo:400:kworker.0 00000100:00100000:0.0:1782758227.885103:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758227.885134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758227.885135:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758227.885149:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211611264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.885183:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211611520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758227.885198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758227.885271:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211610880 00000100:00100000:3.0:1782758227.885283:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211610880 00000100:00100000:1.0:1782758227.885305:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611392 00000100:00100000:1.0:1782758227.885315:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611392 00000100:00100000:3.0:1782758227.885351:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1782758227.885367:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211610880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758227.885380:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611008 00000100:00100000:1.0:1782758227.885386:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611008 00000100:00100000:1.0:1782758227.885414:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:1.0:1782758227.885440:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211611392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.890217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758227.890318:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758227.890334:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211611136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.890400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758227.890462:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611136 00000100:00100000:2.0:1782758227.890472:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611136 00000100:00100000:2.0:1782758227.890540:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:2.0:1782758227.891817:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211611008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.891977:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211611008:12345-0@lo:400:kworker.0 Request processed in 1425us (6843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758227.891992:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:2.0:1782758227.892039:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:2.0:1782758227.892054:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211611136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.892085:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211611136:12345-0@lo:400:kworker.0 Request processed in 39us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758227.892091:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00080000:2.0:1782758227.892120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758227.892136:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611264 00000100:00100000:2.0:1782758227.892144:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611264 00000100:00100000:2.0:1782758227.892185:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611520 00000100:00100000:2.0:1782758227.892189:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611520 00000100:00100000:2.0:1782758227.892215:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1782758227.892221:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.892270:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211611264:12345-0@lo:400:kworker.0 Request processed in 49us (7073us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758227.892276:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1782758227.892478:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1782758227.892485:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211611520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.892512:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211611520:12345-0@lo:400:kworker.0 Request processed in 29us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758227.892518:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00080000:2.0:1782758227.892548:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758227.892552:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758227.892975:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211611136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.892992:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211611008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758227.893006:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211611520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758227.894028:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211611264:0@lo:400:kworker.0 00000100:00100000:3.0:1782758227.895210:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211610880:12345-0@lo:400:kworker.0 Request processed in 9836us (10229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758227.895236:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1782758227.895299:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211610880:0@lo:400:kworker.0 00000100:00100000:1.0:1782758227.901383:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211611392:12345-0@lo:400:kworker.0 Request processed in 15948us (16266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758227.901400:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1782758227.906357:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211611392:0@lo:400:kworker.0 00000100:00100000:3.0:1782758228.397500:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758228.397524:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211611648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758228.397621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758228.397691:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611648 00000100:00100000:3.0:1782758228.397699:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611648 00000100:00100000:3.0:1782758228.397749:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1782758228.397759:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211611648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758228.397799:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758228.397869:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211611648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758228.397876:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1782758228.397927:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211611648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758228.528513:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758229.292341:0:87029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeab1e6b0 20000000:00000080:3.0:1782758229.292362:0:87029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7c48400 uarg=0000000000000000 10000000:01000000:3.0:1782758229.292608:0:87029:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758229.292636:0:87029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.292656:0:87029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.292667:0:87029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.292715:0:87029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.292735:0:87029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 18 pid: 5794 timeout: 2397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758229.292752:0:87029:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87029:1869355211611776:0@lo:104: 00000100:00100000:3.0:1782758229.293128:0:87029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758229.293302:0:87029:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448000 going to sleep for 11 seconds 00000100:00100000:1.0:1782758229.293874:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611776 00000100:00100000:1.0:1782758229.293884:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611776 00000100:00100000:1.0:1782758229.294015:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1782758229.294025:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87029:x1869355211611776:12345-0@lo:104: 00010000:00010000:1.0:1782758229.294043:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294113:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758229.294119:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87029:x1869355211611776:12345-0@lo:104: Request processed in 96us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758229.294127:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:1.0:1782758229.294154:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758229.294160:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294168:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758229.294289:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294300:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758229.294307:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758229.294313:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758229.294352:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294358:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782758229.294414:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211611904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758229.294451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782758229.294476:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294485:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777daea5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daeac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758229.294503:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758229.294505:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211611904 00010000:00010000:1.0:1782758229.294505:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758229.294507:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758229.294509:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211611904 00000100:00100000:0.0:1782758229.294593:0:87029:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87029:1869355211611776:0@lo:104: 00010000:00010000:0.0:1782758229.294620:0:87029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.294698:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 2397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758229.294726:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782758229.294738:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211611904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758229.294749:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758229.294754:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 2397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295053:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 2397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295071:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777daeac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daea5 expref: 19 pid: 5794 timeout: 2397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295088:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295096:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295116:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295123:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295129:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295136:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295142:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758229.295146:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.295153:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758229.295197:0:87029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758229.295205:0:87029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.299136:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.299159:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daeb3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758229.299191:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758229.299289:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211611904:12345-0@lo:103:ldlm_bl.0 Request processed in 4549us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758229.299300:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1782758229.299385:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211611904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758229.554724:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758230.269057:0:87079:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd577f670 20000000:00000080:1.0:1782758230.269076:0:87079:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd8800 uarg=0000000000000000 10000000:01000000:1.0:1782758230.270272:0:87079:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758230.270301:0:87079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270319:0:87079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270330:0:87079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270336:0:87079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270344:0:87079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270351:0:87079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270358:0:87079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758230.270361:0:87079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270368:0:87079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270381:0:87079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270388:0:87079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758230.270394:0:87079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777daeba lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758230.572422:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758230.956954:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758230.956978:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211612032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758230.957047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1782758230.957099:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758230.957104:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758230.957108:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00000100:00100000:0.0:1782758230.957117:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612032 00000100:00100000:0.0:1782758230.957125:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612032 00010000:00010000:3.0:1782758230.957143:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758230.957155:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758230.957167:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758230.957194:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211612160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758230.957209:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1782758230.957222:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211612032:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758230.957235:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1782758230.957261:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758230.957264:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758230.957286:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612160 00000100:00100000:3.0:1782758230.957300:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612160 00000100:00100000:0.0:1782758230.957312:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211612032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758230.957320:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1782758230.957336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1782758230.957346:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211612160:12345-0@lo:101:ll_cfg_requeue.0 00000100:00080000:0.0:1782758230.957346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758230.957358:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758230.957371:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daec1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758230.957388:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211612032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758230.957397:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758230.957409:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758230.957419:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758230.957462:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211612160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758230.957468:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1782758230.958314:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211612160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758230.958331:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758230.958342:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758230.958360:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758230.958366:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758230.958374:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758231.596080:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758232.246726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758232.246780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758232.246886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769536 00000100:00100000:1.0:1782758232.246896:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769536 00000100:00100000:1.0:1782758232.246964:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1633 00000100:00100000:1.0:1782758232.246974:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196769536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758232.247052:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196769536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758232.247058:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1633 00000100:00080000:2.0:1782758232.247204:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758232.248107:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769408 00000100:00100000:3.0:1782758232.248118:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769408 00000100:00100000:3.0:1782758232.248194:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1278 00000100:00100000:3.0:1782758232.248202:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196769408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758232.248267:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196769408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758232.248273:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1278 00010000:00010000:2.0:1782758232.620939:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758233.004294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211612544:0@lo:400:kworker.0 00000100:00100000:2.0:1782758233.004370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758233.004479:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211612288:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.004515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758233.004547:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758233.004553:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211612416:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.004578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758233.004607:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612288 00000100:00100000:3.0:1782758233.004614:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612288 00000100:00100000:3.0:1782758233.004660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1782758233.004669:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211612288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.004716:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211612288:12345-0@lo:400:kworker.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758233.004723:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1782758233.004753:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612544 00000100:00100000:3.0:1782758233.004756:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612544 00000100:00100000:3.0:1782758233.004789:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612416 00000100:00100000:3.0:1782758233.004792:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612416 00000100:00100000:3.0:1782758233.004808:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1782758233.004814:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211612544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.004913:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1782758233.004922:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211612416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.004957:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211612416:12345-0@lo:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758233.004963:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1782758233.006549:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211612672:0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.006608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758233.006678:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612672 00000100:00100000:0.0:1782758233.006686:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612672 00000100:00100000:0.0:1782758233.006736:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1782758233.006744:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211612672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.006791:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211612672:12345-0@lo:400:kworker.0 Request processed in 47us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758233.006798:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1782758233.006864:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211612672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.011287:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211612544:12345-0@lo:400:kworker.0 Request processed in 6459us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758233.011305:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00080000:3.0:1782758233.011357:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758233.011364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758233.011426:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211612416:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.011441:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211612288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758233.012161:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211612544:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.012658:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211612800:0@lo:400:kworker.0 00000100:00100000:3.0:1782758233.012724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758233.013236:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612800 00000100:00100000:2.0:1782758233.013244:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612800 00000100:00100000:2.0:1782758233.013309:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1782758233.013318:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211612800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782758233.013405:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758233.014418:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211612928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.014653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758233.014709:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211612928 00000100:00100000:0.0:1782758233.014715:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211612928 00000100:00100000:0.0:1782758233.014768:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1782758233.014776:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211612928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758233.014819:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211612928:12345-0@lo:400:kworker.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758233.014846:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00080000:0.0:1782758233.014869:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758233.014906:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211612928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758233.017307:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211612800:12345-0@lo:400:kworker.0 Request processed in 3981us (4573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758233.017317:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211612800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758233.017320:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:1.0:1782758233.516033:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758233.516056:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211613056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758233.516127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758233.516247:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613056 00000100:00100000:3.0:1782758233.516256:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613056 00000100:00100000:3.0:1782758233.516312:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1782758233.516322:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211613056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758233.516359:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758233.516411:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211613056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758233.516419:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1782758233.516481:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211613056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758233.644187:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758234.240603:0:87274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd05d15340 20000000:00000080:0.0:1782758234.240620:0:87274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5a800 uarg=0000000000000000 00010000:00010000:2.0:1782758234.241368:0:87274:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758234.241385:0:87274:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758234.241402:0:87274:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758234.241419:0:87274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.241435:0:87274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.241448:0:87274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.241487:0:87274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.241501:0:87274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 18 pid: 5796 timeout: 2402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758234.241587:0:87274:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87274:1869355211613184:0@lo:104: 00000100:00100000:2.0:1782758234.241657:0:87274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758234.241707:0:87274:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237840 going to sleep for 11 seconds 00000100:00100000:3.0:1782758234.241783:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782758234.241796:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613184 00000100:00100000:3.0:1782758234.241803:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613184 00000100:00100000:3.0:1782758234.241987:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1782758234.241999:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87274:x1869355211613184:12345-0@lo:104: 00010000:00010000:3.0:1782758234.242015:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758234.242082:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758234.242089:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87274:x1869355211613184:12345-0@lo:104: Request processed in 93us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758234.242096:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1782758234.242206:0:87274:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87274:1869355211613184:0@lo:104: 00010000:00010000:2.0:1782758234.242227:0:87274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242342:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758234.242349:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242357:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758234.242361:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242371:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758234.242378:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758234.242384:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758234.242424:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242431:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758234.242455:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242461:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777daec1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daec8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242475:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758234.242476:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758234.242478:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758234.242488:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211613312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758234.242529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758234.242572:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613312 00000100:00100000:0.0:1782758234.242577:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613312 00010000:00010000:0.0:1782758234.242598:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 2402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758234.242632:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1782758234.242640:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211613312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758234.242651:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758234.242656:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 2402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242665:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 2402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242676:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777daec8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daec1 expref: 19 pid: 5796 timeout: 2402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242689:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242696:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242708:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242715:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242721:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242726:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242730:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758234.242734:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242739:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242753:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758234.242760:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758234.242787:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211613312:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758234.242793:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1782758234.242843:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211613312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758234.243190:0:87274:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.243270:0:87274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758234.243278:0:87274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777daecf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758234.669772:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758235.501460:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758235.501471:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758235.501478:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758235.501528:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758235.501541:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758235.501553:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758235.501583:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211613440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758235.501691:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758235.501764:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171919cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758235.506052:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613440 00000100:00100000:3.0:1782758235.506067:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613440 00000100:00100000:3.0:1782758235.506159:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1782758235.506170:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211613440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758235.506190:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758235.506215:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daed6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758235.506305:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758235.506318:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758235.506328:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758235.506420:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211613440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (4728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758235.506427:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1782758235.506603:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211613440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758235.506696:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758235.506708:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758235.507023:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758235.507030:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758235.507037:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758235.701689:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758236.081406:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758236.081482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758236.081571:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613568 00000100:00100000:1.0:1782758236.081580:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613568 00000100:00100000:1.0:1782758236.081641:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1782758236.081651:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211613568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758236.081692:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782758236.083177:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758236.087333:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211613568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5672us (5839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758236.087347:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1782758236.089473:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211613568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758236.716993:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758237.364515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758237.364648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758237.364987:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769664 00000100:00100000:0.0:1782758237.364998:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769664 00000100:00100000:0.0:1782758237.365050:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1281 00000100:00100000:0.0:1782758237.365071:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196769664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758237.365155:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196769664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758237.365169:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1281 00000100:00100000:3.0:1782758237.366479:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769792 00000100:00100000:3.0:1782758237.366490:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769792 00000100:00080000:0.0:1782758237.368791:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758237.369010:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1637 00000100:00100000:2.0:1782758237.369030:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196769792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758237.369126:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196769792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 104us (4622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758237.370124:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1637 00010000:00010000:3.0:1782758237.740077:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758237.936950:0:87471:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9633b7b0 20000000:00000080:3.0:1782758237.936968:0:87471:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171a0d10000 uarg=0000000000000000 00010000:00010000:3.0:1782758237.937999:0:87471:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758237.938023:0:87471:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758237.938042:0:87471:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758237.938077:0:87471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758237.938098:0:87471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758237.938107:0:87471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758237.938151:0:87471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758237.938169:0:87471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 18 pid: 5793 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758237.938184:0:87471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87471:1869355211613696:0@lo:104: 00000100:00100000:3.0:1782758237.938250:0:87471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758237.938321:0:87471:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758237.938854:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613696 00000100:00100000:2.0:1782758237.938863:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613696 00000100:00100000:2.0:1782758237.938924:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1782758237.938935:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87471:x1869355211613696:12345-0@lo:104: 00010000:00010000:2.0:1782758237.938949:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758237.939021:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758237.939028:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87471:x1869355211613696:12345-0@lo:104: Request processed in 95us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758237.939035:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1782758237.939074:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758237.939081:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939089:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758237.939093:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939102:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758237.939110:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758237.939116:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782758237.939151:0:87471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87471:1869355211613696:0@lo:104: 00010000:00010000:0.0:1782758237.939155:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939161:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758237.939171:0:87471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939187:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939194:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777daed6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daedd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758237.939196:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211613824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758237.939209:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758237.939211:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758237.939213:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758237.939225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758237.939286:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613824 00000100:00100000:0.0:1782758237.939291:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613824 00010000:00010000:0.0:1782758237.939311:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758237.939378:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1782758237.939387:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211613824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758237.939397:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758237.939403:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939413:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939429:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daedd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daed6 expref: 19 pid: 5793 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939442:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939449:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939462:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939469:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939476:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939482:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939488:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758237.939492:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939498:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939520:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758237.939535:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758237.939581:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211613824:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758237.939588:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:1.0:1782758237.939635:0:87471:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758237.939642:0:87471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758237.939649:0:87471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daee4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758237.940686:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211613824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758238.125292:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211614336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758238.125361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758238.125542:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758238.125550:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211614208:0@lo:400:kworker.0 00000100:00100000:1.0:1782758238.125578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758238.125738:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614336 00000100:00100000:1.0:1782758238.125746:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614336 00000100:00100000:1.0:1782758238.125797:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1782758238.125806:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211614336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758238.125954:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211614336:12345-0@lo:400:kworker.0 Request processed in 149us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758238.126033:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1782758238.126090:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211614336:0@lo:400:kworker.0 00000100:00080000:0.0:1782758238.138836:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758238.145153:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211614080:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758238.145312:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758238.145320:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211613952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758238.145379:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211614464:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758238.145437:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614080 00000100:00100000:0.0:1782758238.145445:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614080 00000100:00100000:0.0:1782758238.145494:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211613952 00000100:00100000:0.0:1782758238.145497:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211613952 00000100:00100000:0.0:1782758238.145516:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1782758238.145524:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211614080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145574:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211614080:12345-0@lo:400:kworker.0 Request processed in 51us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758238.145581:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1782758238.145598:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:0.0:1782758238.145603:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211613952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145629:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211613952:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758238.145638:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:0.0:1782758238.145658:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614208 00000100:00100000:0.0:1782758238.145662:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614208 00000100:00100000:0.0:1782758238.145685:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614464 00000100:00100000:0.0:1782758238.145688:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614464 00000100:00100000:0.0:1782758238.145705:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1782758238.145711:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211614208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145747:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211614208:12345-0@lo:400:kworker.0 Request processed in 37us (20168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758238.145752:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1782758238.145762:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1782758238.145767:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211614464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145793:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211614464:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758238.145798:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:0.0:1782758238.145813:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758238.145816:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758238.145819:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758238.145870:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211613952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145881:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211614464:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145890:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211614080:0@lo:400:kworker.0 00000100:00100000:0.0:1782758238.145937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211614208:0@lo:400:kworker.0 00000100:00100000:1.0:1782758238.636233:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758238.636261:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211614592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758238.636343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758238.636443:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614592 00000100:00100000:3.0:1782758238.636452:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614592 00000100:00100000:3.0:1782758238.636519:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1782758238.636529:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211614592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758238.636567:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758238.636614:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211614592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758238.636620:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1782758238.636811:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211614592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758238.764393:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758238.878191:0:87520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd320c3d80 20000000:00000080:3.0:1782758238.878210:0:87520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171a0d10000 uarg=0000000000000000 00010000:00010000:3.0:1782758238.879719:0:87520:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758238.879738:0:87520:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758238.879755:0:87520:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758238.879776:0:87520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879792:0:87520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879803:0:87520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879810:0:87520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879816:0:87520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879840:0:87520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879847:0:87520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758238.879852:0:87520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879860:0:87520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879874:0:87520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879895:0:87520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758238.879901:0:87520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daeeb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758239.275883:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758239.275893:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758239.275899:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758239.275945:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758239.275957:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758239.275973:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758239.276000:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211614720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758239.276095:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758239.276148:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758239.276271:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614720 00000100:00100000:2.0:1782758239.276279:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614720 00000100:00100000:2.0:1782758239.276337:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1782758239.276347:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211614720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758239.276361:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758239.276384:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daef2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758239.276418:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758239.276430:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758239.276439:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758239.276478:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211614720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758239.276485:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1782758239.276640:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211614720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758239.276655:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758239.276664:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758239.276686:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758239.276691:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758239.276698:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758239.788699:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758240.812317:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758241.196275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211614848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758241.196493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758241.196578:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614848 00000100:00100000:0.0:1782758241.196587:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614848 00000100:00100000:0.0:1782758241.196655:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1782758241.196666:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211614848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758241.196704:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782758241.197650:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758241.203630:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211614848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6953us (7136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758241.203644:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1782758241.203806:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211614848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758241.836029:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758242.489241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758242.489334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758242.489481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770048 00000100:00100000:2.0:1782758242.489490:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770048 00000100:00100000:2.0:1782758242.489626:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1641 00000100:00100000:2.0:1782758242.489636:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196770048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758242.489719:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196770048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758242.489727:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1641 00000100:00080000:1.0:1782758242.489758:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758242.490334:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196769920 00000100:00100000:1.0:1782758242.490341:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196769920 00000100:00100000:1.0:1782758242.490385:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1283 00000100:00100000:1.0:1782758242.490393:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196769920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758242.490440:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196769920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758242.490446:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1283 00010000:00010000:0.0:1782758242.876133:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758243.254233:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211615104:0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758243.254366:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211615616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758243.254420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758243.254425:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211615232:0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758243.254473:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615104 00000100:00100000:0.0:1782758243.254479:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615104 00000100:00100000:0.0:1782758243.254516:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615232 00000100:00100000:0.0:1782758243.254518:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615232 00000100:00100000:0.0:1782758243.254542:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1782758243.254549:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211615104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254602:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211615104:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758243.254609:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1782758243.254626:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1782758243.254632:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211615232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254658:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211615232:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758243.254664:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1782758243.254683:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615616 00000100:00100000:0.0:1782758243.254686:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615616 00000100:00100000:0.0:1782758243.254711:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1782758243.254716:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211615616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254744:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211615616:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758243.254750:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00080000:0.0:1782758243.254768:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758243.254772:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758243.254807:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211615232:0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254818:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211615104:0@lo:400:kworker.0 00000100:00100000:0.0:1782758243.254849:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211615616:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255435:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211614976:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758243.255504:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211615488:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758243.255541:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758243.255547:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211615360:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758243.255599:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211614976 00000100:00100000:2.0:1782758243.255603:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211614976 00000100:00100000:2.0:1782758243.255635:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1782758243.255641:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211614976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255680:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211614976:12345-0@lo:400:kworker.0 Request processed in 39us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758243.255685:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1782758243.255714:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615488 00000100:00100000:2.0:1782758243.255717:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615488 00000100:00100000:2.0:1782758243.255749:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1782758243.255755:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211615488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255785:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211615488:12345-0@lo:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758243.255791:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1782758243.255808:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615360 00000100:00100000:2.0:1782758243.255811:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615360 00000100:00100000:2.0:1782758243.255859:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1782758243.255866:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255892:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211615360:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758243.255897:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1782758243.255928:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211615360:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255935:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211614976:0@lo:400:kworker.0 00000100:00100000:2.0:1782758243.255958:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211615488:0@lo:400:kworker.0 00000100:00080000:2.0:1782758243.255984:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758243.255988:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758243.756240:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758243.756327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758243.756395:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615744 00000100:00100000:0.0:1782758243.756403:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615744 00000100:00100000:0.0:1782758243.756454:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1782758243.756464:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211615744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758243.756633:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758243.757187:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211615744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 723us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758243.757195:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1782758243.757196:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211615744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758243.884070:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758244.911251:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758245.286184:0:87813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf93c5640 20000000:00000080:0.0:1782758245.286208:0:87813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7a92c00 uarg=0000000000000000 00010000:00010000:0.0:1782758245.289018:0:87813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758245.289048:0:87813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758245.289067:0:87813:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758245.289087:0:87813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.289103:0:87813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.289112:0:87813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.289149:0:87813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.289163:0:87813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 18 pid: 5796 timeout: 2413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758245.289178:0:87813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87813:1869355211615872:0@lo:104: 00000100:00100000:0.0:1782758245.289237:0:87813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758245.289351:0:87813:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758245.289546:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211615872 00000100:00100000:1.0:1782758245.289553:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211615872 00000100:00100000:1.0:1782758245.289653:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1782758245.289664:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87813:x1869355211615872:12345-0@lo:104: 00010000:00010000:1.0:1782758245.289677:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758245.289758:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758245.289765:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:87813:x1869355211615872:12345-0@lo:104: Request processed in 103us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758245.289772:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:3.0:1782758245.289850:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758245.289857:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.289865:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758245.289869:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.289878:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758245.289885:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758245.289890:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758245.289930:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.289936:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758245.289957:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.289963:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777daef2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daef9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.289979:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758245.289981:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758245.289983:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758245.290001:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211616000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758245.290031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758245.290068:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616000 00000100:00100000:3.0:1782758245.290072:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616000 00010000:00010000:3.0:1782758245.290089:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 19 pid: 5796 timeout: 2413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758245.290108:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1782758245.290114:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211616000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758245.290124:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758245.290128:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 19 pid: 5796 timeout: 2413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290137:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 19 pid: 5796 timeout: 2413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290152:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290161:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290174:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290181:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290186:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290190:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290193:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758245.290196:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290200:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290205:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758245.290211:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758245.290231:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211616000:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758245.290235:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1782758245.290260:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211616000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758245.290496:0:87813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777daef9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daef2 expref: 18 pid: 5796 timeout: 2413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758245.290506:0:87813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87813:1869355211615872:0@lo:104: 00010000:00010000:0.0:1782758245.290517:0:87813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.290530:0:87813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.290536:0:87813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758245.290542:0:87813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777daf00 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758245.934643:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758246.301693:0:87863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb954d000 20000000:00000080:2.0:1782758246.301711:0:87863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c7400 uarg=0000000000000000 00010000:00010000:2.0:1782758246.304681:0:87863:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758246.304703:0:87863:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758246.304718:0:87863:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758246.304740:0:87863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304756:0:87863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304766:0:87863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304772:0:87863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304778:0:87863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304783:0:87863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304789:0:87863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758246.304793:0:87863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304804:0:87863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304817:0:87863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304842:0:87863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758246.304849:0:87863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777daf07 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758246.316272:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211616128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758246.316374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758246.317335:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616128 00000100:00100000:3.0:1782758246.317344:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616128 00000100:00100000:3.0:1782758246.317418:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1782758246.317429:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211616128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758246.317465:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758246.317522:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211616128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758246.317529:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00080000:2.0:1782758246.317586:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758246.317625:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211616128:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782758246.892972:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758246.892979:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758246.892983:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758246.893026:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758246.893039:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758246.893051:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758246.893078:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211616256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758246.893146:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758246.893210:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758246.893265:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616256 00000100:00100000:3.0:1782758246.893273:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616256 00000100:00100000:3.0:1782758246.893324:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1782758246.893334:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211616256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758246.893346:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758246.893359:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daf0e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758246.893381:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758246.893391:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758246.893400:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782758246.893441:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211616256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758246.893448:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1782758246.895540:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211616256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758246.895568:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758246.895581:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758246.895604:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758246.895610:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758246.895617:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758246.956335:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758247.605151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758247.605214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758247.605245:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770304 00000100:00100000:0.0:1782758247.605255:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770304 00000100:00100000:0.0:1782758247.605320:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1645 00000100:00100000:0.0:1782758247.605331:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196770304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758247.605405:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196770304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758247.605414:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1645 00000100:00080000:0.0:1782758247.605437:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758247.606797:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770176 00000100:00100000:3.0:1782758247.606808:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770176 00000100:00100000:3.0:1782758247.606907:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1286 00000100:00100000:3.0:1782758247.606917:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196770176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758247.606982:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196770176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758247.606989:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1286 00010000:00010000:3.0:1782758247.988509:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758248.364522:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211616512:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364649:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211617024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364704:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782758248.364710:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211616384:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364781:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211616896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364866:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211616768:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364910:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758248.364915:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211616640:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.364935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758248.364963:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616512 00000100:00100000:1.0:1782758248.364970:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616512 00000100:00100000:1.0:1782758248.365010:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616896 00000100:00100000:1.0:1782758248.365014:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616896 00000100:00100000:1.0:1782758248.365040:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616640 00000100:00100000:1.0:1782758248.365042:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616640 00000100:00100000:1.0:1782758248.365058:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1782758248.365066:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211616512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.365117:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211616512:12345-0@lo:400:kworker.0 Request processed in 50us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758248.365125:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1782758248.365145:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1782758248.365151:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211616896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365373:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1782758248.365382:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211616640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365432:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211616640:12345-0@lo:400:kworker.0 Request processed in 52us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758248.365439:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1782758248.365459:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617024 00000100:00100000:0.0:1782758248.365463:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617024 00000100:00100000:0.0:1782758248.365497:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616768 00000100:00100000:0.0:1782758248.365501:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616768 00000100:00100000:0.0:1782758248.365523:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1782758248.365528:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211617024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365560:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211617024:12345-0@lo:400:kworker.0 Request processed in 32us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758248.365566:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1782758248.365578:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1782758248.365583:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211616768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365610:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211616768:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758248.365615:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1782758248.365633:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211616384 00000100:00100000:0.0:1782758248.365637:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211616384 00000100:00100000:0.0:1782758248.365657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1782758248.365663:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211616384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365691:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211616384:12345-0@lo:400:kworker.0 Request processed in 28us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758248.365697:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00080000:0.0:1782758248.365740:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758248.365744:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758248.365747:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758248.365788:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211616384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365802:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211616512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758248.365810:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211617024:0@lo:400:kworker.0 00000100:00100000:3.0:1782758248.365975:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211616640:0@lo:400:kworker.0 00000100:00100000:3.0:1782758248.365985:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211616768:0@lo:400:kworker.0 00000100:00100000:1.0:1782758248.366343:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211616896:12345-0@lo:400:kworker.0 Request processed in 1190us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758248.366352:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1782758248.370979:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211616896:0@lo:400:kworker.0 00000100:00100000:2.0:1782758248.886936:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758248.886959:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211617152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758248.887027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758248.887335:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617152 00000100:00100000:3.0:1782758248.887344:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617152 00000100:00100000:3.0:1782758248.887500:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1782758248.887509:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211617152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758248.887545:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758248.887606:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211617152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758248.887613:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1782758248.887695:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211617152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758249.003978:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758249.772888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758249.772921:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770432 00000100:00100000:0.0:1782758249.772931:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770432 00000100:00100000:0.0:1782758249.772986:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 964 00000100:00100000:0.0:1782758249.772995:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52050:x1869355196770432:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758249.773014:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758249.773092:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777daf1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b94 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773163:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773176:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773189:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758249.773365:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758249.773369:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758249.773442:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773465:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777daf1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b94 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773480:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b94 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.773488:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758249.773492:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758249.773496:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50200, rc 0) 00000100:00100000:0.0:1782758249.773545:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52050:x1869355196770432:12345-192.168.204.31@tcp:101:rm.0 Request processed in 552us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758249.773552:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 964 00000100:00080000:0.0:1782758249.773575:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758249.777177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758249.777214:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770560 00000100:00100000:0.0:1782758249.777223:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770560 00000100:00100000:0.0:1782758249.777268:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:0.0:1782758249.777277:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52050:x1869355196770560:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758249.777297:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758249.777315:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777daf2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64b9b expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777375:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777388:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777399:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777414:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777421:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777427:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777675:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777683:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777690:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777696:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758249.777701:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.777708:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778003:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758249.778008:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758249.778013:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778019:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777daf31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778029:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778035:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778040:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778045:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758249.778048:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778053:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778060:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff91718bcfd300) 00010000:00010000:0.0:1782758249.778062:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758249.778065:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778070:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777daf38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778099:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777daf2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b9b expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778108:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758249.778110:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758249.778113:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777daf2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b9b expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758249.778121:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758249.780012:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52050:x1869355196770560:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2731us (2839us total) trans 0 rc 301/301 00000100:00100000:0.0:1782758249.780021:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:0.0:1782758249.827169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758249.827218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758249.827250:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770944 00000100:00100000:1.0:1782758249.827261:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770944 00000100:00100000:1.0:1782758249.827312:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196770688 00000100:00100000:1.0:1782758249.827315:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196770688 00000100:00100000:1.0:1782758249.827379:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:1.0:1782758249.827388:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52055:x1869355196770944:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782758249.827443:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758249.827471:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777daf23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64b94 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827489:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:1.0:1782758249.827500:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758249.827782:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827796:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827805:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827863:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827871:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.827877:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758249.828945:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00010000:00010000:1.0:1782758249.828958:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.828966:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.828974:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.828980:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758249.828984:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.828992:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.829005:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758249.829009:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758249.829013:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.829019:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758249.829034:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d9322b8 reply state 00000000680b9855 transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758249.829043:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758249.829134:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52055:x1869355196770944:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1743us (1972us total) trans 4294967672 rc 0/0 00000100:00100000:1.0:1782758249.829142:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:1.0:1782758249.829173:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 967 00000100:00100000:1.0:1782758249.829181:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196770688:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:1.0:1782758249.829208:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782758249.829237:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196770688:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 57us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758249.829244:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 967 00010000:00010000:3.0:1782758249.838894:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838911:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838919:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838925:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758249.838932:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838939:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838956:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9171a0e3a700) 00010000:00010000:3.0:1782758249.838959:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758249.838964:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.838970:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777daf46 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758249.907726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758249.907881:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771072 00000100:00100000:1.0:1782758249.907892:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771072 00000100:00100000:1.0:1782758249.907952:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:1.0:1782758249.907963:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52059:x1869355196771072:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782758249.907993:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758249.908017:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ba2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908083:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908097:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908108:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758249.908173:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758249.908176:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758249.908199:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908219:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777daf4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba2 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908239:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba2 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.908252:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758249.908254:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758249.908258:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758249.908319:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52059:x1869355196771072:12345-192.168.204.31@tcp:101:chown.0 Request processed in 358us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758249.908327:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:0.0:1782758249.911181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758249.911302:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771200 00000100:00100000:3.0:1782758249.911311:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771200 00000100:00100000:3.0:1782758249.911407:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:3.0:1782758249.911418:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52059:x1869355196771200:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782758249.911437:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758249.911454:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777daf5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ba9 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911508:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911522:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911534:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911552:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911559:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911566:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911698:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911707:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911715:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758249.911764:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:3.0:1782758249.911768:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758249.911791:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911802:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911808:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911861:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911871:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758249.911875:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911882:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911894:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:3.0:1782758249.911897:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758249.911901:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911907:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777daf62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911917:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911923:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911928:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911933:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758249.911936:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911941:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911950:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75300) 00010000:00010000:3.0:1782758249.911952:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758249.911955:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911960:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777daf69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.911987:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777daf5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba9 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.912000:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba9 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.912006:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758249.912008:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758249.912010:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758249.912061:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52059:x1869355196771200:12345-192.168.204.31@tcp:101:chown.0 Request processed in 644us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758249.912069:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:2.0:1782758249.916222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758249.917994:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771456 00000100:00100000:1.0:1782758249.918008:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771456 00000100:00100000:1.0:1782758249.918293:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:1.0:1782758249.918305:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52059:x1869355196771456:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782758249.918354:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758249.918380:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777daf70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba9 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.918399:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758249.918409:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758249.918432:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.918445:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758249.918454:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758249.918655:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001462b178 reply state 00000000b9b29356 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758249.918671:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758249.918683:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000100:00100000:1.0:1782758249.918777:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52059:x1869355196771456:12345-192.168.204.31@tcp:36:chown.0 Request processed in 473us (2564us total) trans 4294967673 rc 0/0 00000100:00100000:1.0:1782758249.918784:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 970 00010000:00010000:3.0:1782758249.924030:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924047:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924055:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924066:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758249.924071:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924079:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924096:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:3.0:1782758249.924099:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758249.924103:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758249.924109:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777daf77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758250.032148:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758250.479569:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967673 is committed 00000020:00000080:2.0:1782758250.826659:0:88060:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd2847d10 20000000:00000080:2.0:1782758250.826678:0:88060:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718383b400 uarg=0000000000000000 00010000:00010000:3.0:1782758250.829395:0:88060:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758250.829439:0:88060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:3.0:1782758250.829443:0:88060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758250.829454:0:88060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777daf54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ba2 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.829479:0:88060:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758250.829499:0:88060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758250.829512:0:88060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.829525:0:88060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.829539:0:88060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.829578:0:88060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.829592:0:88060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 18 pid: 5796 timeout: 2419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758250.829606:0:88060:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88060:1869355211617280:0@lo:104: 00000100:00100000:3.0:1782758250.829755:0:88060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758250.829889:0:88060:0:(client.c:2701:ptlrpc_set_wait()) set ffff917190899000 going to sleep for 11 seconds 00000100:00100000:2.0:1782758250.830104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617280 00000100:00100000:2.0:1782758250.830180:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617280 00000100:00100000:2.0:1782758250.830265:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1782758250.830276:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88060:x1869355211617280:12345-0@lo:104: 00010000:00010000:2.0:1782758250.830292:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758250.830448:0:88060:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88060:1869355211617280:0@lo:104: 00010000:00010000:0.0:1782758250.830468:0:88060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758250.830509:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758250.830516:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88060:x1869355211617280:12345-0@lo:104: Request processed in 243us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758250.830523:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:1.0:1782758250.830562:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758250.830569:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758250.830576:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758250.830580:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758250.830589:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758250.830596:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758250.830601:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758250.830740:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758250.830747:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758250.830768:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758250.830775:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777daf0e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf15 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758250.830805:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758250.830806:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758250.830808:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758250.830840:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211617408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758250.830998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758250.831089:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617408 00000100:00100000:3.0:1782758250.831094:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617408 00010000:00010000:3.0:1782758250.831129:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 2419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758250.831158:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1782758250.831165:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211617408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758250.831187:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758250.831193:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 2419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831202:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 2419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831214:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777daf15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daf0e expref: 19 pid: 5796 timeout: 2419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831231:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831239:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831252:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831258:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831264:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831270:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831275:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758250.831278:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831285:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831299:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758250.831308:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758250.831337:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211617408:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758250.831345:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1782758250.831550:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211617408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758250.835079:0:88060:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758250.835099:0:88060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758250.835107:0:88060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777daf7e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758251.054025:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758251.447797:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211617536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758251.447888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758251.447959:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617536 00000100:00100000:0.0:1782758251.447967:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617536 00000100:00100000:0.0:1782758251.448027:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1782758251.448037:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211617536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758251.448072:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758251.448116:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211617536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758251.448124:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:0.0:1782758251.448144:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758251.448176:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211617536:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782758251.752134:0:88108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea34cbc80 20000000:00000080:1.0:1782758251.752151:0:88108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba89400 uarg=0000000000000000 00010000:00010000:1.0:1782758251.752374:0:88108:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758251.752389:0:88108:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758251.752403:0:88108:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758251.752424:0:88108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752440:0:88108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752452:0:88108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752459:0:88108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752465:0:88108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752472:0:88108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752484:0:88108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758251.752488:0:88108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752496:0:88108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752509:0:88108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752517:0:88108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758251.752524:0:88108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777daf85 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758252.079364:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758252.460266:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758252.460274:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758252.460279:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758252.460322:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758252.460333:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758252.460343:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758252.460367:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211617664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758252.460432:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758252.460474:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f240 going to sleep for 11 seconds 00000100:00100000:2.0:1782758252.460494:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617664 00000100:00100000:2.0:1782758252.460500:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617664 00000100:00100000:2.0:1782758252.460560:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1782758252.460569:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211617664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758252.460583:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758252.460595:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777daf8c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758252.460620:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758252.460631:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758252.460639:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758252.460685:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211617664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758252.460692:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1782758252.461426:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211617664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758252.461444:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758252.461453:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758252.461472:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758252.461477:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758252.461483:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758252.725642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758252.725685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758252.725808:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771712 00000100:00100000:1.0:1782758252.725819:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771712 00000100:00100000:1.0:1782758252.725906:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1649 00000100:00100000:1.0:1782758252.725916:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196771712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782758252.725940:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758252.726001:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196771712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758252.726009:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1649 00000100:00100000:3.0:1782758252.726141:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771584 00000100:00100000:3.0:1782758252.726146:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771584 00000100:00100000:3.0:1782758252.726186:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1289 00000100:00100000:3.0:1782758252.726194:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196771584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758252.726221:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196771584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758252.726226:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1289 00010000:00010000:1.0:1782758253.100083:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758253.488019:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211617920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758253.488158:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211618432:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758253.488209:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758253.488215:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211618048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758253.488288:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617920 00000100:00100000:0.0:1782758253.488295:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617920 00000100:00100000:0.0:1782758253.488337:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618048 00000100:00100000:0.0:1782758253.488340:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618048 00000100:00100000:0.0:1782758253.488367:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:0.0:1782758253.488376:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211617920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488425:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211617920:12345-0@lo:400:kworker.0 Request processed in 50us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758253.488432:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:0.0:1782758253.488449:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:0.0:1782758253.488456:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211618048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488482:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211618048:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758253.488489:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:0.0:1782758253.488506:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618432 00000100:00100000:0.0:1782758253.488509:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618432 00000100:00100000:0.0:1782758253.488534:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1782758253.488540:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211618432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488569:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211618432:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758253.488575:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00080000:0.0:1782758253.488596:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758253.488600:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758253.488639:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211618048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488650:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211617920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.488672:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211618432:0@lo:400:kworker.0 00000100:00100000:2.0:1782758253.490387:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211618176:0@lo:400:kworker.0 00000100:00100000:2.0:1782758253.490572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758253.490673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758253.490682:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211617792:0@lo:400:kworker.0 00000100:00100000:2.0:1782758253.490713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758253.490887:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618176 00000100:00100000:3.0:1782758253.490896:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618176 00000100:00100000:3.0:1782758253.490946:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1782758253.490955:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758253.491005:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211618176:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758253.491011:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:3.0:1782758253.491034:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758253.491127:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211618304:0@lo:400:kworker.0 00000100:00100000:2.0:1782758253.491157:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758253.491201:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211618176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758253.491279:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618304 00000100:00100000:3.0:1782758253.491282:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618304 00000100:00100000:3.0:1782758253.491317:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00080000:2.0:1782758253.491317:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758253.491324:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758253.491360:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211618304:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758253.491367:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1782758253.491558:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211618304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.492176:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211617792 00000100:00100000:0.0:1782758253.492182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211617792 00000100:00100000:0.0:1782758253.492215:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1782758253.492222:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211617792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758253.492307:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211617792:12345-0@lo:400:kworker.0 Request processed in 85us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758253.492314:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1782758253.492582:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211617792:0@lo:400:kworker.0 00000100:00100000:3.0:1782758253.997317:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758253.997340:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211618560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758253.997406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758253.997468:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618560 00000100:00100000:3.0:1782758253.997476:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618560 00000100:00100000:3.0:1782758253.997519:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1782758253.997528:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211618560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758253.997567:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758253.997612:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211618560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758253.997620:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1782758253.997669:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211618560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758254.128235:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758255.151167:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758255.519350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758255.519418:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771840 00000100:00100000:3.0:1782758255.519428:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771840 00000100:00100000:3.0:1782758255.519505:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1782758255.519516:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196771840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758255.519531:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758255.519535:0:5786:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777daf54) 00010000:00010000:3.0:1782758255.519536:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758255.519591:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196771840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (248us total) trans 0 rc 116/116 00000100:00100000:3.0:1782758255.519599:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00080000:2.0:1782758255.523928:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758256.178341:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758256.556503:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758256.556526:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211618688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758256.556601:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758256.556663:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618688 00000100:00100000:3.0:1782758256.556670:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618688 00000100:00100000:3.0:1782758256.556737:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1782758256.556747:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211618688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758256.556780:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758256.556938:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211618688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758256.556946:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00080000:3.0:1782758256.556968:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758256.557288:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211618688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758257.197002:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758257.679458:0:88354:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbd27c7a0 20000000:00000080:2.0:1782758257.679477:0:88354:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917187966800 uarg=0000000000000000 00010000:00010000:2.0:1782758257.679965:0:88354:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758257.679980:0:88354:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758257.679994:0:88354:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758257.680010:0:88354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758257.680026:0:88354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758257.680035:0:88354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758257.680069:0:88354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758257.680084:0:88354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 18 pid: 5796 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758257.680098:0:88354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88354:1869355211618816:0@lo:104: 00000100:00100000:2.0:1782758257.680153:0:88354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758257.680208:0:88354:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170812ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1782758257.680576:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618816 00000100:00100000:3.0:1782758257.680584:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618816 00000100:00100000:3.0:1782758257.680627:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1782758257.680635:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88354:x1869355211618816:12345-0@lo:104: 00010000:00010000:3.0:1782758257.680648:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758257.680717:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758257.680724:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88354:x1869355211618816:12345-0@lo:104: Request processed in 90us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758257.680731:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1782758257.680815:0:88354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88354:1869355211618816:0@lo:104: 00010000:00010000:0.0:1782758257.680861:0:88354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.680924:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758257.680931:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.680944:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758257.680948:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.680956:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758257.680964:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758257.680983:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758257.681013:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681020:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758257.681042:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681050:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777daf8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777daf93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681065:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758257.681066:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758257.681068:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758257.681075:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758257.681084:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211618944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758257.681112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758257.681144:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211618944 00000100:00100000:1.0:1782758257.681148:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211618944 00010000:00010000:1.0:1782758257.681165:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758257.681184:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1782758257.681189:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211618944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758257.681199:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758257.681204:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681214:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681225:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777daf93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777daf8c expref: 19 pid: 5796 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681236:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681245:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681257:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681264:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681271:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681277:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681284:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758257.681288:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681295:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681305:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758257.681314:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758257.681336:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211618944:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758257.681343:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1782758257.681370:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211618944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758257.681429:0:88354:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758257.681437:0:88354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758257.681444:0:88354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777daf9a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758257.860768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758257.860807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758257.860859:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196771968 00000100:00100000:0.0:1782758257.860867:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196771968 00000100:00100000:0.0:1782758257.860908:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:0.0:1782758257.860916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196771968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758257.860992:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196771968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758257.861003:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:0.0:1782758257.861034:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772096 00000100:00100000:0.0:1782758257.861037:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772096 00000100:00100000:0.0:1782758257.861082:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1653 00000100:00100000:0.0:1782758257.861088:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196772096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758257.861115:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196772096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758257.861121:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1653 00000100:00080000:0.0:1782758257.861225:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758258.220235:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758258.613456:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211619072:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.613574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.613655:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211619584:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.613686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.613792:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758258.613802:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211619200:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.613857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.613878:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211619712:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.613914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.613955:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211619328:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.613987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.614010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758258.614017:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211619456:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.614039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758258.614081:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619584 00000100:00100000:0.0:1782758258.614091:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619584 00000100:00100000:0.0:1782758258.614157:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619200 00000100:00100000:0.0:1782758258.614161:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619200 00000100:00100000:0.0:1782758258.614180:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619328 00000100:00100000:0.0:1782758258.614183:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619328 00000100:00100000:0.0:1782758258.614202:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1782758258.614213:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211619584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.614561:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211619584:12345-0@lo:400:kworker.0 Request processed in 349us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758258.614571:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1782758258.614599:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1782758258.614610:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211619200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758258.614650:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211619584:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.614662:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211619200:12345-0@lo:400:kworker.0 Request processed in 54us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758258.614670:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1782758258.614694:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1782758258.614697:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211619200:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.614708:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211619328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.614751:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211619328:12345-0@lo:400:kworker.0 Request processed in 48us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758258.614757:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1782758258.614909:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619712 00000100:00100000:1.0:1782758258.614918:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619712 00000100:00100000:1.0:1782758258.614990:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619456 00000100:00100000:1.0:1782758258.614994:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619456 00000100:00100000:1.0:1782758258.615024:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1782758258.615039:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211619712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758258.615043:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619072 00000100:00100000:3.0:1782758258.615052:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619072 00000100:00100000:3.0:1782758258.615122:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1782758258.615136:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211619072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758258.615144:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211619712:12345-0@lo:400:kworker.0 Request processed in 106us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758258.615160:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1782758258.615187:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1782758258.615196:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211619456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758258.615210:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211619072:12345-0@lo:400:kworker.0 Request processed in 78us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758258.615219:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1782758258.615242:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211619456:12345-0@lo:400:kworker.0 Request processed in 47us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758258.615251:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1782758258.615499:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211619712:0@lo:400:kworker.0 00000100:00100000:1.0:1782758258.615511:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211619072:0@lo:400:kworker.0 00000100:00080000:0.0:1782758258.615635:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758258.615651:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758258.615655:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758258.615706:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211619456:0@lo:400:kworker.0 00000100:00100000:0.0:1782758258.615722:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211619328:0@lo:400:kworker.0 00000100:00100000:1.0:1782758259.116959:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758259.116993:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758259.117099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758259.117391:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619840 00000100:00100000:3.0:1782758259.117402:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619840 00000100:00100000:3.0:1782758259.117460:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1782758259.117471:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211619840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758259.117523:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758259.117594:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211619840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758259.117607:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1782758259.120931:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211619840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758259.247051:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758259.691990:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758259.692001:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758259.692008:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758259.692081:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758259.692095:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758259.692109:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758259.692145:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211619968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758259.692243:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758259.692315:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758259.693102:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211619968 00000100:00100000:3.0:1782758259.693115:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211619968 00000100:00100000:3.0:1782758259.693184:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1782758259.693194:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211619968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758259.693212:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758259.693235:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dafa1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758259.693265:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758259.693278:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758259.693289:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782758259.693388:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211619968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758259.693395:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1782758259.693740:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211619968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758259.693761:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758259.693770:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758259.693794:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758259.693802:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758259.693810:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758260.269359:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758261.293467:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758261.552985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758261.553879:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772224 00000100:00100000:1.0:1782758261.553890:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772224 00000100:00100000:1.0:1782758261.553975:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00100000:1.0:1782758261.553986:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52237:x1869355196772224:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758261.554007:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758261.554031:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dafaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bb0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554096:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554114:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554126:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758261.554334:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758261.554339:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758261.554426:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554450:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dafaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb0 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554468:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb0 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.554476:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758261.554478:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758261.554482:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758261.554543:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52237:x1869355196772224:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 559us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758261.554550:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00080000:0.0:1782758261.555615:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758261.558632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758261.560893:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772352 00000100:00100000:1.0:1782758261.560916:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772352 00000100:00100000:1.0:1782758261.560975:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:1.0:1782758261.560986:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52237:x1869355196772352:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758261.561009:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758261.561033:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dafbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bb7 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561097:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561110:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561122:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561134:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561141:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561147:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561530:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561539:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561547:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758261.561652:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1782758261.561657:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758261.561741:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561754:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561760:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561767:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561773:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758261.561777:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561783:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561795:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758261.561798:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758261.561803:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561807:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dafc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561818:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561855:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561859:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561864:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758261.561867:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561872:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561878:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9171a0e3a600) 00010000:00010000:1.0:1782758261.561880:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758261.561883:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561887:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dafcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561915:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dafbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb7 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561927:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb7 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758261.561933:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758261.561936:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758261.561938:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782758261.562006:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52237:x1869355196772352:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1022us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758261.562014:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:1.0:1782758261.576750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758261.577066:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772608 00000100:00100000:0.0:1782758261.577076:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772608 00000100:00100000:0.0:1782758261.577137:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:0.0:1782758261.577147:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52237:x1869355196772608:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758261.577202:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758261.577234:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dafd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb7 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758261.577256:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:0.0:1782758261.577269:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758261.577296:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758261.577309:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758261.577320:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758261.694645:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211620096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758261.694729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758261.694848:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620096 00000100:00100000:0.0:1782758261.694856:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620096 00000100:00100000:0.0:1782758261.694914:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1782758261.694923:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211620096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758261.694963:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758261.695009:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211620096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758261.695015:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00080000:0.0:1782758261.695038:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758261.695071:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211620096:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1782758261.706650:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00010000:1.0:1782758261.706706:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd7871bd reply state 0000000051d1c374 transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758261.706723:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758261.706957:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:1.0:1782758261.707057:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758261.707077:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52237:x1869355196772608:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 129928us (130332us total) trans 4294967674 rc 0/0 00000100:00100000:1.0:1782758261.707086:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 973 00010000:00010000:3.0:1782758261.709970:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.709988:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.710001:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.710006:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758261.710011:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.710020:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.710040:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:3.0:1782758261.710044:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758261.710050:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758261.710056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dafd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.316323:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758262.967552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758262.967644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758262.968264:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772864 00000100:00100000:2.0:1782758262.968273:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772864 00000100:00100000:2.0:1782758262.968333:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1657 00000100:00100000:2.0:1782758262.968344:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196772864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758262.968428:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196772864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758262.968436:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1657 00000020:00000080:1.0:1782758262.973862:0:88551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd582f0a0 20000000:00000080:1.0:1782758262.974034:0:88551:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7833800 uarg=0000000000000000 00010000:00010000:1.0:1782758262.974710:0:88551:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758262.974747:0:88551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758262.974751:0:88551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758262.974762:0:88551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dafb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bb0 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758262.974784:0:88551:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782758262.974801:0:88551:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758262.974815:0:88551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758262.974941:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772736 00000100:00100000:0.0:1782758262.974952:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772736 00000100:00100000:0.0:1782758262.975006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1294 00000100:00100000:0.0:1782758262.975016:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196772736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758262.975160:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196772736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 145us (7619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758262.975168:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1294 00010000:00010000:1.0:1782758262.975329:0:88551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758262.975339:0:88551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758262.975373:0:88551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758262.975386:0:88551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 18 pid: 5793 timeout: 2431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758262.975400:0:88551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88551:1869355211620224:0@lo:104: 00000100:00100000:1.0:1782758262.975446:0:88551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758262.975530:0:88551:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083696d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758262.978277:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620224 00000100:00100000:3.0:1782758262.978290:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620224 00000100:00100000:3.0:1782758262.978340:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1782758262.978350:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88551:x1869355211620224:12345-0@lo:104: 00010000:00010000:3.0:1782758262.978369:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.978530:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758262.978538:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88551:x1869355211620224:12345-0@lo:104: Request processed in 190us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758262.978546:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782758262.978635:0:88551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88551:1869355211620224:0@lo:104: 00010000:00010000:1.0:1782758262.978660:0:88551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982175:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758262.982188:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982205:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758262.982208:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982218:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758262.982225:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758262.982230:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758262.982332:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982340:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758262.982373:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982380:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dafa1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafa8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758262.982401:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758262.982403:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758262.982405:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758262.982419:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758262.982438:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211620352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758262.982502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758262.982740:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620352 00000100:00100000:3.0:1782758262.982748:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620352 00010000:00010000:3.0:1782758262.982779:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 2431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758262.982809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1782758262.982841:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211620352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758262.982858:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758262.982864:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 2431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982887:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 2431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982901:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dafa8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dafa1 expref: 19 pid: 5793 timeout: 2431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982915:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982923:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982938:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982945:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982957:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982963:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982968:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758262.982972:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.982981:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.983002:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758262.983012:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758262.983051:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211620352:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758262.983058:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1782758262.983094:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211620352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758262.983265:0:88551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758262.983274:0:88551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758262.983281:0:88551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dafe0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758263.341121:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758263.724426:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758263.724452:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211620864:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.724519:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211620992:0@lo:400:kworker.0 00000100:00100000:2.0:1782758263.724521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758263.724581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758263.724598:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211620480:0@lo:400:kworker.0 00000100:00100000:2.0:1782758263.724636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758263.724636:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211620608:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.724672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758263.724680:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620480 00000100:00100000:2.0:1782758263.724688:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620480 00000100:00100000:2.0:1782758263.724731:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1782758263.724742:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211620480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.724764:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211621120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.724804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758263.724805:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211620480:12345-0@lo:400:kworker.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758263.724815:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1782758263.724874:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758263.724882:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211620736:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.724912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758263.724955:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620992 00000100:00100000:0.0:1782758263.724959:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620992 00000100:00100000:0.0:1782758263.724997:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620608 00000100:00100000:0.0:1782758263.725000:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620608 00000100:00100000:0.0:1782758263.725016:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620736 00000100:00100000:0.0:1782758263.725019:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620736 00000100:00100000:0.0:1782758263.725032:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:0.0:1782758263.725038:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211620992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211620992:12345-0@lo:400:kworker.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758263.725102:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:0.0:1782758263.725120:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1782758263.725127:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211620608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725164:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211620608:12345-0@lo:400:kworker.0 Request processed in 38us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758263.725171:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1782758263.725187:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1782758263.725194:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725225:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211620736:12345-0@lo:400:kworker.0 Request processed in 33us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758263.725232:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1782758263.725260:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211620864 00000100:00100000:0.0:1782758263.725263:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211620864 00000100:00100000:0.0:1782758263.725289:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621120 00000100:00100000:0.0:1782758263.725292:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621120 00000100:00100000:0.0:1782758263.725310:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1782758263.725317:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211620864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725349:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211620864:12345-0@lo:400:kworker.0 Request processed in 34us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758263.725356:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1782758263.725373:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1782758263.725381:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211621120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725409:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211621120:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758263.725416:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00080000:0.0:1782758263.725436:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758263.725440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758263.725442:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758263.725474:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211620992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725499:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211620736:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725510:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211620608:0@lo:400:kworker.0 00000100:00100000:0.0:1782758263.725525:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211621120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758263.727605:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211620864:0@lo:400:kworker.0 00000100:00100000:2.0:1782758263.727623:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211620480:0@lo:400:kworker.0 10000000:01000000:3.0:1782758264.172146:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758264.172154:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758264.172157:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758264.172211:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758264.172223:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758264.172235:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758264.172375:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211621248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758264.172449:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758264.172503:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059a900 going to sleep for 11 seconds 00000100:00100000:0.0:1782758264.172564:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621248 00000100:00100000:0.0:1782758264.172573:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621248 00000100:00100000:0.0:1782758264.172630:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1782758264.172639:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211621248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758264.172654:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758264.172668:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dafe7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758264.172691:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758264.172701:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758264.172710:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:0.0:1782758264.172750:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211621248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758264.172756:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1782758264.173200:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211621248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758264.173217:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758264.173227:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758264.173366:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758264.173373:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758264.173381:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758264.240009:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211621376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758264.240400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758264.241410:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621376 00000100:00100000:3.0:1782758264.241421:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621376 00000100:00100000:3.0:1782758264.241643:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1782758264.241653:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211621376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758264.241692:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758264.241763:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211621376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758264.241771:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1782758264.241909:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211621376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758264.369031:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758265.391115:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758266.416336:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758266.795989:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758266.796017:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211621504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758266.796096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758266.796157:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621504 00000100:00100000:0.0:1782758266.796164:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621504 00000100:00100000:0.0:1782758266.796212:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1782758266.796220:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211621504:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758266.796332:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782758266.796433:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758266.796523:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211621504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 303us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758266.796531:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1782758266.804155:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211621504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758267.061363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.061547:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196772992 00000100:00100000:0.0:1782758267.061557:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196772992 00000100:00100000:0.0:1782758267.061641:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:0.0:1782758267.061653:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52314:x1869355196772992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758267.061678:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758267.061704:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777daff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bbe expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061776:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061791:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061817:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061885:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061893:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.061900:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062352:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062361:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062369:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758267.062446:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1782758267.062450:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758267.062535:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062548:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062555:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062562:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062567:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.062572:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062579:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062592:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758267.062595:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.062600:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062605:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777daffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062620:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062626:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062632:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062637:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.062640:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062645:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062652:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.062654:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.062657:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062662:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db003 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062690:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777daff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bbe expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062704:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bbe expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.062715:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758267.062718:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758267.062720:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782758267.062782:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52314:x1869355196772992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1132us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758267.062790:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00080000:1.0:1782758267.063388:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758267.079245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.079500:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196773248 00000100:00100000:0.0:1782758267.079511:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196773248 00000100:00100000:0.0:1782758267.079583:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 975 00000100:00100000:0.0:1782758267.079593:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52314:x1869355196773248:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758267.079618:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758267.079639:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db011 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bc5 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080333:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080351:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080363:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080410:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080419:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.080430:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758267.088716:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:0.0:1782758267.090614:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090636:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090648:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090687:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090694:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090702:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090708:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.090712:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090719:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090731:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758267.090734:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.090739:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.090745:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db018 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758267.090757:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006729d150 reply state 00000000c6c8fb36 transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758267.090767:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758267.094919:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db011 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bc5 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.094970:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bc5 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.094981:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.094984:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758267.094988:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758267.095139:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52314:x1869355196773248:12345-192.168.204.31@tcp:101:touch.0 Request processed in 15545us (15901us total) trans 4294967675 rc 0/0 00000100:00100000:0.0:1782758267.095149:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 975 00010000:00010000:0.0:1782758267.101709:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101727:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101735:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101745:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.101751:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101758:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101775:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff91718bcfdd00) 00010000:00010000:0.0:1782758267.101778:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.101782:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.101788:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db01f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758267.117436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.119441:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196773504 00000100:00100000:0.0:1782758267.119454:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196773504 00000100:00100000:0.0:1782758267.119550:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 976 00000100:00100000:0.0:1782758267.119561:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52314:x1869355196773504:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782758267.119625:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758267.119654:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bc5 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.119673:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.119683:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758267.121187:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.121210:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.121225:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758267.121377:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb10851d reply state 00000000980756a9 transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758267.121387:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758267.121511:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52314:x1869355196773504:12345-192.168.204.31@tcp:36:touch.0 Request processed in 1948us (4085us total) trans 4294967676 rc 0/0 00000100:00100000:0.0:1782758267.121519:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 976 00010000:00010000:0.0:1782758267.126231:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126250:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126258:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126264:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.126270:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126278:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126297:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758267.126300:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.126306:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.126317:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db034 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758267.129251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.129497:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196773632 00000100:00100000:0.0:1782758267.129508:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196773632 00000100:00100000:0.0:1782758267.129573:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1782758267.129583:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52314:x1869355196773632:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758267.129607:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758267.129628:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db03b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bcc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.129688:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db03b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bcc expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.129702:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db03b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bcc expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.129722:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.129726:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782758267.129730:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758267.130658:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52314:x1869355196773632:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1071us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758267.130667:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:3.0:1782758267.134245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.134335:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196773760 00000100:00100000:0.0:1782758267.134347:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196773760 00000100:00100000:0.0:1782758267.134395:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 534 00000100:00100000:0.0:1782758267.134404:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196773760:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:0.0:1782758267.134441:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2335 last 0 00000020:00000080:0.0:1782758267.134471:0:6597:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db042 00002000:00100000:0.0:1782758267.134526:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917081af9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782758267.134539:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782758267.134818:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782758267.134875:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081afc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758267.134961:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196773760:12345-192.168.204.31@tcp:8:touch.0 Request processed in 547us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758267.134970:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 534 00000100:00100000:1.0:1782758267.137333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.139708:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196773888 00000100:00100000:0.0:1782758267.139728:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196773888 00000100:00100000:3.0:1782758267.139991:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 535 00000100:00100000:3.0:1782758267.140005:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196773888:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:1.0:1782758267.141714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1782758267.233099:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:2.0:1782758267.233131:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000100:00100000:3.0:1782758267.235148:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196773888:12345-192.168.204.31@tcp:2:touch.0 Request processed in 95138us (97815us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1782758267.235161:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 535 00000100:00100000:2.0:1782758267.245631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.245809:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774144 00000100:00100000:0.0:1782758267.245819:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774144 00000100:00100000:0.0:1782758267.245914:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 100 00000100:00100000:0.0:1782758267.245925:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52314:x1869355196774144:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:0.0:1782758267.246256:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:52314:x1869355196774144:12345-192.168.204.31@tcp:35:touch.0 Request processed in 332us (633us total) trans 4294967677 rc 0/0 00000100:00100000:0.0:1782758267.246264:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 100 00000100:00100000:2.0:1782758267.410799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.411020:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774272 00000100:00100000:0.0:1782758267.411030:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774272 00000100:00100000:0.0:1782758267.411088:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:0.0:1782758267.411098:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:52318:x1869355196774272:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758267.411122:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758267.411143:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bd3 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411215:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411228:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411239:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411254:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411261:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411268:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411370:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411379:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411386:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758267.411426:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00200000:0.0:1782758267.411430:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758267.411534:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411552:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411560:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411566:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411573:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411578:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.411582:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411589:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411602:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758267.411606:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.411610:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411617:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411631:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411636:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411642:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411647:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.411650:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411656:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411662:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff91718bcfda00) 00010000:00010000:0.0:1782758267.411665:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.411667:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411673:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411703:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bd3 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411716:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bd3 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.411723:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.411725:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758267.411728:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51400, rc 0) 00000100:00100000:0.0:1782758267.412481:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:52318:x1869355196774272:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1371us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758267.412494:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:0.0:1782758267.426105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758267.429306:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774400 00000100:00100000:3.0:1782758267.429322:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774400 00000100:00100000:2.0:1782758267.432314:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 536 00000100:00100000:2.0:1782758267.432332:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196774400:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758267.432354:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758267.432379:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bda expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758267.432411:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x6a42bb7a, atime: 0x6a42bb7a, ctime: 0x6a42bb7a, blocks: 0x1 00010000:00010000:2.0:1782758267.432436:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=2335s v=(0 0) 00010000:00010000:2.0:1782758267.432452:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758267.432463:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.432493:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.432507:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758267.432589:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196774400:12345-192.168.204.31@tcp:101:rm.0 Request processed in 262us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758267.432598:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 536 00010000:00010000:0.0:1782758267.440393:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758267.444355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758267.444475:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774656 00000100:00100000:0.0:1782758267.444488:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774656 00000100:00100000:0.0:1782758267.444563:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 979 00000100:00100000:0.0:1782758267.444574:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:52318:x1869355196774656:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758267.444637:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758267.444667:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db05e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bd3 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.444690:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db03b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bcc expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.444701:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758267.444713:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758267.444737:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.444752:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.444762:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.444776:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.445489:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.445499:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.445620:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.445628:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.445634:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758267.451381:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:0.0:1782758267.451398:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2335854575284ns, next at 2336854570872ns, rc = 0 00010000:00010000:0.0:1782758267.452424:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452519:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452533:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452543:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452550:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452556:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452636:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758267.452664:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452670:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452676:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452682:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.452686:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452694:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452705:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758267.452708:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758267.452712:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452718:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db07a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452737:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452743:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452752:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452756:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758267.452759:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452765:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452771:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758267.452774:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758267.452777:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758267.452797:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db06c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758267.452808:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b24b4f47 reply state 0000000031a8b357 transno 4294967678 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758267.452851:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758267.452956:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:52318:x1869355196774656:12345-192.168.204.31@tcp:36:rm.0 Request processed in 8380us (8605us total) trans 4294967678 rc 0/0 00000100:00100000:0.0:1782758267.452966:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 979 00010000:00010000:2.0:1782758267.464765:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464784:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464792:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464798:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758267.464803:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464811:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464861:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff91718bcfda00) 00010000:00010000:2.0:1782758267.464865:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758267.464870:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758267.464880:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db073 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471302:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758267.471318:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471329:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758267.471334:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471344:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471366:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:1.0:1782758267.471369:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758267.471375:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471381:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db081 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758267.471407:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758267.471409:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758267.471411:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758268.090290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758268.090340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758268.090378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758268.090427:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774784 00000100:00100000:1.0:1782758268.090438:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774784 00000100:00100000:1.0:1782758268.090496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1297 00000100:00100000:1.0:1782758268.090506:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196774784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758268.090579:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196774784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758268.090587:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1297 00000100:00100000:2.0:1782758268.090775:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196774912 00000100:00100000:2.0:1782758268.090780:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196774912 00000100:00100000:2.0:1782758268.090852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1661 00000100:00100000:2.0:1782758268.090861:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2363:x1869355196774912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758268.090904:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2363:x1869355196774912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758268.090911:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1661 00000100:00100000:0.0:1782758268.091077:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775040 00000100:00100000:0.0:1782758268.091082:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775040 00000100:00100000:0.0:1782758268.091126:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1268 00000100:00100000:0.0:1782758268.091133:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196775040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758268.091165:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196775040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758268.091171:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1268 00010000:00010000:2.0:1782758268.474928:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758268.852206:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758268.852229:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211622016:0@lo:400:kworker.0 00000100:00100000:2.0:1782758268.852236:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211621760:0@lo:400:kworker.0 00000100:00100000:1.0:1782758268.852300:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211622144:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.864844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758268.864917:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211621632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.864960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758268.865015:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622016 00000100:00100000:3.0:1782758268.865022:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622016 00000100:00100000:3.0:1782758268.865080:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1782758268.865089:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211622016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.865143:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211622016:12345-0@lo:400:kworker.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758268.865150:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1782758268.866317:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621632 00000100:00100000:3.0:1782758268.866326:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621632 00000100:00100000:3.0:1782758268.866365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1782758268.866374:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.866426:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211621632:12345-0@lo:400:kworker.0 Request processed in 52us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758268.866432:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1782758268.866502:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211622016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.866512:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211621632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.866558:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211621888:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.866589:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758268.866637:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621888 00000100:00100000:3.0:1782758268.866640:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621888 00000100:00100000:3.0:1782758268.866671:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1782758268.866678:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211621888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.866713:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211621888:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758268.866736:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1782758268.870945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211621888:0@lo:400:kworker.0 00000100:00100000:2.0:1782758268.871403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758268.872397:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211621760 00000100:00100000:3.0:1782758268.872408:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211621760 00000100:00100000:3.0:1782758268.872477:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1782758268.872488:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758268.872519:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211622272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.872556:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211621760:12345-0@lo:400:kworker.0 Request processed in 70us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758268.872556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758268.872563:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1782758268.872594:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622272 00000100:00100000:3.0:1782758268.872598:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622272 00000100:00100000:2.0:1782758268.872610:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211621760:0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.872630:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1782758268.872637:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.872677:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211622272:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758268.872683:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1782758268.872744:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211622272:0@lo:400:kworker.0 00000100:00080000:1.0:1782758268.874308:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758268.874315:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758268.874319:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758268.874365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758268.886294:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622144 00000100:00100000:2.0:1782758268.886314:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622144 00000100:00100000:3.0:1782758268.886940:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:3.0:1782758268.886950:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758268.887053:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211622144:12345-0@lo:400:kworker.0 Request processed in 104us (12687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758268.887060:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00080000:1.0:1782758268.887202:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758268.887261:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211622144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758269.356499:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758269.356521:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211622400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758269.356585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758269.358186:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622400 00000100:00100000:1.0:1782758269.358196:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622400 00000100:00100000:1.0:1782758269.358256:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1782758269.358266:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211622400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758269.358306:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758269.358377:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211622400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758269.358384:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1782758269.358498:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211622400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758269.483977:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758270.040279:0:88799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5d35f260 20000000:00000080:1.0:1782758270.040297:0:88799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7833400 uarg=0000000000000000 00010000:00010000:2.0:1782758270.050143:0:88799:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758270.050193:0:88799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:2.0:1782758270.050197:0:88799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758270.050209:0:88799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db00a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bbe expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.050248:0:88799:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758270.050266:0:88799:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758270.050278:0:88799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.050291:0:88799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.050299:0:88799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.050334:0:88799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.050346:0:88799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 18 pid: 5793 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758270.050427:0:88799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88799:1869355211622528:0@lo:104: 00000100:00100000:2.0:1782758270.050486:0:88799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758270.050694:0:88799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170812aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758270.051638:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622528 00000100:00100000:0.0:1782758270.051649:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622528 00000100:00100000:0.0:1782758270.051700:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1782758270.051709:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88799:x1869355211622528:12345-0@lo:104: 00010000:00010000:0.0:1782758270.051722:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051801:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758270.051807:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88799:x1869355211622528:12345-0@lo:104: Request processed in 100us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758270.051814:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:0.0:1782758270.051850:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758270.051855:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051862:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758270.051866:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051878:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758270.051885:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758270.051891:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758270.051918:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051925:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758270.051940:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051947:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dafe7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dafee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.051966:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758270.051968:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758270.051969:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758270.051988:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211622656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758270.052017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758270.052048:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622656 00000100:00100000:0.0:1782758270.052052:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622656 00010000:00010000:0.0:1782758270.052303:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 19 pid: 5793 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758270.052325:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1782758270.052332:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211622656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758270.052342:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758270.052346:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 19 pid: 5793 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052405:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 19 pid: 5793 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052429:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052437:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052449:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052456:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052463:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052469:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052474:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758270.052478:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052485:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052497:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758270.052507:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758270.053491:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211622656:12345-0@lo:103:ldlm_bl.0 Request processed in 1157us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758270.053500:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1782758270.053672:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211622656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758270.053896:0:88799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dafee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dafe7 expref: 18 pid: 5793 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758270.053910:0:88799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88799:1869355211622528:0@lo:104: 00010000:00010000:2.0:1782758270.053930:0:88799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.053939:0:88799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.053947:0:88799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.053953:0:88799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777db088 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758270.513902:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758271.467896:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758271.467904:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758271.467908:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758271.467974:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758271.467985:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758271.467996:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758271.468022:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211622784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758271.468099:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758271.468153:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758271.468461:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622784 00000100:00100000:1.0:1782758271.468469:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622784 00000100:00100000:1.0:1782758271.468530:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1782758271.468539:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211622784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758271.468554:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758271.468567:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db08f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758271.468591:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758271.468603:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758271.468613:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758271.468659:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211622784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758271.468666:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1782758271.468716:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211622784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758271.468734:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758271.468744:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758271.468762:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758271.468767:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758271.468774:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758271.532651:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758271.918497:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2340321671748ns, next at 2341321669651ns, rc = 0 00000100:00100000:0.0:1782758271.918532:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758271.918552:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211622912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758271.918619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758271.918676:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211622912 00000100:00100000:0.0:1782758271.918684:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211622912 00000100:00100000:0.0:1782758271.918751:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1782758271.918760:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211622912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758271.918795:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782758271.918815:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758271.918865:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211622912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758271.918872:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1782758271.919314:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211622912:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1782758272.120598:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000001:00080000:2.0:1782758272.120634:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967678 is committed 00000004:00080000:2.0:1782758272.120639:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000100:00100000:0.0:1782758272.121518:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211623040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758272.121584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758272.123227:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623040 00000100:00100000:3.0:1782758272.123238:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623040 00000100:00100000:3.0:1782758272.123296:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1782758272.123305:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211623040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782758272.123335:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:3.0:1782758272.123360:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758272.123391:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758272.123400:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1782758272.123404:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758272.123409:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758272.123447:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758272.123475:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 5 pid: 6597 timeout: 2440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758272.123488:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211623168:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758272.123558:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758272.130625:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211623168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758272.130654:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758272.131147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758272.131307:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775168 00000100:00100000:1.0:1782758272.131314:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775168 00010000:00010000:1.0:1782758272.131373:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 2440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758272.131426:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 407 00000100:00100000:1.0:1782758272.131437:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196775168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758272.131463:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758272.131470:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 2440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131489:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 2440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131515:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b878eb82/0xdd99f5c4777db065 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bda expref: 6 pid: 6597 timeout: 2440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131530:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758272.131535:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758272.131540:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131550:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131579:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758272.131628:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196775168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 193us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758272.131637:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 407 00010000:00010000:1.0:1782758272.131743:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131753:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131763:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131772:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.131789:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1782758272.132240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758272.133763:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211623040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10455us (12177us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1782758272.133773:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00010000:00010000:1.0:1782758272.133801:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758272.133808:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.133819:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758272.136774:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.136793:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.136816:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.138445:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001d8008/0xdd99f5c4777db09d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758272.138532:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758272.138536:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758272.138539:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758272.139080:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171bb9b9c00/2, rc 0, transno 4294967359 00000100:00100000:2.0:1782758272.139090:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211623040:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1782758272.515851:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00010000:00010000:2.0:1782758272.580283:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758273.205138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758273.205177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758273.205202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758273.220026:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775296 00000100:00100000:0.0:1782758273.220040:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775296 00000100:00100000:0.0:1782758273.220094:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:0.0:1782758273.220104:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196775296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758273.220194:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196775296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (15015us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.220201:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:0.0:1782758273.220237:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775424 00000100:00100000:0.0:1782758273.220241:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775424 00000100:00100000:0.0:1782758273.220279:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1665 00000100:00100000:0.0:1782758273.220285:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196775424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758273.220318:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196775424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (15191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.220324:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1665 00000100:00080000:0.0:1782758273.220488:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758273.226772:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775552 00000100:00100000:3.0:1782758273.226786:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775552 00000100:00100000:3.0:1782758273.226877:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1271 00000100:00100000:3.0:1782758273.226888:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196775552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758273.226962:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196775552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (21759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758273.226970:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1271 00010000:00010000:3.0:1782758273.584340:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758273.966081:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211623680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966220:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758273.966227:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211623296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966280:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211623808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966330:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211623424:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966384:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211623936:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966423:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758273.966428:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211623552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758273.966484:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623680 00000100:00100000:0.0:1782758273.966492:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623680 00000100:00100000:0.0:1782758273.966550:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623936 00000100:00100000:0.0:1782758273.966553:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623936 00000100:00100000:0.0:1782758273.966578:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1782758273.966589:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211623680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966642:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211623680:12345-0@lo:400:kworker.0 Request processed in 55us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.966649:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1782758273.966665:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1782758273.966671:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211623936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966703:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211623936:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.966712:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1782758273.966729:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623296 00000100:00100000:0.0:1782758273.966733:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623296 00000100:00100000:0.0:1782758273.966768:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1782758273.966774:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211623296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966803:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211623296:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.966809:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1782758273.966867:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623808 00000100:00100000:0.0:1782758273.966871:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623808 00000100:00100000:0.0:1782758273.966901:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623424 00000100:00100000:0.0:1782758273.966904:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623424 00000100:00100000:0.0:1782758273.966917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211623552 00000100:00100000:0.0:1782758273.966919:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211623552 00000100:00100000:0.0:1782758273.966931:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:0.0:1782758273.966936:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211623808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.966966:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211623808:12345-0@lo:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.966972:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:0.0:1782758273.966983:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1782758273.966989:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211623424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967015:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211623424:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.967020:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1782758273.967029:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1782758273.967035:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211623552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967061:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211623552:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758273.967066:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00080000:0.0:1782758273.967090:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758273.967094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758273.967096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758273.967136:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211623552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967146:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211623424:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967155:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211623936:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967183:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211623296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967192:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211623808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758273.967200:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1782758273.967204:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171bb9b9c00, transno 4294967359 00000100:00100000:0.0:1782758273.967214:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211623680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758274.481888:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758274.481962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758274.482039:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624064 00000100:00100000:3.0:1782758274.482047:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624064 00000100:00100000:3.0:1782758274.482098:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1782758274.482106:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211624064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758274.482145:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758274.482193:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211624064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758274.482200:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1782758274.482254:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211624064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758274.604705:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758274.801783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758274.802152:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775680 00000100:00100000:2.0:1782758274.802164:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775680 00000100:00100000:2.0:1782758274.802227:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:2.0:1782758274.802238:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52406:x1869355196775680:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758274.802258:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758274.802281:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db0a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64be1 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802369:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802384:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802397:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758274.802618:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:2.0:1782758274.802623:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758274.802705:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802855:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db0a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be1 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802878:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be1 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758274.802887:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782758274.802890:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758274.802894:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758274.802962:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52406:x1869355196775680:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 725us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758274.802970:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:0.0:1782758274.808992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758274.809035:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196775936 00000100:00100000:0.0:1782758274.809045:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196775936 00000100:00100000:0.0:1782758274.809100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:0.0:1782758274.809112:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52406:x1869355196775936:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758274.809170:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758274.809197:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be1 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758274.809219:0:5801:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db00a) 00010000:00010000:0.0:1782758274.809224:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:0.0:1782758274.809235:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758274.809264:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758274.809279:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758274.809290:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758274.853938:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd51fbaa reply state 000000006ed7bc3a transno 4294967679 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758274.853964:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758274.854145:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000100:00100000:2.0:1782758274.854296:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52406:x1869355196775936:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 45182us (45311us total) trans 4294967679 rc 0/0 00000100:00100000:2.0:1782758274.854305:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 981 00000001:00080000:3.0:1782758274.854420:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967679 is committed 00010000:00010000:1.0:1782758274.854531:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854541:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854551:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854557:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758274.854562:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854570:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854588:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782758274.854591:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758274.854596:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758274.854602:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db0b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.629150:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758275.783710:0:88997:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc99243f0 20000000:00000080:2.0:1782758275.783729:0:88997:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2dab800 uarg=0000000000000000 00010000:00010000:2.0:1782758275.784997:0:88997:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758275.785159:0:88997:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758275.785179:0:88997:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758275.785273:0:88997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.785292:0:88997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.785301:0:88997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.785353:0:88997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.785369:0:88997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 18 pid: 5793 timeout: 2444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758275.785383:0:88997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88997:1869355211624192:0@lo:104: 00000100:00100000:2.0:1782758275.785453:0:88997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758275.785577:0:88997:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358480 going to sleep for 11 seconds 00000100:00100000:0.0:1782758275.785732:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782758275.785745:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624192 00000100:00100000:0.0:1782758275.785752:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624192 00000100:00100000:0.0:1782758275.785857:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1782758275.785867:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88997:x1869355211624192:12345-0@lo:104: 00010000:00010000:0.0:1782758275.785881:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.785954:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758275.785960:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:88997:x1869355211624192:12345-0@lo:104: Request processed in 96us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758275.785967:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1782758275.786102:0:88997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88997:1869355211624192:0@lo:104: 00010000:00010000:3.0:1782758275.786125:0:88997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786373:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758275.786380:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786388:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758275.786392:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786401:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758275.786408:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758275.786414:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758275.786444:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786450:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758275.786471:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786477:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777db08f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db096 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758275.786492:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758275.786494:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758275.786496:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758275.786504:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758275.786514:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211624320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758275.786548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758275.786775:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624320 00000100:00100000:0.0:1782758275.786780:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624320 00010000:00010000:0.0:1782758275.786800:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 2444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758275.786948:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1782758275.786957:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211624320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758275.786971:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758275.786976:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 2444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.786988:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 2444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787002:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db096 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db08f expref: 19 pid: 5793 timeout: 2444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787028:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787045:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787059:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787066:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787074:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787081:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787090:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758275.787094:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787101:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787121:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758275.787130:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758275.787170:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211624320:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758275.787177:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00010000:2.0:1782758275.787340:0:88997:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.787349:0:88997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758275.787355:0:88997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777db0b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758275.789881:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211624320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758276.655144:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758277.036181:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211624448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758277.036253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758277.036375:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624448 00000100:00100000:0.0:1782758277.036383:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624448 00000100:00100000:0.0:1782758277.036450:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1782758277.036460:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211624448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758277.036510:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758277.036560:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211624448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758277.036568:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00080000:1.0:1782758277.036851:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758277.036888:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211624448:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782758277.037313:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758277.037318:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758277.037322:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758277.037357:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758277.037368:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758277.037378:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758277.037397:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211624576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758277.037435:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758277.037471:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1782758277.037619:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624576 00000100:00100000:3.0:1782758277.037625:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624576 00000100:00100000:3.0:1782758277.037674:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1782758277.037682:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211624576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758277.037693:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758277.037705:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db0c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758277.037726:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758277.037737:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758277.037746:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758277.037787:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211624576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758277.037794:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1782758277.038077:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211624576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758277.038093:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758277.038102:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758277.038118:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758277.038122:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758277.038128:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758277.676994:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758278.324068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758278.324285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776064 00000100:00100000:1.0:1782758278.324295:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776064 00000100:00100000:1.0:1782758278.324359:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:1.0:1782758278.324369:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196776064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758278.324443:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196776064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758278.324451:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:3.0:1782758278.325091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758278.325563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758278.328267:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776192 00000100:00100000:0.0:1782758278.328283:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776192 00000100:00100000:0.0:1782758278.328373:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1669 00000100:00100000:0.0:1782758278.328386:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196776192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758278.328474:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196776192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758278.328482:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1669 00000100:00080000:0.0:1782758278.328505:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758278.333019:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776320 00000100:00100000:2.0:1782758278.333038:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776320 00000100:00100000:2.0:1782758278.333165:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:2.0:1782758278.333178:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196776320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758278.333272:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196776320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (9156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758278.333280:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00080000:0.0:1782758278.334478:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758278.700104:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758279.086416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211624960:0@lo:400:kworker.0 00000100:00100000:3.0:1782758279.086484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758279.086532:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758279.086539:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211625088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758279.086565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758279.086632:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211624832:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.086662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758279.086691:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211625344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.086712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758279.086730:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758279.086736:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211624704:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.086766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758279.086789:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211625216:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.086877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758279.086917:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625088 00000100:00100000:1.0:1782758279.086924:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625088 00000100:00100000:1.0:1782758279.086972:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625344 00000100:00100000:1.0:1782758279.086975:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625344 00000100:00100000:1.0:1782758279.086995:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1782758279.087003:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211625088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087056:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211625088:12345-0@lo:400:kworker.0 Request processed in 53us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087069:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1782758279.087106:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1782758279.087114:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087141:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211625344:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087147:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1782758279.087165:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624704 00000100:00100000:1.0:1782758279.087169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624704 00000100:00100000:1.0:1782758279.087191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1782758279.087197:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211624704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087225:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211624704:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087231:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1782758279.087399:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624960 00000100:00100000:1.0:1782758279.087403:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624960 00000100:00100000:1.0:1782758279.087428:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211624832 00000100:00100000:1.0:1782758279.087430:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211624832 00000100:00100000:1.0:1782758279.087445:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625216 00000100:00100000:1.0:1782758279.087448:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625216 00000100:00100000:1.0:1782758279.087462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:1.0:1782758279.087468:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211624960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087500:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211624960:12345-0@lo:400:kworker.0 Request processed in 32us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087506:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:1.0:1782758279.087519:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:1.0:1782758279.087525:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087555:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211624832:12345-0@lo:400:kworker.0 Request processed in 31us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087561:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:1.0:1782758279.087572:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:1.0:1782758279.087578:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211625216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087603:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211625216:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758279.087608:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00080000:1.0:1782758279.087624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758279.087629:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758279.087631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758279.087883:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211625088:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087896:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211624960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211625216:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087946:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211624832:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087955:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211625344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758279.087968:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211624704:0@lo:400:kworker.0 00000100:00100000:3.0:1782758279.380987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758279.381073:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776448 00000100:00100000:2.0:1782758279.381086:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776448 00000100:00100000:2.0:1782758279.381154:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:2.0:1782758279.381164:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52484:x1869355196776448:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758279.381185:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758279.381209:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db0ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64be8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381295:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381309:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381326:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381336:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381342:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381348:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381789:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381799:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.381806:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758279.381928:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:2.0:1782758279.381933:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758279.382011:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382024:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382031:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382044:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382050:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758279.382056:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382063:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382075:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758279.382078:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758279.382083:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382088:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db0d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382099:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382104:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382109:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382114:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758279.382116:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382125:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382131:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917182dd1400) 00010000:00010000:2.0:1782758279.382133:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758279.382136:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382141:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db0dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382169:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db0ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be8 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382185:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be8 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.382193:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782758279.382195:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758279.382197:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758279.382272:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776448:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1109us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758279.382280:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:2.0:1782758279.390573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758279.390932:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776704 00000100:00100000:1.0:1782758279.390942:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776704 00000100:00100000:1.0:1782758279.390999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:1.0:1782758279.391011:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776704:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758279.391032:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758279.391052:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db0ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bef expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391319:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391335:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391346:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391361:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391367:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391374:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758279.391514:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:1.0:1782758279.391537:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391546:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391552:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391558:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758279.391564:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391575:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391590:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758279.391594:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.391598:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391605:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db0f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391618:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391624:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391630:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391635:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758279.391637:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391643:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391649:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758279.391651:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.391654:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391662:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db0f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391697:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db0ea lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bef expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391706:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758279.391708:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.391711:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db0ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bef expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.391720:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758279.391788:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776704:12345-192.168.204.31@tcp:101:touch.0 Request processed in 780us (1225us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758279.391797:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:2.0:1782758279.402953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758279.403278:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776832 00000100:00100000:1.0:1782758279.403289:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776832 00000100:00100000:1.0:1782758279.403353:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 984 00000100:00100000:1.0:1782758279.403363:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776832:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758279.403383:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758279.403404:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bf6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403480:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403494:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403506:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403524:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403531:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403537:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403733:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403741:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403748:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403754:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758279.403762:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403770:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403782:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758279.403785:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.403790:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403797:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403807:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403813:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403818:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403846:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758279.403849:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403855:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403872:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3af00) 00010000:00010000:1.0:1782758279.403875:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.403878:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403884:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db10d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403923:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db0ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bf6 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403937:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758279.403939:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758279.403942:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bf6 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758279.403951:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758279.404026:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776832:12345-192.168.204.31@tcp:101:touch.0 Request processed in 664us (1084us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758279.404034:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 984 00000100:00100000:3.0:1782758279.409293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758279.409729:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196776960 00000100:00100000:2.0:1782758279.409740:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196776960 00000100:00100000:2.0:1782758279.409807:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00100000:2.0:1782758279.409820:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776960:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758279.409863:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758279.409888:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64bfd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.409971:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.409987:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410000:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410017:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410025:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410032:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410254:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410262:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410269:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410278:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758279.410283:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410290:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410303:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782758279.410307:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758279.410313:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410319:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777db11b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410332:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410338:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410344:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410349:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758279.410352:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410357:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410369:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff917182dd1e00) 00010000:00010000:2.0:1782758279.410371:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758279.410374:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410380:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410411:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db114 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bfd expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410421:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:2.0:1782758279.410423:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758279.410427:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64bfd expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758279.410436:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758279.410529:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52484:x1869355196776960:12345-192.168.204.31@tcp:101:touch.0 Request processed in 712us (1246us total) trans 0 rc 301/301 00000100:00100000:2.0:1782758279.410538:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00100000:0.0:1782758279.596111:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211625472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758279.596204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758279.596302:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625472 00000100:00100000:0.0:1782758279.596310:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625472 00000100:00100000:0.0:1782758279.596357:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1782758279.596365:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211625472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758279.596400:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758279.596447:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211625472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758279.596454:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1782758279.596503:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211625472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758279.730288:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758280.756532:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758281.596703:0:89242:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdce052870 20000000:00000080:1.0:1782758281.596722:0:89242:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7833000 uarg=0000000000000000 00010000:00010000:1.0:1782758281.597291:0:89242:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758281.597325:0:89242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1600) 00010000:00010000:1.0:1782758281.597328:0:89242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758281.597340:0:89242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db0e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64be8 expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.597361:0:89242:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782758281.597376:0:89242:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758281.597390:0:89242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.597402:0:89242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.597410:0:89242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.597453:0:89242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.597467:0:89242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 18 pid: 5793 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758281.597482:0:89242:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89242:1869355211625600:0@lo:104: 00000100:00100000:1.0:1782758281.597545:0:89242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758281.597601:0:89242:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643300 going to sleep for 11 seconds 00000100:00100000:2.0:1782758281.597693:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625600 00000100:00100000:2.0:1782758281.597700:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625600 00000100:00100000:2.0:1782758281.597753:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782758281.597763:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:89242:x1869355211625600:12345-0@lo:104: 00010000:00010000:2.0:1782758281.597775:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.597864:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758281.597871:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:89242:x1869355211625600:12345-0@lo:104: Request processed in 111us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758281.597878:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782758281.598621:0:89242:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89242:1869355211625600:0@lo:104: 00010000:00010000:1.0:1782758281.598642:0:89242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599086:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758281.599094:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599101:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758281.599105:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599113:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758281.599119:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758281.599125:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758281.599166:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599172:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758281.599207:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599214:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777db0c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db0c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599234:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758281.599236:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758281.599237:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758281.599367:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211625728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758281.599421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758281.599522:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625728 00000100:00100000:2.0:1782758281.599528:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625728 00010000:00010000:2.0:1782758281.599555:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758281.599592:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1782758281.599600:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211625728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758281.599612:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758281.599617:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599628:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599642:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db0c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db0c0 expref: 19 pid: 5793 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599655:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599663:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599677:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599688:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599694:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599701:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599706:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758281.599710:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599717:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599728:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758281.599737:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758281.599769:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211625728:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758281.599777:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1782758281.599875:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211625728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758281.600414:0:89242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.600424:0:89242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758281.600429:0:89242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db129 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758281.782753:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758282.159720:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758282.159744:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758282.161763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758282.166697:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625856 00000100:00100000:0.0:1782758282.166711:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625856 00000100:00100000:0.0:1782758282.166845:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1782758282.166856:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211625856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758282.166895:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758282.166980:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211625856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (5223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758282.166991:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1782758282.167046:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211625856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758282.167464:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758282.795995:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758283.450040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758283.450091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758283.450128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758283.450172:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777344 00000100:00100000:0.0:1782758283.450180:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777344 00000100:00100000:0.0:1782758283.450258:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1277 00000100:00100000:0.0:1782758283.450275:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196777344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758283.450357:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196777344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758283.450364:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1277 00000100:00100000:0.0:1782758283.450388:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777216 00000100:00100000:0.0:1782758283.450391:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777216 00000100:00100000:0.0:1782758283.450422:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1673 00000100:00100000:0.0:1782758283.450429:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196777216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758283.450457:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196777216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758283.450464:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1673 00000100:00080000:0.0:1782758283.450486:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758283.450490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758283.452119:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777088 00000100:00100000:2.0:1782758283.452130:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777088 00000100:00100000:2.0:1782758283.452192:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1305 00000100:00100000:2.0:1782758283.452203:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196777088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758283.452279:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196777088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758283.452286:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1305 10000000:01000000:1.0:1782758283.629685:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758283.629693:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758283.629698:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758283.629766:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758283.629778:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758283.629789:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758283.629815:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211625984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758283.629919:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758283.629987:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758283.631307:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211625984 00000100:00100000:2.0:1782758283.631319:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211625984 00000100:00100000:2.0:1782758283.631380:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1782758283.631390:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211625984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758283.631405:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758283.631424:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db130 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758283.631448:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758283.631459:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758283.631467:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758283.631543:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211625984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758283.631550:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1782758283.632483:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211625984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758283.632506:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758283.632517:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758283.632539:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758283.632544:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758283.632551:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758283.822266:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758284.208927:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211626112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.208998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758284.209067:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626112 00000100:00100000:1.0:1782758284.209074:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626112 00000100:00100000:1.0:1782758284.209120:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:1.0:1782758284.209128:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211626112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209197:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211626112:12345-0@lo:400:kworker.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758284.209205:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:1.0:1782758284.209252:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211626112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209296:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211626240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758284.209352:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626240 00000100:00100000:1.0:1782758284.209356:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626240 00000100:00100000:1.0:1782758284.209386:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:1.0:1782758284.209391:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211626240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209427:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211626240:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758284.209434:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00080000:1.0:1782758284.209450:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758284.209480:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211626240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209509:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211626368:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758284.209560:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626368 00000100:00100000:1.0:1782758284.209564:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626368 00000100:00100000:1.0:1782758284.209594:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1782758284.209601:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211626368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209634:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211626368:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758284.209643:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00080000:1.0:1782758284.209660:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758284.209675:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211626368:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758284.209712:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211626496:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758284.209777:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626496 00000100:00100000:1.0:1782758284.209781:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626496 00000100:00100000:1.0:1782758284.209807:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:1.0:1782758284.209813:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211626496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209873:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211626496:12345-0@lo:400:kworker.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758284.209879:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00080000:1.0:1782758284.209894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758284.209913:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211626496:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209944:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211626624:0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.209966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758284.209993:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626624 00000100:00100000:1.0:1782758284.209997:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626624 00000100:00100000:1.0:1782758284.210026:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1782758284.210032:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758284.210068:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211626624:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758284.210073:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00080000:1.0:1782758284.210089:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758284.210104:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211626624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758284.722699:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758284.722723:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211626752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758284.722814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758284.723044:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626752 00000100:00100000:3.0:1782758284.723054:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626752 00000100:00100000:3.0:1782758284.723108:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1782758284.723118:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211626752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758284.723160:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758284.723219:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211626752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758284.723226:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1782758284.723318:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211626752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758284.845722:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758285.609772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758285.609867:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777472 00000100:00100000:1.0:1782758285.609876:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777472 00000100:00100000:1.0:1782758285.609952:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00100000:1.0:1782758285.609962:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52572:x1869355196777472:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758285.609982:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758285.610004:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db13e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c04 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610069:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610093:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610106:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758285.610317:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1782758285.610322:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758285.610406:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610936:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db13e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c04 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610962:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c04 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.610972:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758285.610976:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758285.610979:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782758285.611046:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52572:x1869355196777472:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1084us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758285.611053:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00080000:2.0:1782758285.611751:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758285.615959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758285.616940:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777728 00000100:00100000:1.0:1782758285.616951:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777728 00000100:00100000:1.0:1782758285.617016:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 987 00000100:00100000:1.0:1782758285.617025:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52572:x1869355196777728:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758285.617084:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758285.617120:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c04 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.617138:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db0e3) 00010000:00010000:1.0:1782758285.617142:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3aa00) 00010000:00010000:1.0:1782758285.617153:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758285.617178:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.617191:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758285.617200:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758285.618634:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4517ab0 reply state 00000000fea054a4 transno 4294967680 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758285.618651:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758285.618757:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000100:00100000:1.0:1782758285.620688:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52572:x1869355196777728:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 3652us (4725us total) trans 4294967680 rc 0/0 00000100:00100000:1.0:1782758285.620701:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 987 00010000:00010000:2.0:1782758285.642040:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642058:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642066:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642084:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758285.642090:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642099:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642125:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:2.0:1782758285.642129:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758285.642134:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.642141:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db14c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758285.868004:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758286.846179:0:89439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff083f46b0 20000000:00000080:0.0:1782758286.846197:0:89439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30d9000 uarg=0000000000000000 00010000:00010000:0.0:1782758286.846665:0:89439:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758286.846681:0:89439:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758286.846693:0:89439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758286.846709:0:89439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.846725:0:89439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.846732:0:89439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.846767:0:89439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.846781:0:89439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 18 pid: 5794 timeout: 2455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758286.846795:0:89439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89439:1869355211626880:0@lo:104: 00000100:00100000:0.0:1782758286.846880:0:89439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758286.846930:0:89439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171872ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1782758286.847377:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211626880 00000100:00100000:2.0:1782758286.847384:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211626880 00000100:00100000:2.0:1782758286.847448:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782758286.847458:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:89439:x1869355211626880:12345-0@lo:104: 00010000:00010000:2.0:1782758286.847471:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758286.847540:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758286.847546:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:89439:x1869355211626880:12345-0@lo:104: Request processed in 90us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758286.847554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:3.0:1782758286.847650:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758286.847658:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847670:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758286.847674:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847682:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758286.847689:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758286.847695:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758286.847732:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847739:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758286.847756:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847763:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db130 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db137 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847778:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758286.847780:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758286.847782:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758286.847793:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211627008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758286.847855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758286.847890:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627008 00000100:00100000:3.0:1782758286.847894:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627008 00010000:00010000:3.0:1782758286.847911:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 19 pid: 5794 timeout: 2455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758286.847933:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1782758286.847939:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211627008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758286.847948:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758286.847953:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 19 pid: 5794 timeout: 2455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847962:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 19 pid: 5794 timeout: 2455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847977:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847985:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.847998:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848005:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848012:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848018:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848024:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758286.848027:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848035:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848043:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.848053:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758286.848080:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211627008:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758286.848097:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1782758286.848155:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211627008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758286.848519:0:89439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777db137 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db130 expref: 18 pid: 5794 timeout: 2455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758286.848531:0:89439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89439:1869355211626880:0@lo:104: 00010000:00010000:0.0:1782758286.848544:0:89439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.848553:0:89439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.848563:0:89439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758286.848569:0:89439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777db153 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758286.899970:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758287.278516:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211627136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758287.278603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758287.278845:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627136 00000100:00100000:3.0:1782758287.278853:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627136 00000100:00100000:3.0:1782758287.278933:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1782758287.278943:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211627136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758287.278988:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758287.279036:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211627136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758287.279043:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00080000:0.0:1782758287.279289:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758287.279326:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211627136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758287.919971:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758288.567490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758288.567536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758288.570222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758288.570733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777856 00000100:00100000:1.0:1782758288.570743:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777856 00000100:00100000:1.0:1782758288.570806:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1307 00000100:00100000:1.0:1782758288.570817:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196777856:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758288.570928:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196777856:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 113us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758288.570936:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1307 00000100:00100000:1.0:1782758288.570972:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778112 00000100:00100000:1.0:1782758288.570976:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778112 00000100:00100000:1.0:1782758288.571016:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1280 00000100:00100000:1.0:1782758288.571022:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196778112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758288.571068:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196778112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758288.571075:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1280 00000100:00100000:1.0:1782758288.571094:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196777984 00000100:00100000:1.0:1782758288.571097:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196777984 00000100:00100000:1.0:1782758288.571123:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1677 00000100:00100000:1.0:1782758288.571130:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196777984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758288.571163:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196777984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758288.571170:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1677 00000100:00080000:1.0:1782758288.571186:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758288.571190:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1782758288.685075:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758288.685084:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758288.685089:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758288.685135:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.685147:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.685158:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758288.685185:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211627264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758288.685256:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758288.685354:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171932f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1782758288.689796:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627264 00000100:00100000:3.0:1782758288.689812:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627264 00000100:00100000:2.0:1782758288.690274:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1782758288.690285:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211627264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758288.690303:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758288.690323:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db15a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.690351:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.690378:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.690388:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758288.690463:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211627264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758288.690470:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1782758288.690525:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211627264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758288.690541:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.690548:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758288.690564:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758288.690568:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.690575:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758288.942212:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758289.324365:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211627648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758289.324439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758289.324505:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758289.324513:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211627520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758289.324542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758289.324588:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627520 00000100:00100000:0.0:1782758289.324595:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627520 00000100:00100000:0.0:1782758289.324646:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1782758289.324655:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758289.324705:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211627520:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758289.324841:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211627776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.324872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758289.324898:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758289.324904:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211627392:0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.324933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758289.324964:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211627904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758289.324977:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627776 00000100:00100000:1.0:1782758289.324991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758289.324993:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627776 00000100:00100000:1.0:1782758289.325047:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627648 00000100:00100000:1.0:1782758289.325054:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627648 00000100:00100000:1.0:1782758289.325093:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627904 00000100:00100000:1.0:1782758289.325096:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627904 00000100:00100000:1.0:1782758289.325116:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1782758289.325123:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211627648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.325155:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211627648:12345-0@lo:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758289.325162:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1782758289.325186:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1782758289.325199:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211627904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.325234:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211627904:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758289.325240:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00080000:1.0:1782758289.325256:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758289.325259:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758289.325262:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758289.325271:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211627392 00000100:00100000:1.0:1782758289.325273:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211627392 00000100:00100000:2.0:1782758289.325837:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211627520:0@lo:400:kworker.0 00000100:00100000:2.0:1782758289.325852:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211627648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758289.326845:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1782758289.326966:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211627904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758289.327150:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:3.0:1782758289.327166:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211627776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758289.328235:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211627776:12345-0@lo:400:kworker.0 Request processed in 1074us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758289.328244:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1782758289.328378:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211627776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.329736:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:1.0:1782758289.329756:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211627392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758289.330585:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211627392:12345-0@lo:400:kworker.0 Request processed in 836us (5649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758289.330594:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1782758289.334194:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211627392:0@lo:400:kworker.0 00000100:00100000:3.0:1782758289.842379:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758289.842413:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211628032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758289.842512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758289.842604:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628032 00000100:00100000:3.0:1782758289.842614:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628032 00000100:00100000:3.0:1782758289.842669:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1782758289.842680:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211628032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758289.842729:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758289.842810:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211628032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758289.842819:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1782758289.842907:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211628032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758289.965602:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758290.445974:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967680 is committed 00000100:00100000:0.0:1782758290.487060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758290.487171:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778240 00000100:00100000:1.0:1782758290.487198:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778240 00000100:00100000:1.0:1782758290.487302:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00100000:1.0:1782758290.487317:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778240:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758290.487489:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778240:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 175us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758290.487499:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00080000:2.0:1782758290.487975:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758290.492983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.496643:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778368 00000100:00100000:2.0:1782758290.496662:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778368 00000100:00100000:2.0:1782758290.496779:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 538 00000100:00100000:2.0:1782758290.496796:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778368:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758290.497283:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778368:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 492us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.497292:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 538 00000100:00080000:3.0:1782758290.497412:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758290.503178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.503787:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778496 00000100:00100000:2.0:1782758290.503799:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778496 00000100:00100000:2.0:1782758290.503946:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 539 00000100:00100000:2.0:1782758290.503955:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196778496:12345-192.168.204.31@tcp:8:lfs.0 00010000:00080000:2.0:1782758290.503992:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2358 last 0 00000020:00000080:2.0:1782758290.504041:0:6599:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db168 00002000:00100000:2.0:1782758290.504060:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff91708297b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782758290.504074:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782758290.504352:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782758290.504404:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082979800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782758290.504479:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196778496:12345-192.168.204.31@tcp:8:lfs.0 Request processed in 523us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.504488:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 539 00000100:00100000:2.0:1782758290.516881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758290.516964:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778624 00000100:00100000:0.0:1782758290.516974:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778624 00000100:00100000:0.0:1782758290.517062:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 540 00000100:00100000:0.0:1782758290.517073:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52657:x1869355196778624:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:3.0:1782758290.518135:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758290.522909:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52657:x1869355196778624:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 5730us (5930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.522924:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 540 00000100:00100000:0.0:1782758290.542533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758290.543255:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778752 00000100:00100000:3.0:1782758290.543265:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778752 00000100:00100000:3.0:1782758290.543497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 989 00000100:00100000:3.0:1782758290.543511:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778752:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758290.544060:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778752:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 551us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758290.549757:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 989 00000100:00100000:0.0:1782758290.549976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758290.553302:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196778880 00000100:00100000:3.0:1782758290.553320:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196778880 00000100:00100000:3.0:1782758290.553516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 990 00000100:00100000:3.0:1782758290.553528:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778880:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758290.553733:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196778880:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 206us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758290.553742:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 990 00000100:00100000:1.0:1782758290.557034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.557166:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779008 00000100:00100000:2.0:1782758290.557177:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779008 00000100:00100000:2.0:1782758290.557251:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 541 00000100:00100000:2.0:1782758290.557263:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196779008:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758290.558050:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196779008:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 787us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.558060:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 541 00000100:00100000:2.0:1782758290.564679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758290.574737:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779136 00000100:00100000:1.0:1782758290.574814:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779136 00000100:00100000:1.0:1782758290.574914:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 542 00000100:00100000:1.0:1782758290.574924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52657:x1869355196779136:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758290.577637:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52657:x1869355196779136:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2697us (12953us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758290.577655:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 542 00000100:00100000:3.0:1782758290.581921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.582300:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779264 00000100:00100000:2.0:1782758290.582313:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779264 00000100:00100000:2.0:1782758290.582676:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 991 00000100:00100000:2.0:1782758290.582689:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196779264:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758290.583281:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52657:x1869355196779264:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 594us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.583290:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 991 00000100:00100000:2.0:1782758290.686894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758290.687134:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779392 00000100:00100000:3.0:1782758290.687145:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779392 00000100:00100000:3.0:1782758290.687204:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 992 00000100:00100000:3.0:1782758290.687214:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52661:x1869355196779392:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782758290.687234:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758290.687257:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db16f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687321:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687342:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687356:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687546:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687554:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.687562:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.688847:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.688863:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.688875:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758290.688958:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758290.688962:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758290.689044:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689058:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689064:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689071:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689076:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758290.689080:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689087:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689100:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758290.689103:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758290.689107:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689114:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689125:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689130:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689136:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689142:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758290.689144:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689149:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689155:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75900) 00010000:00010000:3.0:1782758290.689157:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758290.689160:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689165:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db17d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689201:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db16f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c0b expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689216:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c0b expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758290.689224:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758290.689226:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758290.689228:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782758290.689978:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52661:x1869355196779392:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2759us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758290.689989:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 992 00000100:00100000:3.0:1782758290.698380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758290.698470:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779648 00000100:00100000:1.0:1782758290.698480:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779648 00000100:00100000:1.0:1782758290.698550:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 993 00000100:00100000:1.0:1782758290.698562:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52661:x1869355196779648:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758290.698584:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758290.698605:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db18b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c12 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699029:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699045:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699056:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699070:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699077:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.699083:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758290.700121:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:1.0:1782758290.701039:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db1a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701056:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701067:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701105:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701117:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701123:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701129:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758290.701134:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701141:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701153:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758290.701156:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758290.701160:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701166:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758290.701181:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3b3c2f3 reply state 00000000c309be76 transno 4294967681 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758290.701190:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758290.701228:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db18b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c12 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701243:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c12 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758290.701255:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:1.0:1782758290.701257:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758290.701259:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758290.701339:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52661:x1869355196779648:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2779us (2969us total) trans 4294967681 rc 0/0 00000100:00100000:1.0:1782758290.701348:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 993 00010000:00010000:2.0:1782758290.705190:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705210:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705217:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705223:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758290.705228:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705235:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705255:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3ac00) 00010000:00010000:2.0:1782758290.705258:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758290.705262:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.705269:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758290.711688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.712365:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779776 00000100:00100000:2.0:1782758290.712376:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779776 00000100:00100000:2.0:1782758290.712441:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 543 00000100:00100000:2.0:1782758290.712452:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52661:x1869355196779776:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782758290.712473:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758290.712497:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c19 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758290.712523:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782758290.712755:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=2359s v=(0 0) 00010000:00010000:2.0:1782758290.712761:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758290.712771:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.712790:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758290.712803:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758290.712884:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52661:x1869355196779776:12345-192.168.204.31@tcp:101:dd.0 Request processed in 434us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758290.712893:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 543 00000100:00100000:0.0:1782758290.738423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758290.738534:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196779904 00000100:00100000:1.0:1782758290.738555:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196779904 00002000:00100000:1.0:1782758290.738605:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff91719fc16300 x1869355196779904/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:206/0 lens 488/0 e 0 to 0 dl 1782758301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782758290.738617:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91719fc16300 with x1869355196779904 ext(0->1048575) 00002000:00010000:1.0:1782758290.738623:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91719fc16300 00000100:00100000:1.0:1782758290.738660:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1782758290.738669:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196779904:12345-192.168.204.31@tcp:4:dd.0 00000001:00100000:2.0:1782758290.875713:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:2.0:1782758290.884772:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196779904:12345-192.168.204.31@tcp:4:dd.0 Request processed in 146090us (146345us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1782758290.884788:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00002000:00100000:2.0:1782758290.884803:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff91719fc16300 x1869355196779904/t4294967358(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:206/0 lens 488/448 e 0 to 0 dl 1782758301 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782758290.884813:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91719fc16300 with x1869355196779904 ext(0->1048575) 00002000:00010000:2.0:1782758290.884833:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91719fc16300 00000100:00100000:1.0:1782758290.887071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758290.887137:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780032 00000100:00100000:2.0:1782758290.887147:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780032 00000100:00100000:2.0:1782758290.887213:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 994 00000100:00100000:2.0:1782758290.887224:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52661:x1869355196780032:12345-192.168.204.31@tcp:44:dd.0 00010000:00010000:2.0:1782758290.988024:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758291.001380:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967681 is committed 00000100:00100000:2.0:1782758291.002299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52661:x1869355196780032:12345-192.168.204.31@tcp:44:dd.0 Request processed in 115068us (115228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758291.002312:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 994 00000100:00100000:0.0:1782758291.008051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758291.012875:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780160 00000100:00100000:3.0:1782758291.012892:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780160 00000100:00100000:2.0:1782758291.017179:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:2.0:1782758291.017195:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196780160:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:2.0:1782758291.174089:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000100:00100000:3.0:1782758291.174537:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196780160:12345-192.168.204.31@tcp:16:dd.0 Request processed in 157340us (166489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758291.174549:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:3.0:1782758291.189108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758291.189242:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780416 00000100:00100000:0.0:1782758291.189254:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780416 00000100:00100000:0.0:1782758291.189333:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 101 00000100:00100000:0.0:1782758291.189344:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52661:x1869355196780416:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:0.0:1782758291.190069:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967682 00000100:00100000:0.0:1782758291.190208:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:52661:x1869355196780416:12345-192.168.204.31@tcp:35:dd.0 Request processed in 863us (1111us total) trans 4294967683 rc 0/0 00000100:00100000:0.0:1782758291.190216:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 101 00000020:00080000:0.0:1782758291.190221:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782758292.012837:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758292.407252:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211628160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758292.407338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758292.407441:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628160 00000100:00100000:3.0:1782758292.407449:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628160 00000100:00100000:3.0:1782758292.407502:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1782758292.407511:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211628160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758292.407548:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758292.407590:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211628160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758292.407600:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:3.0:1782758292.407625:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758292.407668:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211628160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758293.049217:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758293.361989:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967683 is committed 00000100:00100000:2.0:1782758293.702874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758293.702915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758293.702948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758293.703004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758293.703038:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780800 00000100:00100000:2.0:1782758293.703048:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780800 00000100:00100000:2.0:1782758293.703129:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780928 00000100:00100000:2.0:1782758293.703132:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780928 00000100:00100000:2.0:1782758293.703153:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1283 00000100:00100000:2.0:1782758293.703163:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196780800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758293.703281:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1284 00000100:00100000:1.0:1782758293.703291:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196780928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758293.703379:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196780928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758293.703388:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1284 00000100:00100000:2.0:1782758293.703782:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196780800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 620us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758293.703790:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1283 00000100:00100000:3.0:1782758293.705487:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780544 00000100:00100000:3.0:1782758293.705501:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780544 00000100:00100000:3.0:1782758293.705708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1309 00000100:00100000:3.0:1782758293.705719:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196780544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1782758293.709579:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758293.709587:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758293.709606:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196780672 00000100:00100000:1.0:1782758293.709615:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196780672 00000100:00100000:1.0:1782758293.709692:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1681 00000100:00100000:1.0:1782758293.709703:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196780672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782758293.709813:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758293.715570:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196780544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 9842us (12697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758293.715586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1309 00000100:00100000:1.0:1782758293.716463:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196780672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 6757us (13508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758293.716476:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1681 00010000:00010000:2.0:1782758294.060293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758294.449505:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758294.454611:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211628416:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.454699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758294.454761:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211628288:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.454786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758294.454842:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628288 00000100:00100000:3.0:1782758294.454848:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628288 00000100:00100000:3.0:1782758294.454888:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1782758294.454895:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211628288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.454953:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211628288:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758294.454961:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1782758294.455002:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211628288:0@lo:400:kworker.0 00000100:00100000:1.0:1782758294.455432:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628416 00000100:00100000:1.0:1782758294.455437:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628416 00000100:00100000:1.0:1782758294.455479:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1782758294.455486:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211628416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758294.455527:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211628416:12345-0@lo:400:kworker.0 Request processed in 41us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758294.455533:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1782758294.455563:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211628416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456275:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211628928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758294.456345:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758294.456351:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211628800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758294.456399:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628928 00000100:00100000:2.0:1782758294.456405:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628928 00000100:00100000:2.0:1782758294.456447:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1782758294.456469:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211628928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456509:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211628928:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758294.456516:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1782758294.456536:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628800 00000100:00100000:2.0:1782758294.456539:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628800 00000100:00100000:2.0:1782758294.456564:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:2.0:1782758294.456571:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211628800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456599:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211628800:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758294.456606:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00080000:2.0:1782758294.456621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758294.456624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758294.456649:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211628800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758294.456659:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211628928:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457218:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211628544:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758294.457288:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758294.457294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211628672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758294.457344:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628544 00000100:00100000:3.0:1782758294.457349:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628544 00000100:00100000:3.0:1782758294.457385:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1782758294.457390:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211628544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457427:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211628544:12345-0@lo:400:kworker.0 Request processed in 37us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758294.457434:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1782758294.457453:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211628672 00000100:00100000:3.0:1782758294.457457:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211628672 00000100:00100000:3.0:1782758294.457481:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1782758294.457487:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457517:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211628672:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758294.457522:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:3.0:1782758294.457543:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758294.457546:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758294.457565:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211628672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758294.457575:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211628544:0@lo:400:kworker.0 00000100:00100000:1.0:1782758294.956108:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758294.956134:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758294.956220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758294.956464:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629056 00000100:00100000:3.0:1782758294.956473:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629056 00000100:00100000:3.0:1782758294.956525:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1782758294.956534:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211629056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758294.956571:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758294.956632:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211629056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758294.956639:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1782758294.956904:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211629056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758295.088968:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758295.218961:0:89685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2363622135815ns, next at 2341321669651ns, rc = 0 00000004:00080000:2.0:1782758295.219081:0:89685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2363622257446ns, next at 2251730348730ns, rc = 0 00000004:00080000:0.0:1782758295.224678:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000004:00080000:0.0:1782758295.224701:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00010000:00010000:3.0:1782758296.118674:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758297.134973:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758297.273241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758297.273415:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781056 00000100:00100000:3.0:1782758297.273425:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781056 00000100:00100000:3.0:1782758297.273500:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 995 00000100:00100000:3.0:1782758297.273511:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781056:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758297.273608:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781056:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 98us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758297.273615:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 995 00000100:00080000:2.0:1782758297.276145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758297.277579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758297.277666:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781184 00000100:00100000:2.0:1782758297.277676:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781184 00000100:00100000:2.0:1782758297.277751:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 545 00000100:00100000:2.0:1782758297.277761:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52854:x1869355196781184:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758297.278183:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52854:x1869355196781184:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 423us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758297.278192:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 545 00000100:00080000:3.0:1782758297.278604:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758297.292018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758297.292053:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781312 00000100:00100000:3.0:1782758297.292063:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781312 00000100:00100000:3.0:1782758297.292120:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 546 00000100:00100000:3.0:1782758297.292131:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52854:x1869355196781312:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758297.297477:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52854:x1869355196781312:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 5331us (5453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758297.297496:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 546 00000100:00080000:3.0:1782758297.297558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758297.301939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758297.303455:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781440 00000100:00100000:1.0:1782758297.303476:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781440 00000100:00100000:1.0:1782758297.303570:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 996 00000100:00100000:1.0:1782758297.303585:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781440:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758297.304186:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781440:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 602us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758297.304195:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 996 00000100:00100000:1.0:1782758297.317421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758297.317605:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781568 00000100:00100000:3.0:1782758297.317617:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781568 00000100:00100000:3.0:1782758297.317675:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 997 00000100:00100000:3.0:1782758297.317685:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781568:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758297.317798:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781568:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758297.317806:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 997 00000100:00100000:1.0:1782758297.321301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758297.321505:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781696 00000100:00100000:3.0:1782758297.321515:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781696 00000100:00100000:3.0:1782758297.321571:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 547 00000100:00100000:3.0:1782758297.321582:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52854:x1869355196781696:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758297.322069:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:52854:x1869355196781696:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 487us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758297.322079:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 547 00000100:00100000:2.0:1782758297.325972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758297.326044:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781824 00000100:00100000:0.0:1782758297.326054:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781824 00000100:00100000:0.0:1782758297.326108:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 548 00000100:00100000:0.0:1782758297.326119:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52854:x1869355196781824:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758297.326681:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:52854:x1869355196781824:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 489us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758297.326691:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 548 00000100:00100000:1.0:1782758297.327964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758297.328080:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196781952 00000100:00100000:2.0:1782758297.328089:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196781952 00000100:00100000:2.0:1782758297.328413:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 998 00000100:00100000:2.0:1782758297.328466:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781952:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758297.329002:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52854:x1869355196781952:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 541us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758297.329010:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 998 00000100:00100000:1.0:1782758297.390559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758297.390707:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782208 00000100:00100000:2.0:1782758297.391386:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782208 00000100:00100000:2.0:1782758297.391458:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 999 00000100:00100000:2.0:1782758297.391469:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:52858:x1869355196782208:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782758297.391526:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758297.391556:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db1a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c12 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391576:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:2.0:1782758297.391588:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758297.391611:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391627:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391639:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391655:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391662:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.391668:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.392402:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.392414:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.392423:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758297.393851:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:2.0:1782758297.393867:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2365797043869ns, next at 2366797039539ns, rc = 0 00010000:00010000:2.0:1782758297.393989:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394003:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394013:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394023:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394029:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394036:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394067:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758297.394096:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394103:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394109:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394115:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758297.394121:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394128:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394140:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782758297.394143:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758297.394147:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394153:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db1c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394175:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394182:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394188:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394192:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758297.394333:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758297.394340:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.394346:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758297.394350:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.394357:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.394367:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff917182dd1300) 00010000:00010000:1.0:1782758297.394369:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758297.394372:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.394377:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db1ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.394392:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758297.394394:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758297.394396:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758297.394483:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394492:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394501:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758297.394503:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758297.394506:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758297.394512:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db1b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758297.394523:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000340c065d reply state 00000000969b9379 transno 4294967684 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758297.394532:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758297.394706:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:52858:x1869355196782208:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3234us (4153us total) trans 4294967684 rc 0/0 00000100:00100000:2.0:1782758297.394726:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 999 00010000:00010000:1.0:1782758297.400164:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400182:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400195:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400212:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758297.400217:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400225:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400244:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff917182dd1500) 00010000:00010000:1.0:1782758297.400247:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758297.400252:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758297.400259:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db1bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758297.517480:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211629184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758297.517551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758297.517930:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629184 00000100:00100000:3.0:1782758297.517940:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629184 00000100:00100000:3.0:1782758297.518004:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1782758297.518013:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211629184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758297.518048:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758297.518105:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211629184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758297.518112:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00080000:0.0:1782758297.518168:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758297.518239:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211629184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758298.157106:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758298.813350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758298.813397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758298.813433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758298.813465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758298.813515:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782592 00000100:00100000:1.0:1782758298.813525:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782592 00000100:00100000:1.0:1782758298.813571:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782720 00000100:00100000:1.0:1782758298.813575:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782720 00000100:00100000:1.0:1782758298.813598:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1287 00000100:00100000:1.0:1782758298.813609:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196782592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758298.813690:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196782592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758298.813698:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1287 00000100:00100000:1.0:1782758298.813719:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1288 00000100:00100000:1.0:1782758298.813725:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196782720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758298.813750:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196782720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758298.813756:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1288 00000100:00100000:2.0:1782758298.814160:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782336 00000100:00100000:2.0:1782758298.814167:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782336 00000100:00100000:2.0:1782758298.814210:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:2.0:1782758298.814218:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196782336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758298.814268:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196782336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758298.814274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:3.0:1782758298.814429:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782464 00000100:00100000:3.0:1782758298.814433:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782464 00000100:00100000:3.0:1782758298.814480:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1685 00000100:00100000:3.0:1782758298.814489:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196782464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758298.814526:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196782464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758298.814532:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1685 00010000:00010000:2.0:1782758299.180025:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758299.564498:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211629568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758299.564572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758299.564641:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758299.564647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211629696:0@lo:400:kworker.0 00000100:00100000:3.0:1782758299.564675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.564854:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211629312:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.564890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.564925:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211629824:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.564949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.564968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758299.564973:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211629440:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.564994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.565009:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211629952:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.565068:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629568 00000100:00100000:2.0:1782758299.565075:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629568 00000100:00100000:2.0:1782758299.565128:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629824 00000100:00100000:2.0:1782758299.565131:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629824 00000100:00100000:2.0:1782758299.565153:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629440 00000100:00100000:2.0:1782758299.565155:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629440 00000100:00100000:2.0:1782758299.565172:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1782758299.565181:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211629568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565233:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211629568:12345-0@lo:400:kworker.0 Request processed in 53us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758299.565240:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1782758299.565256:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1782758299.565263:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565294:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211629824:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758299.565299:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1782758299.565311:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1782758299.565318:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211629440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565339:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211629440:12345-0@lo:400:kworker.0 Request processed in 22us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758299.565345:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1782758299.565375:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629696 00000100:00100000:2.0:1782758299.565379:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629696 00000100:00100000:2.0:1782758299.565403:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1782758299.565411:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565467:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211629696:12345-0@lo:400:kworker.0 Request processed in 56us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758299.565474:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1782758299.565493:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629952 00000100:00100000:2.0:1782758299.565497:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629952 00000100:00100000:2.0:1782758299.565533:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1782758299.565540:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211629952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565574:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211629952:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758299.565581:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:2.0:1782758299.565600:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758299.565604:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758299.565607:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758299.565862:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211629440:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565884:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211629952:0@lo:400:kworker.0 00000100:00100000:2.0:1782758299.565910:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211629824:0@lo:400:kworker.0 00000100:00100000:1.0:1782758299.565925:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211629696:0@lo:400:kworker.0 00000100:00100000:1.0:1782758299.565953:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211629568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758299.566162:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211629312 00000100:00100000:3.0:1782758299.566169:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211629312 00000100:00100000:3.0:1782758299.566204:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1782758299.566212:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211629312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758299.566268:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211629312:12345-0@lo:400:kworker.0 Request processed in 58us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758299.566275:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1782758299.566363:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211629312:0@lo:400:kworker.0 00000004:00080000:3.0:1782758299.778784:0:89830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2368181958558ns, next at 2341321669651ns, rc = 0 00000004:00080000:3.0:1782758299.779251:0:89830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2368182427658ns, next at 2366797039539ns, rc = 0 00000001:00080000:0.0:1782758299.909197:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967684 is committed 00000004:00080000:0.0:1782758299.909211:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000004:00080000:0.0:1782758299.909232:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000004:00080000:0.0:1782758299.909238:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00000100:00100000:3.0:1782758299.909858:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211630080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782758299.909929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758299.910617:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630080 00000100:00100000:2.0:1782758299.910625:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630080 00000100:00100000:2.0:1782758299.910690:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1782758299.910699:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211630080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782758299.910728:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:31 count 1 00010000:00010000:2.0:1782758299.910750:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.910771:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.910781:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=9s v=(0 0) 00010000:00010000:2.0:1782758299.910784:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758299.910788:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.910815:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.910871:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 5 pid: 6597 timeout: 2468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758299.910884:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211630208:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758299.910952:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff917184d11d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758299.913397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758299.913433:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782848 00000100:00100000:0.0:1782758299.913442:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782848 00010000:00010000:0.0:1782758299.913501:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 6 pid: 6597 timeout: 2468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758299.913534:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211630208:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758299.913535:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 411 00000100:00100000:0.0:1782758299.913543:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196782848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758299.913555:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758299.913559:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758299.913560:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 6 pid: 6597 timeout: 2468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782758299.913992:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758299.914244:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 6 pid: 6597 timeout: 2468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758299.914276:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db1ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c19 expref: 6 pid: 6597 timeout: 2468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758299.914291:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758299.914294:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758299.914299:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758299.914310:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758299.914342:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758299.914462:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.914472:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.914482:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758299.916019:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196782848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2468us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758299.916032:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 411 00010000:00010000:2.0:1782758299.917620:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758299.917729:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758299.917780:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758299.917786:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.917795:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758299.917799:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.917810:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.917852:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.917864:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000806b4b97/0xdd99f5c4777db1d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758299.917887:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758299.917888:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758299.917890:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758299.918356:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211630080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7654us (8424us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1782758299.918365:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000004:00080000:0.0:1782758299.918674:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2dfc000/2, rc 0, transno 4294967359 00000100:00100000:0.0:1782758299.918686:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211630080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782758300.082323:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758300.082350:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211630336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758300.082431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758300.082503:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630336 00000100:00100000:3.0:1782758300.082511:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630336 00000100:00100000:3.0:1782758300.082556:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1782758300.082565:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211630336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758300.082602:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758300.082645:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211630336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758300.082652:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1782758300.082695:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211630336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758300.204941:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758301.228200:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758302.183431:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00010000:00010000:2.0:1782758302.252101:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758302.636845:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211630464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758302.636946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758302.637121:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630464 00000100:00100000:3.0:1782758302.637131:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630464 00000100:00080000:2.0:1782758302.637198:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758302.637221:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1782758302.637242:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211630464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758302.637302:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758302.637624:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211630464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 385us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758302.637632:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1782758302.637866:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211630464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758303.276480:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758303.942915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758303.942958:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783104 00000100:00100000:1.0:1782758303.942971:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783104 00000100:00100000:1.0:1782758303.943049:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1689 00000100:00100000:1.0:1782758303.943063:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196783104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758303.943161:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196783104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758303.943171:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1689 00000100:00080000:1.0:1782758303.943204:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758303.943238:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758303.943404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758303.943440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758303.943464:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783360 00000100:00100000:1.0:1782758303.943468:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783360 00000100:00100000:1.0:1782758303.943500:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783232 00000100:00100000:1.0:1782758303.943503:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783232 00000100:00100000:1.0:1782758303.943530:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:1.0:1782758303.943536:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758303.943573:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758303.943581:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:1.0:1782758303.943594:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1292 00000100:00100000:1.0:1782758303.943599:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758303.943624:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758303.943631:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1292 00000100:00080000:1.0:1782758303.943650:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758303.943654:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758303.944773:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196782976 00000100:00100000:0.0:1782758303.944783:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196782976 00000100:00100000:0.0:1782758303.944857:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1313 00000100:00100000:0.0:1782758303.944867:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196782976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758303.944927:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196782976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 61us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758303.944935:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1313 00010000:00010000:2.0:1782758304.300078:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758304.684676:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211630592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758304.684798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758304.684992:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630592 00000100:00100000:2.0:1782758304.685003:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630592 00000100:00100000:2.0:1782758304.685097:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1782758304.685109:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.690518:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211630848:0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.690695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758304.690758:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758304.690766:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211630720:0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.690791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758304.690857:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630848 00000100:00100000:1.0:1782758304.690865:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630848 00000100:00100000:1.0:1782758304.690932:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630720 00000100:00100000:1.0:1782758304.690936:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630720 00000100:00100000:1.0:1782758304.690960:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1782758304.690970:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211630848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691034:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211630848:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758304.691042:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1782758304.691064:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1782758304.691071:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211630720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691103:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211630720:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758304.691116:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00080000:1.0:1782758304.691135:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758304.691154:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211630976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758304.691228:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211630976 00000100:00100000:1.0:1782758304.691231:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211630976 00000100:00100000:1.0:1782758304.691264:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1782758304.691346:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691384:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211630976:12345-0@lo:400:kworker.0 Request processed in 40us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758304.691392:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00080000:1.0:1782758304.691609:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758304.691645:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211630976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691683:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211630720:0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.691704:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211630848:0@lo:400:kworker.0 00000100:00100000:2.0:1782758304.691705:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211630592:12345-0@lo:400:kworker.0 Request processed in 6594us (6904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758304.691720:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1782758304.696393:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211631232:0@lo:400:kworker.0 00000100:00100000:2.0:1782758304.696492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758304.698258:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631232 00000100:00100000:3.0:1782758304.698275:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631232 00000100:00100000:1.0:1782758304.698290:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758304.698315:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211631104:0@lo:400:kworker.0 00000100:00100000:3.0:1782758304.698386:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1782758304.698389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758304.698400:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211631232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.698448:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631104 00000100:00100000:1.0:1782758304.698452:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631104 00000100:00100000:3.0:1782758304.698483:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211631232:12345-0@lo:400:kworker.0 Request processed in 85us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758304.698493:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1782758304.698497:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:1.0:1782758304.698507:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758304.698550:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211631104:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758304.698557:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:1.0:1782758304.698606:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211631104:0@lo:400:kworker.0 00000100:00100000:2.0:1782758304.698766:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:2.0:1782758304.698773:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2dfc000, transno 4294967359 00000100:00100000:2.0:1782758304.698795:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211631232:0@lo:400:kworker.0 00000100:00080000:2.0:1782758304.698857:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758304.698863:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758304.698986:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211630592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758305.199952:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758305.199982:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211631360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758305.200086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758305.200292:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631360 00000100:00100000:1.0:1782758305.200302:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631360 00000100:00100000:1.0:1782758305.200376:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1782758305.200388:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211631360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758305.200445:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758305.200507:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211631360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758305.200515:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1782758305.201380:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211631360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758305.326952:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758306.351163:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758307.372399:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758307.756761:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211631488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758307.756900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758307.756981:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631488 00000100:00100000:1.0:1782758307.756988:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631488 00000100:00100000:1.0:1782758307.757041:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1782758307.757051:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211631488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758307.757110:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758307.757158:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211631488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758307.757165:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1782758307.757219:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211631488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758307.757626:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758308.396021:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758309.044804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758309.044892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758309.044930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758309.044955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758309.045001:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783872 00000100:00100000:1.0:1782758309.045011:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783872 00000100:00100000:1.0:1782758309.045063:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783744 00000100:00100000:1.0:1782758309.045066:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783744 00000100:00100000:1.0:1782758309.045090:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1295 00000100:00100000:1.0:1782758309.045099:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758309.045148:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783616 00000100:00100000:2.0:1782758309.045152:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783616 00000100:00100000:1.0:1782758309.045168:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758309.045174:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1295 00000100:00100000:2.0:1782758309.045183:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00100000:1.0:1782758309.045192:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1296 00000100:00100000:2.0:1782758309.045193:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196783616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758309.045197:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758309.045218:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196783616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758309.045218:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196783744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 20us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758309.045224:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1296 00000100:00100000:2.0:1782758309.045225:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00080000:2.0:1782758309.045240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758309.045244:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758309.045246:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758309.046094:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196783488 00000100:00100000:0.0:1782758309.046108:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196783488 00000100:00100000:0.0:1782758309.046152:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1315 00000100:00100000:0.0:1782758309.046159:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196783488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758309.046210:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196783488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758309.046216:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1315 00010000:00010000:1.0:1782758309.421439:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758309.804128:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211631616:0@lo:400:kworker.0 00000100:00100000:2.0:1782758309.804158:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211631872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.804198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758309.804226:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211631744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758309.804246:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211632000:0@lo:400:kworker.0 00000100:00100000:2.0:1782758309.807680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758309.807807:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631616 00000100:00100000:2.0:1782758309.807819:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631616 00000100:00100000:2.0:1782758309.807912:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1782758309.807922:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211631616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758309.808000:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211631616:12345-0@lo:400:kworker.0 Request processed in 79us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758309.808008:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1782758309.808466:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631872 00000100:00100000:2.0:1782758309.808473:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631872 00000100:00100000:2.0:1782758309.808514:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:2.0:1782758309.808521:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211631872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758309.808564:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211631872:12345-0@lo:400:kworker.0 Request processed in 43us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758309.808570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00080000:2.0:1782758309.808590:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758309.808620:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211631872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.817737:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211631616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.817784:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211632128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.817863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758309.817921:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632128 00000100:00100000:0.0:1782758309.817928:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632128 00000100:00100000:0.0:1782758309.820779:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1782758309.820804:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211632128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.820927:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211632128:12345-0@lo:400:kworker.0 Request processed in 135us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758309.820935:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1782758309.821194:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211632128:0@lo:400:kworker.0 00000100:00080000:0.0:1782758309.821248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758309.825273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758309.825334:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211632256:0@lo:400:kworker.0 00000100:00100000:3.0:1782758309.825369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758309.826457:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211631744 00000100:00100000:0.0:1782758309.826470:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211631744 00000100:00100000:0.0:1782758309.826522:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1782758309.826531:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.826627:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211631744:12345-0@lo:400:kworker.0 Request processed in 96us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758309.826635:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1782758309.826681:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632256 00000100:00100000:0.0:1782758309.826685:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632256 00000100:00100000:0.0:1782758309.826720:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:0.0:1782758309.826727:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758309.826762:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211632256:12345-0@lo:400:kworker.0 Request processed in 36us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758309.826769:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:0.0:1782758309.826784:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758309.826882:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211631744:0@lo:400:kworker.0 00000100:00100000:3.0:1782758309.826897:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211632256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758309.833786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758309.833878:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632000 00000100:00100000:3.0:1782758309.833889:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632000 00000100:00100000:3.0:1782758309.833960:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1782758309.833970:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211632000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758309.834057:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211632000:12345-0@lo:400:kworker.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758309.834065:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1782758309.834155:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211632000:0@lo:400:kworker.0 00000100:00080000:0.0:1782758309.835155:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758310.327885:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211632384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758310.327967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758310.328098:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632384 00000100:00100000:1.0:1782758310.328105:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632384 00000100:00100000:1.0:1782758310.328155:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1782758310.328164:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211632384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758310.328199:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758310.339810:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211632384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11636us (11832us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758310.339840:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1782758310.360978:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211632384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758310.444290:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758311.469205:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758312.494889:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758312.880072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758312.880097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211632512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758312.880165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758312.880732:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632512 00000100:00100000:1.0:1782758312.880741:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632512 00000100:00100000:1.0:1782758312.880807:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1782758312.880848:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211632512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758312.880890:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758312.880957:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211632512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758312.880964:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:0.0:1782758312.881031:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758312.881146:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211632512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758313.516047:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758314.185413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758314.185522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758314.186613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758314.186694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758314.186990:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784384 00000100:00100000:3.0:1782758314.187000:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784384 00000100:00100000:3.0:1782758314.187073:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784256 00000100:00100000:3.0:1782758314.187077:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784256 00000100:00100000:3.0:1782758314.187100:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1299 00000100:00100000:3.0:1782758314.187110:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196784384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758314.187186:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196784384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758314.187195:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1299 00000100:00100000:3.0:1782758314.187211:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:3.0:1782758314.187218:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196784256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758314.187244:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196784256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758314.187250:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:2.0:1782758314.187424:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784128 00000100:00100000:2.0:1782758314.187429:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784128 00000100:00100000:2.0:1782758314.187479:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:2.0:1782758314.187489:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196784128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758314.187527:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196784128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758314.187534:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:0.0:1782758314.187966:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784000 00000100:00100000:0.0:1782758314.187972:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784000 00000100:00100000:0.0:1782758314.188012:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1317 00000100:00100000:0.0:1782758314.188019:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196784000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758314.188069:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196784000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758314.188075:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1317 00000100:00080000:1.0:1782758314.188444:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758314.188450:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758314.188452:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758314.543914:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758314.924170:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211632768:0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.924280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758314.924348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211633280:0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.924382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758314.924429:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758314.924435:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211632896:0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.924459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758314.924500:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633280 00000100:00100000:2.0:1782758314.924512:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633280 00000100:00100000:0.0:1782758314.924525:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632768 00000100:00100000:2.0:1782758314.924599:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1782758314.924610:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211633280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.924676:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211633280:12345-0@lo:400:kworker.0 Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758314.924684:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00080000:1.0:1782758314.924854:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758314.924870:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211633024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.924911:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211633280:0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.924918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758314.924948:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633024 00000100:00100000:1.0:1782758314.924951:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633024 00000100:00100000:1.0:1782758314.924990:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1782758314.924997:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211633024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925029:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211633024:12345-0@lo:400:kworker.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758314.925034:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:1.0:1782758314.925057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758314.925073:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211633024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925084:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758314.925090:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211632640:0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758314.925162:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211633152:0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758314.925223:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632896 00000100:00100000:1.0:1782758314.925227:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632896 00000100:00100000:1.0:1782758314.925264:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633152 00000100:00100000:1.0:1782758314.925266:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633152 00000100:00100000:1.0:1782758314.925287:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:1.0:1782758314.925293:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211632896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925338:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211632896:12345-0@lo:400:kworker.0 Request processed in 46us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758314.925346:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:1.0:1782758314.925360:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:1.0:1782758314.925366:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211633152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758314.925398:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211633152:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758314.925405:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1782758314.925676:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632768 00000100:00100000:1.0:1782758314.925708:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211632896:0@lo:400:kworker.0 00000100:00080000:1.0:1782758314.925737:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758314.925751:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1782758314.925761:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211633152:0@lo:400:kworker.0 00000100:00100000:0.0:1782758314.925769:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211632768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758314.925903:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211632768:12345-0@lo:400:kworker.0 Request processed in 141us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758314.925911:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1782758314.927082:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211632768:0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.927324:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211632640 00000100:00100000:2.0:1782758314.927332:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211632640 00000100:00100000:2.0:1782758314.927527:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1782758314.927548:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211632640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758314.927652:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211632640:12345-0@lo:400:kworker.0 Request processed in 115us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758314.927660:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1782758314.930762:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211632640:0@lo:400:kworker.0 00000100:00100000:3.0:1782758315.439925:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211633408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758315.440037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758315.440076:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633408 00000100:00100000:1.0:1782758315.440088:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633408 00000100:00100000:1.0:1782758315.440151:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1782758315.440161:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211633408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758315.440214:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758315.440267:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211633408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758315.440276:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1782758315.440340:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211633408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758315.564187:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758316.533888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758316.533949:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784512 00000100:00100000:0.0:1782758316.533958:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784512 00000100:00100000:0.0:1782758316.534017:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1000 00000100:00100000:0.0:1782758316.534028:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196784512:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758316.534124:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196784512:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 97us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758316.534132:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1000 00000100:00080000:0.0:1782758316.534153:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758316.538667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758316.540588:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784640 00000100:00100000:0.0:1782758316.540601:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784640 00000100:00100000:0.0:1782758316.540687:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 550 00000100:00100000:0.0:1782758316.540700:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196784640:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758316.541209:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196784640:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 512us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758316.541220:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 550 00000100:00080000:3.0:1782758316.541608:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758316.544125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758316.545061:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784768 00000100:00100000:2.0:1782758316.545073:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784768 00000100:00100000:2.0:1782758316.545134:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 551 00000100:00100000:2.0:1782758316.545146:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196784768:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758316.545937:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196784768:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 792us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758316.545946:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 551 00000100:00080000:2.0:1782758316.545979:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758316.557920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758316.559802:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196784896 00000100:00100000:1.0:1782758316.559815:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196784896 00000100:00100000:1.0:1782758316.559898:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1001 00000100:00100000:1.0:1782758316.559909:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196784896:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758316.560353:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196784896:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 444us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758316.560361:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1001 00000100:00100000:2.0:1782758316.571557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758316.572295:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785024 00000100:00100000:3.0:1782758316.572312:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785024 00000100:00100000:3.0:1782758316.572395:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1002 00000100:00100000:3.0:1782758316.572408:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196785024:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758316.572627:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196785024:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 221us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758316.572636:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1002 00000100:00100000:3.0:1782758316.577122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758316.577851:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785152 00000100:00100000:2.0:1782758316.577867:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785152 00000100:00100000:2.0:1782758316.577968:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:2.0:1782758316.577983:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196785152:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758316.580609:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196785152:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2614us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758316.580626:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:2.0:1782758316.582818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758316.582913:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785280 00000100:00100000:1.0:1782758316.582928:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785280 00000100:00100000:1.0:1782758316.583002:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 553 00000100:00100000:1.0:1782758316.583013:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196785280:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758316.583402:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53076:x1869355196785280:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 390us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758316.583410:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 553 00010000:00010000:2.0:1782758316.588027:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758316.588068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758316.588147:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785408 00000100:00100000:1.0:1782758316.588161:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785408 00000100:00100000:1.0:1782758316.588236:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1003 00000100:00100000:1.0:1782758316.588246:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196785408:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758316.588708:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53076:x1869355196785408:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 462us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758316.588717:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1003 00010000:00010000:3.0:1782758317.622808:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758317.997235:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211633536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758317.997362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758317.997434:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633536 00000100:00100000:0.0:1782758317.997441:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633536 00000100:00100000:0.0:1782758317.997507:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1782758317.997517:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211633536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758317.997554:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758317.997596:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211633536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758317.997602:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00080000:0.0:1782758317.997622:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758317.997654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211633536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758318.636250:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758319.284435:0:90098:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccfed3b60 20000000:00000080:2.0:1782758319.284473:0:90098:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfecc00 uarg=0000000000000000 00010000:00010000:2.0:1782758319.285062:0:90098:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758319.285153:0:90098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758319.285158:0:90098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758319.285169:0:90098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c0b expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.285205:0:90098:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758319.285223:0:90098:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758319.285238:0:90098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.285252:0:90098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.285261:0:90098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.285301:0:90098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.285316:0:90098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 18 pid: 5793 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758319.285333:0:90098:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90098:1869355211633664:0@lo:104: 00000100:00100000:2.0:1782758319.285409:0:90098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758319.285488:0:90098:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758319.285538:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633664 00000100:00100000:0.0:1782758319.285546:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633664 00000100:00100000:0.0:1782758319.285613:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1782758319.285623:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90098:x1869355211633664:12345-0@lo:104: 00010000:00010000:0.0:1782758319.285637:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.285709:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758319.285716:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90098:x1869355211633664:12345-0@lo:104: Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758319.285723:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:3.0:1782758319.286014:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758319.286023:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758319.286031:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758319.286035:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758319.286046:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758319.286052:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758319.286057:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758319.286110:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758319.286118:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782758319.286171:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211633792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758319.286208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782758319.286255:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758319.286264:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db15a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db161 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758319.286281:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758319.286283:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758319.286284:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758319.286510:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633792 00000100:00100000:0.0:1782758319.286516:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633792 00010000:00010000:0.0:1782758319.286540:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758319.286584:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1782758319.286591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211633792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758319.286603:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758319.286610:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286620:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286637:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286645:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286660:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286667:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286673:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286679:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286684:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758319.286688:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286695:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286703:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758319.286713:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758319.288036:0:90098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db161 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db15a expref: 19 pid: 5793 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758319.288056:0:90098:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90098:1869355211633664:0@lo:104: 00010000:00010000:2.0:1782758319.288079:0:90098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.288089:0:90098:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.288096:0:90098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758319.288103:0:90098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777db1d8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758319.293969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758319.294054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758319.294129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758319.294156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758319.294184:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785792 00000100:00100000:3.0:1782758319.294195:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785792 00000100:00100000:3.0:1782758319.294258:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785920 00000100:00100000:3.0:1782758319.294261:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785920 00000100:00100000:3.0:1782758319.294288:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:3.0:1782758319.294297:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758319.294371:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758319.294380:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:3.0:1782758319.294397:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1304 00000100:00100000:3.0:1782758319.294404:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758319.294429:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758319.294435:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1304 00000100:00100000:2.0:1782758319.296488:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785536 00000100:00100000:2.0:1782758319.296500:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785536 00000100:00100000:2.0:1782758319.296564:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1319 00000100:00100000:2.0:1782758319.296574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196785536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758319.296638:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196785536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 65us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758319.296646:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1319 00000100:00100000:2.0:1782758319.296683:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196785664 00000100:00100000:2.0:1782758319.296688:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196785664 00000100:00100000:2.0:1782758319.296719:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00100000:2.0:1782758319.296725:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758319.296754:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196785664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758319.296762:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00080000:2.0:1782758319.297947:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758319.297955:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758319.297957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758319.298722:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211633792:12345-0@lo:103:ldlm_bl.0 Request processed in 12125us (12507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758319.298738:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1782758319.298940:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211633792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758319.667553:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758320.044015:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211633920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.044095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.044160:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211634432:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.044189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.044216:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758320.044222:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211634048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.044260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.044495:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211634560:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.044524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.044607:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211634176:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.044634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.044657:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758320.044662:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634560 00000100:00100000:3.0:1782758320.044672:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634560 00000100:00100000:3.0:1782758320.044728:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1782758320.044737:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211634560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758320.044794:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211634560:12345-0@lo:400:kworker.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758320.044801:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:3.0:1782758320.044819:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758320.045019:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211634304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.045048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.045091:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211633920 00000100:00100000:0.0:1782758320.045095:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211633920 00000100:00100000:3.0:1782758320.045222:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634304 00000100:00100000:3.0:1782758320.045226:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634304 00000100:00100000:3.0:1782758320.045255:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1782758320.045260:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211634304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758320.045296:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211634304:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758320.045302:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00080000:3.0:1782758320.045313:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758320.046619:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1782758320.046634:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211633920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.046699:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211633920:12345-0@lo:400:kworker.0 Request processed in 70us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758320.046709:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1782758320.046752:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634432 00000100:00100000:0.0:1782758320.049490:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634432 00000100:00100000:0.0:1782758320.049582:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634048 00000100:00100000:0.0:1782758320.049586:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634048 00000100:00100000:0.0:1782758320.049611:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634176 00000100:00100000:0.0:1782758320.049615:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634176 00000100:00100000:0.0:1782758320.049640:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:0.0:1782758320.049651:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211634432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.049743:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211634432:12345-0@lo:400:kworker.0 Request processed in 94us (5552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758320.049751:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:0.0:1782758320.049770:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1782758320.049777:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.049811:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211634048:12345-0@lo:400:kworker.0 Request processed in 34us (5551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758320.049817:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1782758320.049844:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1782758320.049851:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211634176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.049881:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211634176:12345-0@lo:400:kworker.0 Request processed in 31us (5247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758320.049887:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1782758320.049957:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211634304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.049971:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211634176:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.050012:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211634048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.050025:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211634560:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.050035:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211633920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758320.050044:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211634432:0@lo:400:kworker.0 00000100:00080000:1.0:1782758320.053943:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1782758320.363967:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758320.363975:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758320.363980:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758320.364025:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758320.364037:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758320.364048:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758320.364097:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211634688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758320.364348:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.364396:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170824483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758320.364467:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634688 00000100:00100000:3.0:1782758320.364475:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634688 00000100:00100000:3.0:1782758320.364527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1782758320.364537:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211634688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758320.364551:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758320.364566:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db1df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758320.364589:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758320.364600:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758320.364608:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758320.364670:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211634688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758320.364677:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1782758320.364765:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211634688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758320.364780:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758320.364789:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758320.364808:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758320.364813:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758320.364848:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758320.556198:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211634816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758320.556272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758320.556400:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634816 00000100:00100000:0.0:1782758320.556408:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634816 00000100:00100000:0.0:1782758320.556466:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1782758320.556476:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211634816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758320.556510:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758320.556565:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211634816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758320.556573:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1782758320.556610:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211634816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758320.684956:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758321.708242:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758322.279735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758322.280109:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786048 00000100:00100000:1.0:1782758322.280121:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786048 00000100:00100000:1.0:1782758322.280194:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:1.0:1782758322.280205:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53163:x1869355196786048:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758322.280230:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758322.280319:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c20 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280391:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280413:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280425:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758322.280607:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1782758322.280612:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758322.280689:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280716:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777db1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c20 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280737:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c20 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758322.280745:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782758322.280748:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758322.280751:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758322.280814:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53163:x1869355196786048:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 611us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758322.280861:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00080000:3.0:1782758322.281104:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758322.283480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758322.283613:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786304 00000100:00100000:3.0:1782758322.283624:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786304 00000100:00100000:3.0:1782758322.283681:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1005 00000100:00100000:3.0:1782758322.283690:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53163:x1869355196786304:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758322.283926:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758322.283955:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c20 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758322.283969:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db184) 00010000:00010000:3.0:1782758322.283974:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:3.0:1782758322.283986:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758322.284011:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758322.284023:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758322.284033:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758322.389799:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967685 is committed 00000004:00010000:3.0:1782758322.391959:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069ffd5e4 reply state 00000000ba59d45e transno 4294967685 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758322.391980:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782758322.392185:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:3.0:1782758322.392290:0:5802:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782758322.392308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53163:x1869355196786304:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 108614us (108829us total) trans 4294967685 rc 0/0 00000100:00100000:3.0:1782758322.392317:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1005 00010000:00010000:0.0:1782758322.394275:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394293:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394301:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394307:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758322.394312:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394319:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394337:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75d00) 00010000:00010000:0.0:1782758322.394340:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758322.394345:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758322.394351:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db1fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758322.738611:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758323.118131:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211634944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758323.118229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758323.118575:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211634944 00000100:00100000:0.0:1782758323.118585:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211634944 00000100:00100000:0.0:1782758323.118656:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1782758323.118667:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211634944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758323.118713:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758323.118779:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211634944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758323.118787:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:3.0:1782758323.118855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758323.119018:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211634944:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782758323.373601:0:90296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb97b52b0 20000000:00000080:2.0:1782758323.373620:0:90296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfee400 uarg=0000000000000000 00010000:00010000:2.0:1782758323.374518:0:90296:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758323.374537:0:90296:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758323.374551:0:90296:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758323.374569:0:90296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758323.374586:0:90296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758323.374594:0:90296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758323.374632:0:90296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758323.374644:0:90296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 18 pid: 5796 timeout: 2491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758323.374660:0:90296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90296:1869355211635072:0@lo:104: 00000100:00100000:2.0:1782758323.374720:0:90296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758323.375001:0:90296:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186293540 going to sleep for 11 seconds 00000100:00100000:3.0:1782758323.377658:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635072 00000100:00100000:3.0:1782758323.377675:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635072 00000100:00100000:3.0:1782758323.380993:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1782758323.381983:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90296:x1869355211635072:12345-0@lo:104: 00010000:00010000:3.0:1782758323.382006:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758323.382134:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758323.382141:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90296:x1869355211635072:12345-0@lo:104: Request processed in 1137us (7421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758323.382150:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1782758323.382260:0:90296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90296:1869355211635072:0@lo:104: 00010000:00010000:0.0:1782758323.382286:0:90296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382341:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758323.382349:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382358:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758323.382361:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382370:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758323.382387:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758323.382393:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758323.382444:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382455:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758323.382477:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382484:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db1df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db1e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382504:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758323.382506:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758323.382507:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758323.382521:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211635200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758323.382561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758323.382612:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635200 00000100:00100000:1.0:1782758323.382618:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635200 00010000:00010000:1.0:1782758323.382643:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 2491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758323.382668:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1782758323.382676:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211635200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758323.382686:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758323.382691:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 2491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382701:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 2491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382715:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777db1e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db1df expref: 19 pid: 5796 timeout: 2491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382732:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382740:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382754:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382762:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382769:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382774:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382779:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758323.382783:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382790:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382801:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758323.382809:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758323.382863:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211635200:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758323.382872:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1782758323.382926:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211635200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758323.383074:0:90296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758323.383083:0:90296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758323.383089:0:90296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777db202 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758323.756259:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758324.419436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758324.419483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758324.419513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758324.419542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758324.419577:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786688 00000100:00100000:1.0:1782758324.419585:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786688 00000100:00100000:1.0:1782758324.419636:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786816 00000100:00100000:1.0:1782758324.419639:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786816 00000100:00100000:1.0:1782758324.419670:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1307 00000100:00100000:1.0:1782758324.419683:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758324.419817:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786432 00000100:00100000:2.0:1782758324.419838:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786432 00000100:00100000:2.0:1782758324.419873:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:2.0:1782758324.419880:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196786432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758324.419932:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196786432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758324.419941:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:1.0:1782758324.420349:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 668us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758324.420367:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1307 00000100:00100000:1.0:1782758324.420387:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1308 00000100:00100000:1.0:1782758324.420395:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758324.420421:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758324.420428:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1308 00000100:00100000:1.0:1782758324.420449:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786560 00000100:00100000:1.0:1782758324.420453:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786560 00000100:00100000:1.0:1782758324.420485:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1705 00000100:00100000:1.0:1782758324.420492:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758324.420524:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196786560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758324.420531:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1705 00000100:00080000:1.0:1782758324.420553:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758324.420557:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758324.420559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758324.782173:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758324.922322:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758324.922491:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758324.922498:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758324.922563:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758324.922579:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758324.922592:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758324.922626:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211635328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758324.922898:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758324.923086:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758324.923967:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635328 00000100:00100000:0.0:1782758324.923980:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635328 00000100:00100000:0.0:1782758324.924048:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1782758324.924058:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211635328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758324.924078:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758324.924098:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db209 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758324.924124:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758324.924136:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758324.924145:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758324.924206:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211635328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758324.924213:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1782758324.928978:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211635328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758324.929015:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758324.929030:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758324.929054:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758324.929061:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758324.929069:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758325.165703:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211635456:0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.165774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758325.166483:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211635712:0@lo:400:kworker.0 00000100:00100000:2.0:1782758325.166524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758325.166696:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635712 00000100:00100000:0.0:1782758325.166705:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635712 00000100:00100000:0.0:1782758325.166766:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1782758325.166775:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211635712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758325.166846:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211635712:12345-0@lo:400:kworker.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758325.166854:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00080000:0.0:1782758325.166876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758325.167805:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211635968:0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.168119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758325.168208:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758325.168216:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211635840:0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.168243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758325.168279:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211635584:0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.168302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758325.168346:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635456 00000100:00100000:3.0:1782758325.168352:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635456 00000100:00100000:3.0:1782758325.168389:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635840 00000100:00100000:3.0:1782758325.168392:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635840 00000100:00100000:3.0:1782758325.168413:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635584 00000100:00100000:3.0:1782758325.168415:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635584 00000100:00100000:3.0:1782758325.168430:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:3.0:1782758325.168437:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211635456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.168807:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211635456:12345-0@lo:400:kworker.0 Request processed in 368us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758325.168815:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:3.0:1782758325.168857:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1782758325.168864:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211635840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.168895:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211635840:12345-0@lo:400:kworker.0 Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758325.168901:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1782758325.168912:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1782758325.168918:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211635584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.169322:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211635584:12345-0@lo:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758325.169330:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1782758325.169394:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211635584:0@lo:400:kworker.0 00000100:00080000:3.0:1782758325.169418:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758325.169449:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211635840:0@lo:400:kworker.0 00000100:00100000:3.0:1782758325.169460:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211635456:0@lo:400:kworker.0 00000100:00100000:2.0:1782758325.171812:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211635712:0@lo:400:kworker.0 00000100:00100000:0.0:1782758325.175033:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211635968 00000100:00100000:0.0:1782758325.175046:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211635968 00000100:00100000:0.0:1782758325.175116:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1782758325.175126:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758325.175220:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211635968:12345-0@lo:400:kworker.0 Request processed in 96us (7101us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758325.175228:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00080000:0.0:1782758325.175255:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758325.175292:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211635968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758325.676593:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758325.676620:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758325.677357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758325.677584:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636096 00000100:00100000:3.0:1782758325.677592:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636096 00000100:00100000:0.0:1782758325.678265:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1782758325.678279:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211636096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758325.678318:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758325.678385:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211636096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758325.678609:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758325.679348:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00010000:00010000:0.0:1782758325.811670:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758326.741016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758326.741101:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196786944 00000100:00100000:3.0:1782758326.741113:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196786944 00000100:00100000:3.0:1782758326.741185:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1006 00000100:00100000:3.0:1782758326.741196:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53240:x1869355196786944:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758326.741218:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758326.741243:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c27 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741305:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741333:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741346:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741359:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741367:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741374:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741907:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741918:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.741927:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758326.742009:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758326.742014:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758326.742092:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742106:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742112:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742119:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742125:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758326.742129:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742137:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742150:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758326.742153:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758326.742159:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742166:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742178:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742185:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742191:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742197:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758326.742200:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742206:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742214:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75800) 00010000:00010000:3.0:1782758326.742216:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758326.742219:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742230:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742260:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c27 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742274:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c27 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.742281:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758326.742283:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758326.742285:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782758326.742356:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53240:x1869355196786944:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1162us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758326.742363:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1006 00000100:00080000:0.0:1782758326.742784:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758326.748301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758326.748417:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196787200 00000100:00100000:0.0:1782758326.748428:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196787200 00000100:00100000:0.0:1782758326.748487:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:0.0:1782758326.748498:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53240:x1869355196787200:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782758326.748519:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758326.748540:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db233 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c2e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.748905:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.748920:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.748932:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.748997:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.749005:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.749011:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758326.749785:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:0.0:1782758326.750074:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750086:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750096:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750132:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750139:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750146:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750151:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758326.750155:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750162:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750174:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75b00) 00010000:00010000:0.0:1782758326.750177:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758326.750181:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750187:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db23a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758326.750200:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4ec0e0b reply state 000000005659d633 transno 4294967686 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758326.750209:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758326.750240:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db233 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c2e expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750254:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c2e expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.750262:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:0.0:1782758326.750265:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758326.750267:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758326.750359:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53240:x1869355196787200:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1861us (2067us total) trans 4294967686 rc 0/0 00000100:00100000:0.0:1782758326.750368:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1007 00010000:00010000:1.0:1782758326.762375:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762394:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762403:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762410:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758326.762415:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762424:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762442:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff91718bcfd300) 00010000:00010000:1.0:1782758326.762446:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758326.762451:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.762458:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db241 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758326.768940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758326.768984:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196787456 00000100:00100000:3.0:1782758326.768993:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196787456 00000100:00100000:3.0:1782758326.769050:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1008 00000100:00100000:3.0:1782758326.769061:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:53240:x1869355196787456:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:3.0:1782758326.769147:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758326.769177:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c2e expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.769198:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff91718bcfdc00) 00010000:00010000:3.0:1782758326.769211:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758326.769253:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.769268:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.769278:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758326.769431:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f1220f2 reply state 0000000085f48548 transno 4294967687 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758326.769441:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758326.769536:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53240:x1869355196787456:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 476us (604us total) trans 4294967687 rc 0/0 00000100:00100000:3.0:1782758326.769544:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1008 00010000:00010000:2.0:1782758326.773168:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773186:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773195:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773201:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758326.773207:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773216:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773235:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff917191f75d00) 00010000:00010000:2.0:1782758326.773239:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758326.773243:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.773250:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758326.774576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758326.774645:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196787584 00000100:00100000:2.0:1782758326.774655:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196787584 00000100:00100000:2.0:1782758326.774716:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1009 00000100:00100000:2.0:1782758326.774725:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:53240:x1869355196787584:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782758326.774750:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758326.774772:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db25d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c35 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.774864:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db25d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c35 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.774880:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db25d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c35 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758326.774901:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758326.774905:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782758326.774909:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758326.774971:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53240:x1869355196787584:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 247us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758326.774979:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1009 00000100:00100000:1.0:1782758326.780939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758326.781716:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196787712 00000100:00100000:3.0:1782758326.781733:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196787712 00000100:00100000:3.0:1782758326.781881:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 554 00000100:00100000:3.0:1782758326.781896:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196787712:12345-192.168.204.31@tcp:2:touch.60003 00000100:00080000:0.0:1782758326.782575:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758326.794913:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196787712:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 13004us (13966us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1782758326.794931:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 554 00000100:00100000:2.0:1782758326.810875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758326.810941:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196787968 00000100:00100000:1.0:1782758326.810958:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196787968 00000100:00100000:1.0:1782758326.811034:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 102 00000100:00100000:1.0:1782758326.811045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53240:x1869355196787968:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:1.0:1782758326.811433:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:53240:x1869355196787968:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 389us (607us total) trans 4294967688 rc 0/0 00000100:00100000:1.0:1782758326.811442:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 102 00010000:00010000:1.0:1782758326.830771:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758326.891286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758326.891414:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788096 00000100:00100000:1.0:1782758326.891426:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788096 00000100:00100000:1.0:1782758326.891492:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:1.0:1782758326.891504:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:53244:x1869355196788096:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782758326.891529:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758326.891550:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777db264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c3c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891614:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891641:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891654:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891669:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891677:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891683:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891795:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891804:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891812:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758326.891881:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 0 00000004:00200000:1.0:1782758326.891885:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758326.891903:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891915:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891925:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891932:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891939:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891951:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758326.891956:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891964:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891976:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75b00) 00010000:00010000:1.0:1782758326.891980:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758326.891984:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.891990:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db26b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892005:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892011:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892017:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892023:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758326.892026:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892031:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892042:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3a900) 00010000:00010000:1.0:1782758326.892044:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758326.892047:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892052:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892080:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777db264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c3c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892097:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c3c expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.892105:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782758326.892107:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758326.892110:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:2.0:1782758326.892969:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:53244:x1869355196788096:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 1445us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758326.892985:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:2.0:1782758326.898964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758326.899081:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788224 00000100:00100000:0.0:1782758326.899096:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788224 00000100:00100000:0.0:1782758326.899168:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 555 00000100:00100000:0.0:1782758326.899179:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196788224:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:0.0:1782758326.899203:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758326.899230:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c43 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758326.899263:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x6a42bbb5, atime: 0x6a42bbb5, ctime: 0x6a42bbb5, blocks: 0x1 00010000:00010000:0.0:1782758326.899289:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2395s v=(0 0) 00010000:00010000:0.0:1782758326.899293:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758326.899317:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.899340:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.899366:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758326.899444:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196788224:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 266us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758326.899452:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 555 00000100:00100000:3.0:1782758326.906190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758326.908043:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788480 00000100:00100000:0.0:1782758326.908056:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788480 00000100:00100000:0.0:1782758326.908126:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1011 00000100:00100000:0.0:1782758326.908136:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:53244:x1869355196788480:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:0.0:1782758326.908191:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758326.908217:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c3c expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908241:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db25d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c35 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908252:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782758326.908262:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758326.908282:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908295:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908318:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908334:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908341:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908348:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908454:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908463:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.908470:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758326.909598:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:0.0:1782758326.909631:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2395312808147ns, next at 2396312805177ns, rc = 0 00010000:00010000:0.0:1782758326.909700:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909714:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909723:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909732:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909739:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909748:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909772:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758326.909795:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909801:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909807:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909814:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758326.909818:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909844:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909854:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:0.0:1782758326.909857:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758326.909861:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909867:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db295 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909883:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909890:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909897:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909902:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758326.909905:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909912:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909919:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75b00) 00010000:00010000:0.0:1782758326.909921:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758326.909924:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758326.909931:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db287 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758326.909939:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f316fb4f reply state 000000002705f9f1 transno 4294967689 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758326.909948:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758326.910022:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:53244:x1869355196788480:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 1884us (3839us total) trans 4294967689 rc 0/0 00000100:00100000:0.0:1782758326.910030:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1011 00010000:00010000:3.0:1782758326.910341:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758326.910349:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.910357:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758326.910360:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.910368:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.910378:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:3.0:1782758326.910381:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758326.910384:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.910390:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777db29c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758326.910404:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758326.910406:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758326.910407:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758326.914477:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914500:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914509:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914516:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758326.914523:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914536:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914562:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff91718bcfdd00) 00010000:00010000:1.0:1782758326.914565:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758326.914571:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758326.914577:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db28e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758327.798988:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000001:00080000:1.0:1782758327.813552:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967689 is committed 00000004:00080000:1.0:1782758327.813566:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000100:00100000:3.0:1782758327.814503:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758327.814527:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211636224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758327.815259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758327.819765:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636224 00000100:00100000:0.0:1782758327.819780:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636224 00000100:00100000:0.0:1782758327.819871:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1782758327.819883:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211636224:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1782758327.820080:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1782758327.820437:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:0.0:1782758327.820537:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.820560:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.820571:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782758327.820575:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758327.820579:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.820746:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.820763:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 5 pid: 6597 timeout: 2496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758327.820780:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211636352:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758327.821070:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758327.824420:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211636352:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758327.824453:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758327.825197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758327.825898:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788608 00000100:00100000:0.0:1782758327.825909:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788608 00010000:00010000:0.0:1782758327.825954:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 6 pid: 6597 timeout: 2496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758327.825993:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 414 00000100:00100000:0.0:1782758327.826002:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196788608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758327.826018:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758327.826025:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 6 pid: 6597 timeout: 2496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.826039:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 6 pid: 6597 timeout: 2496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.826067:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a34bc0/0xdd99f5c4777db280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c43 expref: 6 pid: 6597 timeout: 2496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.826085:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758327.826089:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758327.826175:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.826186:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.826226:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758327.826393:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196788608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 389us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758327.826402:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 414 00010000:00010000:2.0:1782758327.828120:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758327.828139:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758327.828151:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758327.828160:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758327.828185:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782758327.830579:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211636224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10691us (15315us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1782758327.830593:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00010000:00010000:0.0:1782758327.831205:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758327.831215:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.831228:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758327.831233:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.831244:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.831265:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.831273:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777db2a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758327.831303:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758327.831305:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758327.831306:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758327.837684:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171bdef6680/2, rc 0, transno 4294967361 00000100:00100000:3.0:1782758327.837701:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211636224:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782758327.860420:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758328.238077:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758328.238099:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211636480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758328.238168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758328.238238:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636480 00000100:00100000:0.0:1782758328.238247:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636480 00000100:00100000:0.0:1782758328.238308:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1782758328.238317:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211636480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758328.238354:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758328.238399:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211636480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758328.241127:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211636480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758328.246885:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00010000:00010000:3.0:1782758328.876467:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758328.942793:0:90541:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce7816a30 20000000:00000080:2.0:1782758328.942810:0:90541:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfee400 uarg=0000000000000000 00010000:00010000:2.0:1782758328.943725:0:90541:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758328.943764:0:90541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75b00) 00010000:00010000:2.0:1782758328.943768:0:90541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758328.943779:0:90541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db22c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c27 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.943801:0:90541:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758328.943816:0:90541:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758328.943873:0:90541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.943887:0:90541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.943897:0:90541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.943951:0:90541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.943966:0:90541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 18 pid: 5793 timeout: 2497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758328.943982:0:90541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90541:1869355211636608:0@lo:104: 00000100:00100000:2.0:1782758328.944051:0:90541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758328.944124:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636608 00000100:00100000:0.0:1782758328.944131:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636608 00000100:00100000:2.0:1782758328.944228:0:90541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782758328.944234:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782758328.944243:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90541:x1869355211636608:12345-0@lo:104: 00010000:00010000:0.0:1782758328.944256:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758328.944342:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758328.944348:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90541:x1869355211636608:12345-0@lo:104: Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758328.944354:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:3.0:1782758328.944375:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758328.944383:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758328.944392:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758328.944397:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758328.944407:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758328.944414:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758328.944422:0:90541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90541:1869355211636608:0@lo:104: 00010000:00010000:2.0:1782758328.944441:0:90541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758328.944529:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758328.944563:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758328.944570:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758328.944744:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758328.944753:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777db209 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db210 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758328.944767:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1782758328.944769:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758328.944772:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758328.944775:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758328.944783:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211636736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758328.944817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758328.945009:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636736 00000100:00100000:2.0:1782758328.945016:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636736 00010000:00010000:2.0:1782758328.945037:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 2497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758328.945107:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1782758328.945115:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211636736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758328.945126:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758328.945132:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 2497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945142:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 2497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945155:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db210 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db209 expref: 19 pid: 5793 timeout: 2497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945166:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945174:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945187:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945195:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945201:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945208:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945213:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758328.945217:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945224:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945243:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758328.945253:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758328.945302:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211636736:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758328.945309:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:0.0:1782758328.945360:0:90541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758328.945369:0:90541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758328.945375:0:90541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777db2aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758328.946037:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211636736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758329.531053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758329.531086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758329.531113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758329.531148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758329.531173:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789120 00000100:00100000:2.0:1782758329.531183:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789120 00000100:00100000:2.0:1782758329.531232:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788992 00000100:00100000:2.0:1782758329.531236:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788992 00000100:00100000:2.0:1782758329.531277:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:2.0:1782758329.531288:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196789120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758329.531358:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196789120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758329.531365:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:2.0:1782758329.531382:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1312 00000100:00100000:2.0:1782758329.531389:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196788992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758329.531411:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196788992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758329.531416:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1312 00000100:00100000:2.0:1782758329.531431:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788736 00000100:00100000:2.0:1782758329.531434:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788736 00000100:00100000:2.0:1782758329.531455:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1324 00000100:00100000:2.0:1782758329.531461:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196788736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758329.531481:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196788736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758329.531486:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1324 00000100:00080000:2.0:1782758329.531526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758329.531529:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758329.534969:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196788864 00000100:00100000:0.0:1782758329.534985:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196788864 00000100:00100000:0.0:1782758329.535063:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1709 00000100:00100000:0.0:1782758329.535073:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196788864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758329.535159:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196788864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758329.535166:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1709 00000100:00080000:0.0:1782758329.535193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758329.900356:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758330.091943:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758330.091951:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758330.091957:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758330.092002:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758330.092014:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758330.092025:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758330.092052:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211636864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758330.092127:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758330.092230:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758330.093138:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636864 00000100:00100000:0.0:1782758330.093149:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636864 00000100:00100000:0.0:1782758330.093208:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1782758330.093217:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211636864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758330.093233:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758330.095858:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db2b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758330.095914:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758330.095928:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758330.096083:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758330.096192:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211636864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2974us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758330.096202:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1782758330.096350:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211636864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758330.096369:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758330.096379:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758330.096400:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758330.096405:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758330.096412:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758330.291116:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211637120:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291137:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211636992:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758330.291475:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211637504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758330.291538:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211637248:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758330.291594:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211636992 00000100:00100000:1.0:1782758330.291601:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211636992 00000100:00100000:1.0:1782758330.291649:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1782758330.291657:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291708:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211636992:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758330.291715:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1782758330.291742:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637504 00000100:00100000:1.0:1782758330.291745:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637504 00000100:00100000:1.0:1782758330.291777:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637248 00000100:00100000:1.0:1782758330.291780:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637248 00000100:00100000:1.0:1782758330.291802:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1782758330.291847:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211637504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758330.291854:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211637376:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.291879:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211637504:12345-0@lo:400:kworker.0 Request processed in 58us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758330.291896:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1782758330.291910:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1782758330.291916:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211637248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.292590:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211637248:12345-0@lo:400:kworker.0 Request processed in 672us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758330.292591:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758330.292603:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1782758330.292635:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637376 00000100:00100000:1.0:1782758330.292640:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637376 00000100:00100000:1.0:1782758330.292669:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1782758330.292675:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211637376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.292719:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211637376:12345-0@lo:400:kworker.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758330.292725:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00080000:0.0:1782758330.292740:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758330.292745:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758330.292749:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758330.292769:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211637248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758330.292779:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211636992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758330.292796:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211637504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.292811:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211637376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758330.292848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758330.292868:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637120 00000100:00100000:1.0:1782758330.292872:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637120 00000100:00080000:0.0:1782758330.293134:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758330.293218:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1782758330.293229:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758330.293462:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211637120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758330.293511:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211637120:12345-0@lo:400:kworker.0 Request processed in 284us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758330.293519:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1782758330.805006:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211637632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758330.805075:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758330.805563:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637632 00000100:00100000:0.0:1782758330.805571:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637632 00000100:00100000:0.0:1782758330.805621:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1782758330.805631:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211637632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758330.805738:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758330.805787:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211637632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758330.805794:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1782758330.805863:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211637632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758330.924705:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758331.961050:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758332.215989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758332.216943:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789248 00000100:00100000:3.0:1782758332.216961:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789248 00000100:00100000:3.0:1782758332.217058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1012 00000100:00100000:3.0:1782758332.217069:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53332:x1869355196789248:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758332.217097:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758332.217128:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db2bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c4a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782758332.217413:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758332.217657:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758332.217675:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758332.217689:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758332.217985:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758332.217990:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758332.218072:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758332.218108:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c4a expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758332.218133:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c4a expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758332.218145:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758332.218149:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758332.218153:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758332.219757:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53332:x1869355196789248:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2674us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758332.219774:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1012 00000100:00100000:0.0:1782758332.236940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758332.237032:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789504 00000100:00100000:1.0:1782758332.237046:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789504 00000100:00100000:1.0:1782758332.237124:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1013 00000100:00100000:1.0:1782758332.237138:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53332:x1869355196789504:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758332.237228:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758332.237268:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c4a expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.237289:0:5801:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db22c) 00010000:00010000:1.0:1782758332.237294:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75300) 00010000:00010000:1.0:1782758332.237309:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758332.237346:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.237362:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.237374:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758332.359613:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967690 is committed 00000004:00010000:1.0:1782758332.360047:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027e4ef60 reply state 000000006efb54af transno 4294967690 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758332.360064:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758332.360255:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:1.0:1782758332.360368:0:5801:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758332.360388:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53332:x1869355196789504:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 123249us (123460us total) trans 4294967690 rc 0/0 00000100:00100000:1.0:1782758332.360396:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1013 00010000:00010000:1.0:1782758332.360437:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360446:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360454:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360459:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758332.360464:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360472:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360487:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9171a0e3af00) 00010000:00010000:1.0:1782758332.360491:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758332.360496:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758332.360502:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777db2cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758332.982942:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00010000:00010000:3.0:1782758332.983614:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758333.360881:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758333.360908:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211637760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758333.360981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758333.361124:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637760 00000100:00100000:0.0:1782758333.361133:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637760 00000100:00100000:0.0:1782758333.361207:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1782758333.361217:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211637760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758333.361254:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758333.361302:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211637760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758333.361309:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1782758333.361349:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:0.0:1782758333.361354:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171bdef6680, transno 4294967361 00000100:00100000:0.0:1782758333.361374:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211637760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758333.362148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782758333.394051:0:90739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb14f77d0 20000000:00000080:2.0:1782758333.394072:0:90739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317ec00 uarg=0000000000000000 00010000:00010000:2.0:1782758333.395793:0:90739:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758333.395815:0:90739:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758333.396231:0:90739:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758333.396252:0:90739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758333.396270:0:90739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758333.396278:0:90739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758333.396318:0:90739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758333.396335:0:90739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 18 pid: 5794 timeout: 2501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758333.396351:0:90739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90739:1869355211637888:0@lo:104: 00000100:00100000:2.0:1782758333.396423:0:90739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758333.396532:0:90739:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758333.402633:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211637888 00000100:00100000:3.0:1782758333.402646:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211637888 00000100:00100000:2.0:1782758333.402857:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782758333.402867:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90739:x1869355211637888:12345-0@lo:104: 00010000:00010000:2.0:1782758333.402886:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758333.402982:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758333.402988:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90739:x1869355211637888:12345-0@lo:104: Request processed in 123us (6566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758333.402997:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:0.0:1782758333.403071:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758333.403078:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403086:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758333.403090:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403099:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758333.403107:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758333.403112:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758333.403150:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403156:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758333.403175:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403191:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403209:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758333.403210:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758333.403212:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758333.403226:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211638016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758333.403266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758333.403323:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638016 00000100:00100000:0.0:1782758333.403327:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638016 00010000:00010000:0.0:1782758333.403348:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 19 pid: 5794 timeout: 2501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758333.403370:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1782758333.403377:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211638016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758333.403388:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758333.403393:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 19 pid: 5794 timeout: 2501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403403:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 19 pid: 5794 timeout: 2501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403420:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403430:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403452:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403458:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403465:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403471:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403477:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758333.403481:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403488:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403506:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758333.403516:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758333.403544:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211638016:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758333.403550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1782758333.403598:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211638016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758333.403917:0:90739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db2b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db2b1 expref: 18 pid: 5794 timeout: 2501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758333.403929:0:90739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90739:1869355211637888:0@lo:104: 00010000:00010000:3.0:1782758333.403944:0:90739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758333.403954:0:90739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758333.403959:0:90739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758333.403966:0:90739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777db2d4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758334.007260:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758334.646261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758334.646295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758334.646323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758334.646347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758334.646375:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789888 00000100:00100000:0.0:1782758334.646384:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789888 00000100:00100000:0.0:1782758334.646439:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790016 00000100:00100000:0.0:1782758334.646442:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790016 00000100:00100000:0.0:1782758334.646469:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1315 00000100:00100000:0.0:1782758334.646479:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196789888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758334.646551:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196789888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758334.646561:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1315 00000100:00100000:0.0:1782758334.646578:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1316 00000100:00100000:0.0:1782758334.646584:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196790016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758334.646608:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196790016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758334.646615:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1316 00000100:00100000:0.0:1782758334.646635:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789760 00000100:00100000:0.0:1782758334.646639:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789760 00000100:00100000:0.0:1782758334.646667:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1713 00000100:00100000:0.0:1782758334.646674:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196789760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758334.646708:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196789760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758334.646714:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1713 00000100:00080000:0.0:1782758334.646734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758334.646739:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758334.646742:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758334.649078:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196789632 00000100:00100000:3.0:1782758334.649092:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196789632 00000100:00100000:3.0:1782758334.649147:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1326 00000100:00100000:3.0:1782758334.649167:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196789632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758334.649234:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196789632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758334.649243:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1326 00010000:00010000:3.0:1782758335.020428:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758335.406775:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211638144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.406860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.406903:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211638656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.406925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.406947:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758335.406952:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211638272:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.406970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.406982:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211638784:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.407004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.407025:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211638400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.407043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.407057:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758335.407061:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211638528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.407082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758335.407111:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638144 00000100:00100000:0.0:1782758335.407118:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638144 00000100:00100000:0.0:1782758335.407169:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1782758335.407178:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211638144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.407231:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211638144:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758335.407239:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1782758335.407272:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638656 00000100:00100000:0.0:1782758335.407276:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638656 00000100:00100000:0.0:1782758335.407308:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638272 00000100:00100000:0.0:1782758335.407311:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638272 00000100:00100000:0.0:1782758335.407329:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638400 00000100:00100000:0.0:1782758335.407331:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638400 00000100:00100000:0.0:1782758335.407349:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1782758335.407354:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.407387:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211638656:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758335.407392:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1782758335.407405:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1782758335.407410:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211638272:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758335.407655:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758335.407671:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638784 00000100:00100000:2.0:1782758335.407675:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638784 00000100:00100000:2.0:1782758335.407724:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638528 00000100:00100000:2.0:1782758335.407727:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638528 00000100:00100000:2.0:1782758335.407762:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1782758335.407770:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758335.407807:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211638784:12345-0@lo:400:kworker.0 Request processed in 39us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758335.407813:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1782758335.407841:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1782758335.407847:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211638528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758335.407881:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211638528:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758335.407887:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1782758335.407905:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1782758335.407911:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211638400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758335.407941:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211638400:12345-0@lo:400:kworker.0 Request processed in 30us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758335.407947:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00080000:2.0:1782758335.407972:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758335.407975:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1782758335.407987:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758335.407990:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758335.407994:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758335.408029:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408040:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408050:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758335.408070:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211638912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758335.408098:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758335.408122:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782758335.408135:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211638912 00000100:00100000:2.0:1782758335.408147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211638912 00000100:00100000:2.0:1782758335.408171:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1782758335.408178:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211638912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758335.408186:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758335.408200:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db2db expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408222:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408233:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408241:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758335.408268:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211638912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758335.408274:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1782758335.408310:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211638912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758335.408323:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408332:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758335.408349:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758335.408354:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758335.408360:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758335.408792:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211638272:12345-0@lo:400:kworker.0 Request processed in 1322us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758335.408800:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1782758335.408866:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211638272:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.408878:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211638784:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.408887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211638144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.408896:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211638656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.408946:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211638528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.408957:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211638400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758335.916257:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758335.916333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758335.916453:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639040 00000100:00100000:3.0:1782758335.916461:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639040 00000100:00100000:3.0:1782758335.916520:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:3.0:1782758335.916529:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758335.916569:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758335.916629:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758335.916636:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1782758335.916716:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758336.044077:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758336.705587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758336.705641:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790144 00000100:00100000:3.0:1782758336.705654:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790144 00000100:00100000:3.0:1782758336.705733:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1014 00000100:00100000:3.0:1782758336.705746:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53409:x1869355196790144:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758336.705774:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758336.705805:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db2e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c51 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706260:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706277:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706294:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706314:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706322:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.706329:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782758336.707319:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758336.708011:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708031:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708045:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758336.708158:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758336.708163:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758336.708251:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708267:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708274:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708283:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708295:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758336.708300:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708308:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708321:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758336.708324:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758336.708329:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708335:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db2f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708348:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708354:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708361:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708374:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758336.708376:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708382:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708394:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75a00) 00010000:00010000:3.0:1782758336.708396:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758336.708399:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708405:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db2f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708449:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db2e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c51 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708470:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c51 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758336.708478:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782758336.708481:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758336.708483:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782758336.708581:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53409:x1869355196790144:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2835us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758336.708593:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1014 00010000:00010000:3.0:1782758337.074687:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758338.092105:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758338.476174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758338.476383:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758338.476490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758338.477019:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639168 00000100:00100000:2.0:1782758338.477033:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639168 00000100:00100000:2.0:1782758338.477130:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1782758338.477143:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758338.477197:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758338.477272:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758338.477279:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1782758338.477340:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758338.479191:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1782758338.600534:0:90984:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4038b3b0 20000000:00000080:3.0:1782758338.600691:0:90984:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbc2a400 uarg=0000000000000000 00010000:00010000:3.0:1782758338.601681:0:90984:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758338.601729:0:90984:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782758338.601734:0:90984:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758338.601748:0:90984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db2fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c51 expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.601776:0:90984:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758338.601796:0:90984:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758338.601814:0:90984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.601855:0:90984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.601865:0:90984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.601914:0:90984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.601930:0:90984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 18 pid: 5796 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758338.601948:0:90984:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90984:1869355211639296:0@lo:104: 00000100:00100000:3.0:1782758338.602036:0:90984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758338.602108:0:90984:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059a900 going to sleep for 11 seconds 00000100:00100000:0.0:1782758338.602220:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782758338.602237:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639296 00000100:00100000:0.0:1782758338.602245:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639296 00000100:00100000:0.0:1782758338.602302:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1782758338.602316:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bba94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90984:x1869355211639296:12345-0@lo:104: 00010000:00010000:0.0:1782758338.602334:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758338.602419:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758338.602427:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bba94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:90984:x1869355211639296:12345-0@lo:104: Request processed in 116us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758338.602435:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782758338.602446:0:90984:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90984:1869355211639296:0@lo:104: 00010000:00010000:3.0:1782758338.602468:0:90984:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602536:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758338.602816:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602855:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758338.602860:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602869:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758338.602876:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758338.602883:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758338.602924:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602931:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758338.602955:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602962:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777db2db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db2e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758338.602980:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758338.602983:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758338.602984:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758338.603617:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211639424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758338.603684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758338.603991:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639424 00000100:00100000:3.0:1782758338.604002:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639424 00010000:00010000:3.0:1782758338.604041:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758338.604091:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1782758338.604101:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211639424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758338.604119:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758338.604125:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604138:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604156:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777db2e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db2db expref: 19 pid: 5796 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604175:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604185:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604202:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604210:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604218:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604225:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604232:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758338.604237:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.604246:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758338.618899:0:90984:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758338.618926:0:90984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.619216:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.619230:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777db305 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758338.619255:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758338.619377:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211639424:12345-0@lo:103:ldlm_bl.0 Request processed in 15271us (15687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758338.619389:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1782758338.619559:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211639424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758339.116990:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758339.775629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758339.775674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758339.775709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758339.775740:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790656 00000100:00100000:0.0:1782758339.775743:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790400 00000100:00100000:1.0:1782758339.775749:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790656 00000100:00100000:0.0:1782758339.775749:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790400 00000100:00100000:3.0:1782758339.775796:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790272 00000100:00100000:3.0:1782758339.775800:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790272 00000100:00100000:0.0:1782758339.775819:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1717 00000100:00100000:3.0:1782758339.775845:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1329 00000100:00100000:0.0:1782758339.775846:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196790400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758339.775852:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196790272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758339.775913:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196790272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758339.775913:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196790400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758339.775922:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1329 00000100:00100000:0.0:1782758339.775922:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1717 00000100:00100000:3.0:1782758339.781789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758339.781846:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790528 00000100:00100000:3.0:1782758339.781857:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790528 00000100:00100000:1.0:1782758339.782363:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 557 00000100:00100000:1.0:1782758339.783921:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196790656:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1782758339.783956:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db168 00000100:00080000:1.0:1782758339.783966:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917082979800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782758339.784013:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967359 00000100:00100000:1.0:1782758339.784887:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196790656:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 979us (9174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758339.784896:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 557 00010000:00010000:1.0:1782758339.784937:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782758339.786622:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758339.786628:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758339.786632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758339.796646:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1319 00000100:00100000:3.0:1782758339.796668:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196790528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758339.796966:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196790528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 305us (15188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758339.796975:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1319 00010000:00010000:1.0:1782758340.141520:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782758340.523938:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758340.523946:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758340.523952:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758340.524001:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758340.524014:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758340.524027:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758340.524062:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211639552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758340.524134:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758340.524194:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1782758340.524259:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639552 00000100:00100000:1.0:1782758340.524267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639552 00000100:00100000:1.0:1782758340.524326:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1782758340.524336:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211639552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758340.524351:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758340.524365:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db30c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758340.524396:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758340.524407:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758340.524416:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758340.524471:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211639552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758340.524477:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1782758340.524626:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211639552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758340.524642:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758340.524652:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758340.524671:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758340.524676:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758340.524684:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758340.525787:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211639680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.525857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758340.525883:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211640192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.525909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758340.525930:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758340.525935:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211640064:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.525956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758340.525982:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211639808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758340.526022:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758340.526028:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758340.526093:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639680 00000100:00100000:2.0:1782758340.526099:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639680 00000100:00100000:2.0:1782758340.526140:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640064 00000100:00100000:2.0:1782758340.526143:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640064 00000100:00100000:1.0:1782758340.526157:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640192 00000100:00100000:1.0:1782758340.526161:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640192 00000100:00100000:2.0:1782758340.526168:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639808 00000100:00100000:2.0:1782758340.526170:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639808 00000100:00100000:2.0:1782758340.526183:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1782758340.526185:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211639936 00000100:00100000:1.0:1782758340.526187:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211639936 00000100:00100000:2.0:1782758340.526189:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211639680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758340.526204:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1782758340.526210:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211640192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211639680:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758340.526237:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1782758340.526238:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211640192:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758340.526243:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1782758340.526253:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:1.0:1782758340.526255:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1782758340.526259:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211640064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758340.526259:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526283:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211640064:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758340.526286:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211639936:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758340.526289:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:1.0:1782758340.526291:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1782758340.526300:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:2.0:1782758340.526306:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211639808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758340.526324:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211639936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526329:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211639808:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758340.526334:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1782758340.526334:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211639808:0@lo:400:kworker.0 00000100:00080000:2.0:1782758340.526352:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758340.526356:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758340.526358:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758340.526377:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211640064:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526386:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211639680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758340.526393:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211640192:0@lo:400:kworker.0 00000100:00100000:1.0:1782758341.037085:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211640320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758341.037164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758341.037238:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640320 00000100:00100000:1.0:1782758341.037247:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640320 00000100:00100000:1.0:1782758341.037299:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1782758341.037308:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211640320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758341.037350:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758341.037395:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211640320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758341.037402:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1782758341.037748:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211640320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758341.166238:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758341.792994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758341.793038:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196790784 00000100:00100000:3.0:1782758341.793047:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196790784 00000100:00100000:3.0:1782758341.793107:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1015 00000100:00100000:3.0:1782758341.793116:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53496:x1869355196790784:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758341.793138:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758341.793160:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db31a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c58 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.793227:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.793242:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.793255:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758341.794928:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758341.794938:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758341.795055:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.795099:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c58 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.795124:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c58 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758341.795133:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75100) 00010000:00010000:3.0:1782758341.795136:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758341.795140:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758341.795217:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53496:x1869355196790784:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2101us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758341.795227:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1015 00000100:00080000:3.0:1782758341.795265:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758341.801002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758341.805317:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791040 00000100:00100000:2.0:1782758341.805341:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791040 00000100:00100000:2.0:1782758341.805408:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1016 00000100:00100000:2.0:1782758341.805420:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53496:x1869355196791040:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758341.805473:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758341.805505:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c58 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.805525:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db2fe) 00010000:00010000:2.0:1782758341.805529:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782758341.805542:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758341.805571:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.805584:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.805594:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758341.811539:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003175b3e2 reply state 000000006ecc2b49 transno 4294967691 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758341.811560:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758341.811739:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000100:00100000:2.0:1782758341.811878:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53496:x1869355196791040:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 6456us (10883us total) trans 4294967691 rc 0/0 00000100:00100000:2.0:1782758341.811887:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1016 00010000:00010000:2.0:1782758341.814761:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814779:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814792:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814799:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758341.814804:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814812:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814924:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782758341.814928:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758341.814933:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758341.814940:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777db328 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.189004:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758342.581205:0:91180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa19eff90 20000000:00000080:1.0:1782758342.581222:0:91180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5bc00 uarg=0000000000000000 00010000:00010000:1.0:1782758342.582292:0:91180:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758342.582311:0:91180:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758342.582335:0:91180:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758342.582352:0:91180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.582370:0:91180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.582379:0:91180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.582417:0:91180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.582431:0:91180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 18 pid: 5794 timeout: 2510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758342.582445:0:91180:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91180:1869355211640448:0@lo:104: 00000100:00100000:1.0:1782758342.582511:0:91180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758342.582563:0:91180:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a9347840 going to sleep for 11 seconds 00000100:00100000:3.0:1782758342.582692:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640448 00000100:00100000:3.0:1782758342.582699:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640448 00000100:00100000:3.0:1782758342.582739:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782758342.582747:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:91180:x1869355211640448:12345-0@lo:104: 00010000:00010000:3.0:1782758342.582760:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582806:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758342.582812:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:91180:x1869355211640448:12345-0@lo:104: Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758342.582819:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:3.0:1782758342.582869:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758342.582876:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582884:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758342.582888:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582896:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758342.582904:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758342.582910:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758342.582944:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582951:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758342.582971:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582979:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777db30c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.582995:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758342.583006:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758342.583008:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758342.583015:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758342.583025:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211640576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758342.583056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758342.583086:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640576 00000100:00100000:3.0:1782758342.583090:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640576 00010000:00010000:3.0:1782758342.583106:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 19 pid: 5794 timeout: 2510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758342.583128:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1782758342.583133:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211640576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758342.583142:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758342.583147:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 19 pid: 5794 timeout: 2510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583157:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 19 pid: 5794 timeout: 2510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583173:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583194:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583207:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583214:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583221:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583227:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583232:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758342.583236:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583242:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583249:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758342.583259:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758342.583285:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211640576:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758342.583292:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1782758342.583330:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211640576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758342.584159:0:91180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db313 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db30c expref: 18 pid: 5794 timeout: 2510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758342.584172:0:91180:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083658a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91180:1869355211640448:0@lo:104: 00010000:00010000:1.0:1782758342.584188:0:91180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.584197:0:91180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.584202:0:91180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758342.584209:0:91180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db32f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758342.694640:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967691 is committed 00000001:00100000:3.0:1782758343.129442:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758343.129450:0:7507:0:(genops.c:906:class_export_put()) final put ffff91708297b000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758343.129475:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff91708297b000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:3.0:1782758343.129524:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082979800 for lustre-OST0001 00010000:00010000:3.0:1782758343.213223:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758343.596661:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211640704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758343.596744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758343.596912:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640704 00000100:00100000:0.0:1782758343.596922:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640704 00000100:00100000:0.0:1782758343.597106:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1782758343.597118:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211640704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758343.597162:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758343.609261:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211640704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12134us (12506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758343.609277:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:0.0:1782758343.609346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758343.611220:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211640704:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782758343.660962:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758343.660970:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758343.660975:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758343.661036:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758343.661049:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758343.661059:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758343.661086:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211640832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758343.661154:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758343.661199:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc269c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758343.662654:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640832 00000100:00100000:0.0:1782758343.662666:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640832 00000100:00100000:0.0:1782758343.662716:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1782758343.662726:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211640832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758343.662743:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758343.662758:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db336 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758343.662795:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758343.662808:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758343.662817:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782758343.662898:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211640832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758343.662904:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1782758343.662960:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211640832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758343.662988:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758343.662998:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758343.663018:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758343.663024:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758343.663031:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758344.236291:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758344.884438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758344.884484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758344.884521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758344.884541:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791424 00000100:00100000:1.0:1782758344.884553:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791424 00000100:00100000:1.0:1782758344.884631:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:1.0:1782758344.884644:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196791424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758344.884655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791296 00000100:00100000:0.0:1782758344.884659:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791296 00000100:00100000:0.0:1782758344.884695:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1721 00000100:00100000:0.0:1782758344.884701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196791296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782758344.885110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758344.885116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758344.885166:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196791296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 462us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758344.885176:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1721 00000100:00100000:3.0:1782758344.885244:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791168 00000100:00100000:3.0:1782758344.885249:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791168 00000100:00100000:3.0:1782758344.885295:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1332 00000100:00100000:3.0:1782758344.885303:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196791168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758344.885414:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196791424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 774us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758344.885421:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:3.0:1782758344.886139:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196791168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 834us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758344.886150:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1332 00010000:00010000:3.0:1782758345.262818:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758345.460755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.461000:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791552 00000100:00100000:0.0:1782758345.461010:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791552 00000100:00100000:0.0:1782758345.461817:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1017 00000100:00100000:0.0:1782758345.461912:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196791552:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758345.462049:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196791552:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 140us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.462057:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1017 00000100:00100000:1.0:1782758345.470472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.472703:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791680 00000100:00100000:0.0:1782758345.472717:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791680 00000100:00100000:0.0:1782758345.472798:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:0.0:1782758345.472809:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196791680:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758345.473716:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196791680:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 422us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.473728:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:3.0:1782758345.476200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758345.476300:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791808 00000100:00100000:1.0:1782758345.476310:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791808 00000100:00100000:1.0:1782758345.476601:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 559 00000100:00100000:1.0:1782758345.476612:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196791808:12345-192.168.204.31@tcp:8:lfs.60003 00010000:00080000:1.0:1782758345.476644:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2413 last 0 00000020:00000080:1.0:1782758345.476684:0:6597:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db344 00002000:00100000:1.0:1782758345.476695:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917084d25800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782758345.476715:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782758345.477145:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782758345.477172:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917084d27800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758345.477235:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196791808:12345-192.168.204.31@tcp:8:lfs.60003 Request processed in 623us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758345.477241:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 559 00000100:00100000:1.0:1782758345.480354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.481355:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196791936 00000100:00100000:0.0:1782758345.481369:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196791936 00000100:00100000:0.0:1782758345.481455:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 560 00000100:00100000:0.0:1782758345.481466:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53581:x1869355196791936:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:1.0:1782758345.481471:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758345.481841:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53581:x1869355196791936:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 360us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.481851:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 560 00000100:00100000:3.0:1782758345.484806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.485358:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792064 00000100:00100000:0.0:1782758345.485369:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792064 00000100:00100000:0.0:1782758345.485433:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1018 00000100:00100000:0.0:1782758345.485443:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792064:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758345.485910:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792064:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 467us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.485918:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1018 00000100:00100000:3.0:1782758345.494536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.494672:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792192 00000100:00100000:0.0:1782758345.494684:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792192 00000100:00100000:0.0:1782758345.494740:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1019 00000100:00100000:0.0:1782758345.494750:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792192:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758345.494869:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792192:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.494881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1019 00000100:00100000:1.0:1782758345.500044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758345.500374:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792320 00000100:00100000:3.0:1782758345.500387:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792320 00000100:00100000:3.0:1782758345.500498:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 561 00000100:00100000:3.0:1782758345.500509:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792320:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758345.500988:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792320:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 479us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758345.500998:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 561 00000100:00100000:3.0:1782758345.508122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758345.508157:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792448 00000100:00100000:3.0:1782758345.508166:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792448 00000100:00100000:3.0:1782758345.508217:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:3.0:1782758345.508241:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53581:x1869355196792448:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758345.508915:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53581:x1869355196792448:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 686us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758345.508925:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:3.0:1782758345.513807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758345.513867:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792576 00000100:00100000:3.0:1782758345.513876:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792576 00000100:00100000:3.0:1782758345.517126:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:3.0:1782758345.517148:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792576:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758345.517611:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53581:x1869355196792576:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 469us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758345.517619:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:0.0:1782758345.598713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758345.598816:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792704 00000100:00100000:3.0:1782758345.598856:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792704 00000100:00100000:3.0:1782758345.598903:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1021 00000100:00100000:3.0:1782758345.598912:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53585:x1869355196792704:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:3.0:1782758345.598931:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758345.598964:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db34b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c5f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599030:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599043:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599055:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599066:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599073:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599080:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599668:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599679:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758345.599687:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758345.599759:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1782758345.599763:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758345.601245:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601322:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601330:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601338:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601344:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758345.601348:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601355:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601369:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782758345.601548:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758345.601553:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601559:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601574:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601579:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601585:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601590:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758345.601592:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601601:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601610:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75700) 00010000:00010000:2.0:1782758345.601612:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758345.601615:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601620:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db359 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601660:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db34b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c5f expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601677:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c5f expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758345.601684:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75500) 00010000:00010000:2.0:1782758345.601686:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758345.601689:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:2.0:1782758345.601935:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53585:x1869355196792704:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 3022us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758345.601955:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1021 00000100:00100000:3.0:1782758345.607584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758345.608213:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196792960 00000100:00100000:1.0:1782758345.608234:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196792960 00000100:00100000:1.0:1782758345.608316:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1022 00000100:00100000:1.0:1782758345.608328:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53585:x1869355196792960:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:1.0:1782758345.608350:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758345.608372:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db367 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c66 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608711:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608739:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608751:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608767:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608774:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.608780:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758345.609931:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:1.0:1782758345.610241:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db37c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610552:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db37c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610570:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db37c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610612:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610618:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610624:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610630:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758345.610634:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610642:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610654:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75500) 00010000:00010000:1.0:1782758345.610657:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758345.610661:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610667:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db36e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758345.610679:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001383f239 reply state 00000000ef27dfe9 transno 4294967692 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758345.610688:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758345.610721:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c66 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610734:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db37c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c66 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.610740:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758345.610743:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758345.610745:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758345.610965:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53585:x1869355196792960:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 2638us (3389us total) trans 4294967692 rc 0/0 00000100:00100000:1.0:1782758345.610974:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1022 00010000:00010000:0.0:1782758345.615482:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615500:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615508:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615515:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758345.615519:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615527:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615545:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3a200) 00010000:00010000:0.0:1782758345.615548:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758345.615552:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758345.615558:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db375 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758345.621797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758345.621999:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793088 00000100:00100000:1.0:1782758345.622010:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793088 00000100:00100000:1.0:1782758345.622067:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:1.0:1782758345.622078:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53585:x1869355196793088:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:1.0:1782758345.622097:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758345.622120:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c6d expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758345.622152:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782758345.622176:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=2414s v=(0 0) 00010000:00010000:1.0:1782758345.622181:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758345.622191:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.622212:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758345.622225:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758345.622473:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53585:x1869355196793088:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 395us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758345.622480:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:0.0:1782758345.644463:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211641216:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.644538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758345.644605:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758345.644612:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211641088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.644636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758345.644654:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211641600:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.644679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758345.644713:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641216 00000100:00100000:0.0:1782758345.644720:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641216 00000100:00100000:0.0:1782758345.644775:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641088 00000100:00100000:0.0:1782758345.644779:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641088 00000100:00100000:0.0:1782758345.644800:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1782758345.644808:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.644884:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211641216:12345-0@lo:400:kworker.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.644891:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1782758345.644908:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1782758345.644915:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211641088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.644957:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211641088:12345-0@lo:400:kworker.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.644964:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00080000:0.0:1782758345.644980:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758345.645009:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211641088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.645021:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211641216:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.645045:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641600 00000100:00100000:0.0:1782758345.645049:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641600 00000100:00100000:0.0:1782758345.645082:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1782758345.645088:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211641600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.645125:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211641600:12345-0@lo:400:kworker.0 Request processed in 37us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758345.645132:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00080000:0.0:1782758345.645145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758345.645161:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211641600:0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646440:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211640960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758345.646544:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211641472:0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758345.646593:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758345.646600:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211641344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758345.646651:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641344 00000100:00100000:1.0:1782758345.646657:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641344 00000100:00100000:1.0:1782758345.646699:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1782758345.646708:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211641344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646756:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211641344:12345-0@lo:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758345.646764:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:1.0:1782758345.646785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758345.646808:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211641344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646852:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641472 00000100:00100000:1.0:1782758345.646855:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641472 00000100:00100000:1.0:1782758345.646888:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:1.0:1782758345.646894:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211641472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758345.646929:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211641472:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758345.646936:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00080000:1.0:1782758345.646966:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758345.646983:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211641472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758345.647183:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211640960 00000100:00100000:2.0:1782758345.647189:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211640960 00000100:00100000:2.0:1782758345.647226:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1782758345.647234:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211640960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758345.647285:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211640960:12345-0@lo:400:kworker.0 Request processed in 52us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758345.647291:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1782758345.647324:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211640960:0@lo:400:kworker.0 00000100:00100000:0.0:1782758345.671060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758345.671149:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793216 00000100:00100000:1.0:1782758345.671161:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793216 00002000:00100000:1.0:1782758345.671219:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff917187969500 x1869355196793216/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782758356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1782758345.671230:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917187969500 with x1869355196793216 ext(0->1048575) 00002000:00010000:1.0:1782758345.671236:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917187969500 00000100:00100000:1.0:1782758345.671270:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1782758345.671280:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196793216:12345-192.168.204.31@tcp:4:dd.60003 00000001:00100000:2.0:1782758345.761718:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:1.0:1782758345.775881:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196793216:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 104591us (104821us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1782758345.775896:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00002000:00100000:1.0:1782758345.775911:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff917187969500 x1869355196793216/t4294967360(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782758356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1782758345.775923:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917187969500 with x1869355196793216 ext(0->1048575) 00002000:00010000:1.0:1782758345.775930:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff917187969500 00000100:00100000:1.0:1782758345.778044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.778148:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793344 00000100:00100000:0.0:1782758345.778160:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793344 00000100:00100000:0.0:1782758345.778230:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00100000:0.0:1782758345.778240:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:53585:x1869355196793344:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:3.0:1782758345.812473:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967692 is committed 00000100:00100000:2.0:1782758345.812710:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53585:x1869355196793344:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 34464us (34669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758345.812723:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00100000:0.0:1782758345.816399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758345.817663:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793472 00000100:00100000:3.0:1782758345.817674:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793472 00000100:00100000:3.0:1782758345.817734:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 564 00000100:00100000:3.0:1782758345.817744:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196793472:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:2.0:1782758345.888110:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196793472:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 70355us (71710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758345.888125:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 564 00000001:00080000:2.0:1782758345.888167:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000100:00100000:1.0:1782758345.900764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758345.901103:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793728 00000100:00100000:0.0:1782758345.901114:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793728 00000100:00100000:0.0:1782758345.901178:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:0.0:1782758345.901188:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53585:x1869355196793728:12345-192.168.204.31@tcp:35:dd.60003 00000001:00080000:0.0:1782758345.901613:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967693 00000100:00100000:0.0:1782758345.901745:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:53585:x1869355196793728:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 554us (986us total) trans 4294967694 rc 0/0 00000100:00100000:0.0:1782758345.901754:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 103 00000020:00080000:0.0:1782758345.901760:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782758346.157146:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211641728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758346.157224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758346.157356:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641728 00000100:00100000:1.0:1782758346.157365:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641728 00000100:00100000:1.0:1782758346.157425:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1782758346.157435:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211641728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758346.157460:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1782758346.157520:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211641728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758346.157528:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1782758346.157609:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211641728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758346.283994:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758347.052974:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967694 is committed 00010000:00010000:3.0:1782758347.308094:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758348.332012:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758348.437084:0:91428:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2416840258419ns, next at 2396312805177ns, rc = 0 00000004:00080000:0.0:1782758348.437239:0:91428:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2416840415680ns, next at 2366797039539ns, rc = 0 00000004:00080000:3.0:1782758348.443433:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:3.0:1782758348.443467:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00000100:00100000:0.0:1782758348.716915:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758348.716939:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211641856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758348.717012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758348.717092:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641856 00000100:00100000:0.0:1782758348.717100:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641856 00000100:00100000:0.0:1782758348.717161:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1782758348.717322:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211641856:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758348.717418:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782758348.717485:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758348.717543:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211641856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 373us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758348.717550:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1782758348.717695:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211641856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758349.356080:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758349.834623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758349.834723:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793856 00000100:00100000:0.0:1782758349.834734:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793856 00000100:00100000:0.0:1782758349.834887:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00100000:0.0:1782758349.834897:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196793856:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758349.834998:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196793856:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758349.835007:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00080000:2.0:1782758349.835067:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758349.843200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758349.843921:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196793984 00000100:00100000:1.0:1782758349.843931:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196793984 00000100:00100000:1.0:1782758349.845236:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:1.0:1782758349.845250:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53777:x1869355196793984:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:3.0:1782758349.845278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758349.845649:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53777:x1869355196793984:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 402us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758349.845658:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:0.0:1782758349.857794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758349.857916:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794112 00000100:00100000:3.0:1782758349.857927:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794112 00000100:00100000:3.0:1782758349.858034:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:3.0:1782758349.858046:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53777:x1869355196794112:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758349.858458:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53777:x1869355196794112:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 413us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758349.858467:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00080000:0.0:1782758349.859004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758349.872142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758349.872218:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794240 00000100:00100000:2.0:1782758349.872230:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794240 00000100:00100000:2.0:1782758349.872308:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1025 00000100:00100000:2.0:1782758349.872318:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794240:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758349.872726:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794240:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 396us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758349.872735:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1025 00000100:00100000:2.0:1782758349.877410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758349.877514:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794368 00000100:00100000:0.0:1782758349.877525:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794368 00000100:00100000:0.0:1782758349.877586:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00100000:0.0:1782758349.877598:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794368:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758349.877930:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794368:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 333us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758349.877939:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00100000:1.0:1782758349.887931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758349.887978:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794496 00000100:00100000:1.0:1782758349.887989:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794496 00000100:00100000:1.0:1782758349.888052:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:1.0:1782758349.888062:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53777:x1869355196794496:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758349.888846:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53777:x1869355196794496:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 440us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758349.888866:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:2.0:1782758349.894959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758349.895088:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794624 00000100:00100000:0.0:1782758349.895098:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794624 00000100:00100000:0.0:1782758349.895390:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:0.0:1782758349.895404:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53777:x1869355196794624:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758349.895881:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53777:x1869355196794624:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 480us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758349.895890:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:1.0:1782758349.901974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758349.902068:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196794752 00000100:00100000:2.0:1782758349.902078:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196794752 00000100:00100000:2.0:1782758349.902135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00100000:2.0:1782758349.902145:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794752:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758349.902884:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53777:x1869355196794752:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 738us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758349.902893:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00100000:2.0:1782758349.982287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758349.982417:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795008 00000100:00100000:1.0:1782758349.982433:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795008 00000100:00100000:1.0:1782758349.982521:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:1.0:1782758349.982535:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:53781:x1869355196795008:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:1.0:1782758349.982613:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758349.982644:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db37c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c66 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982666:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758349.982678:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758349.982705:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982719:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982728:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982743:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982749:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758349.982755:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.983389:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.983400:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.983409:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758349.986320:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:0.0:1782758349.986341:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2418389517839ns, next at 2419389514499ns, rc = 0 00010000:00010000:0.0:1782758349.986477:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986492:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986503:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986512:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986518:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986524:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986553:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758349.986577:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986584:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986591:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986597:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758349.986601:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986607:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758349.986609:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986616:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986623:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:0.0:1782758349.986628:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758349.986632:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986633:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758349.986640:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986642:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db39f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986655:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986668:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986670:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff91718bcfde00) 00010000:00010000:3.0:1782758349.986677:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758349.986681:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986683:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986701:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db3a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986704:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986715:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758349.986718:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986724:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758349.986725:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758349.986727:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758349.986731:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758349.986737:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75500) 00010000:00010000:0.0:1782758349.986741:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758349.986745:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758349.986750:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758349.986761:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011435a41 reply state 0000000000fe7394 transno 4294967695 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758349.986771:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758349.986887:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:53781:x1869355196795008:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 4349us (4610us total) trans 4294967695 rc 0/0 00000100:00100000:0.0:1782758349.986897:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1028 00010000:00010000:2.0:1782758349.990516:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990533:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990552:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990559:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758349.990565:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990572:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990598:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9171a0e3aa00) 00010000:00010000:2.0:1782758349.990601:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758349.990606:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758349.990613:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db398 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758350.017964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758350.018116:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795136 00000100:00100000:3.0:1782758350.018130:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795136 00000100:00100000:3.0:1782758350.018195:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1334 00000100:00100000:3.0:1782758350.018206:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196795136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758350.018296:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196795136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758350.018304:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1334 00010000:00010000:3.0:1782758350.380097:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758350.767817:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211642368:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.767922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.767978:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758350.767984:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211641984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.768037:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211642496:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.768091:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211642112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.768131:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211642624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.768180:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758350.768186:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211642240:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758350.768238:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642368 00000100:00100000:2.0:1782758350.768245:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642368 00000100:00100000:2.0:1782758350.768292:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642624 00000100:00100000:2.0:1782758350.768295:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642624 00000100:00100000:2.0:1782758350.768318:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1782758350.768328:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211642368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768382:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211642368:12345-0@lo:400:kworker.0 Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.768389:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1782758350.768405:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1782758350.768412:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211642624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768444:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211642624:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.768451:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1782758350.768469:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211641984 00000100:00100000:2.0:1782758350.768473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211641984 00000100:00100000:2.0:1782758350.768503:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1782758350.768510:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768538:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211641984:12345-0@lo:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.768544:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1782758350.768569:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642496 00000100:00100000:2.0:1782758350.768572:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642496 00000100:00100000:2.0:1782758350.768596:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642112 00000100:00100000:2.0:1782758350.768599:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642112 00000100:00100000:2.0:1782758350.768611:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642240 00000100:00100000:2.0:1782758350.768613:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642240 00000100:00100000:2.0:1782758350.768625:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1782758350.768630:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211642496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768657:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211642496:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.768663:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1782758350.768674:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:2.0:1782758350.768680:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211642112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.768706:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211642112:12345-0@lo:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.768711:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:2.0:1782758350.768721:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:2.0:1782758350.768726:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211642240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769136:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211642240:12345-0@lo:400:kworker.0 Request processed in 408us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758350.769142:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00080000:2.0:1782758350.769181:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758350.769186:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758350.769188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758350.769224:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211642240:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769236:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211642112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769247:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211642624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769280:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211641984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769290:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211642496:0@lo:400:kworker.0 00000100:00100000:2.0:1782758350.769298:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211642368:0@lo:400:kworker.0 00000004:00080000:2.0:1782758351.279398:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2419682572869ns, next at 2420682570956ns, rc = 0 00000100:00100000:2.0:1782758351.279430:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758351.279450:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211642752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758351.279517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758351.279685:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642752 00000100:00100000:1.0:1782758351.279693:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642752 00000100:00100000:1.0:1782758351.279746:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1782758351.279757:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211642752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758351.279797:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782758351.279895:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211642752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758351.279904:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1782758351.280004:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211642752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758351.404079:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758352.232552:0:91573:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2420635725334ns, next at 2396312805177ns, rc = 0 00000004:00080000:2.0:1782758352.233459:0:91573:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2420636634791ns, next at 2420682570956ns, rc = 0 00000001:00080000:3.0:1782758352.291493:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967695 is committed 00000004:00080000:3.0:1782758352.291512:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000004:00080000:3.0:1782758352.291579:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000100:00100000:2.0:1782758352.291989:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211642880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758352.292090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758352.292380:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211642880 00000100:00100000:1.0:1782758352.292390:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211642880 00000100:00100000:1.0:1782758352.292477:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1782758352.292491:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211642880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782758352.292529:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:1.0:1782758352.292562:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758352.292600:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758352.292619:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782758352.292625:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758352.292630:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758352.292665:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758352.292680:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 5 pid: 6597 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758352.292694:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211643008:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758352.292773:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f240 going to sleep for 11 seconds 00000100:00080000:0.0:1782758352.293415:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1782758352.293727:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000004:00080000:3.0:1782758352.293756:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000100:00100000:2.0:1782758352.303933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758352.303933:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211643008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782758352.303972:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758352.304098:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795264 00000100:00100000:3.0:1782758352.304109:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795264 00010000:00010000:3.0:1782758352.304183:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 6 pid: 6597 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782758352.304328:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758352.304347:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 419 00000100:00100000:3.0:1782758352.304359:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196795264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758352.304380:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758352.304387:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 6 pid: 6597 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.304403:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 6 pid: 6597 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.304436:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012b1a8c8/0xdd99f5c4777db38a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c6d expref: 6 pid: 6597 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.304457:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758352.304461:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758352.304467:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.304478:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.304513:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758352.304577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196795264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 219us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758352.304586:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 419 00010000:00010000:2.0:1782758352.304659:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758352.304669:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758352.304682:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758352.304692:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758352.304719:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758352.305048:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758352.305056:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.305065:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758352.305069:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.305079:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.305095:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.305103:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ae12c3d/0xdd99f5c4777db3ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758352.305126:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758352.305129:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758352.305130:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758352.306876:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211642880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14383us (14780us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1782758352.306891:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000004:00080000:0.0:1782758352.311852:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917187968000/2, rc 0, transno 4294967361 00000100:00100000:0.0:1782758352.311887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211642880:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782758352.428985:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758353.453476:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758353.838041:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758353.838066:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211643136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758353.838138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758353.838286:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643136 00000100:00100000:0.0:1782758353.838295:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643136 00000100:00100000:0.0:1782758353.838363:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1782758353.838375:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211643136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758353.838409:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758353.838465:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211643136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758353.838472:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1782758353.838522:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211643136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758353.838559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758354.479396:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758354.921166:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00000100:00100000:1.0:1782758355.126048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758355.126132:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795392 00000100:00100000:2.0:1782758355.126144:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795392 00000100:00100000:2.0:1782758355.126215:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000100:00100000:2.0:1782758355.126226:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196795392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758355.126302:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196795392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.126309:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000100:00100000:2.0:1782758355.126357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758355.126468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758355.126493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758355.126513:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795520 00000100:00100000:2.0:1782758355.126516:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795520 00000100:00100000:2.0:1782758355.126549:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1728 00000100:00100000:2.0:1782758355.126555:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196795520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758355.126591:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196795520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.126597:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1728 00000100:00100000:2.0:1782758355.126614:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795648 00000100:00100000:2.0:1782758355.126617:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795648 00000100:00100000:2.0:1782758355.126640:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795776 00000100:00100000:2.0:1782758355.126643:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795776 00000100:00100000:2.0:1782758355.126661:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1327 00000100:00100000:2.0:1782758355.126666:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196795648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758355.126691:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196795648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.126698:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1327 00000100:00100000:2.0:1782758355.126709:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1328 00000100:00100000:2.0:1782758355.126715:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196795776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758355.126737:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196795776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.126743:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1328 00000100:00080000:3.0:1782758355.127233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758355.127237:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758355.127240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758355.507270:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758355.884344:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211643648:0@lo:400:kworker.0 00000100:00100000:2.0:1782758355.884422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758355.884491:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758355.884498:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211643520:0@lo:400:kworker.0 00000100:00100000:2.0:1782758355.884528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758355.884565:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643648 00000100:00100000:2.0:1782758355.884572:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643648 00000100:00100000:2.0:1782758355.884885:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1782758355.884895:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211643648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758355.885021:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211643648:12345-0@lo:400:kworker.0 Request processed in 127us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.885028:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1782758355.885175:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643520 00000100:00100000:2.0:1782758355.885180:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643520 00000100:00100000:2.0:1782758355.885208:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:2.0:1782758355.885214:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211643520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758355.885243:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211643520:12345-0@lo:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758355.885248:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00080000:2.0:1782758355.885264:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758355.885268:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758355.885299:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211643520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885600:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211643392:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758355.885665:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211643904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758355.885705:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758355.885711:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211643264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758355.885771:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211643776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758355.885817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643392 00000100:00100000:0.0:1782758355.885836:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643392 00000100:00100000:0.0:1782758355.885862:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643776 00000100:00100000:0.0:1782758355.885864:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643776 00000100:00100000:0.0:1782758355.885889:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1782758355.885896:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211643392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885932:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211643392:12345-0@lo:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758355.885939:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1782758355.885965:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:0.0:1782758355.885970:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211643776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.885998:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211643776:12345-0@lo:400:kworker.0 Request processed in 28us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758355.886003:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:0.0:1782758355.886020:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643904 00000100:00100000:0.0:1782758355.886023:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643904 00000100:00100000:0.0:1782758355.886049:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1782758355.886055:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211643904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.886086:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211643904:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758355.886092:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1782758355.886110:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211643264 00000100:00100000:0.0:1782758355.886113:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211643264 00000100:00100000:0.0:1782758355.886140:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1782758355.886145:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211643264:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782758355.886159:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758355.886165:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758355.886177:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211643264:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758355.886184:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1782758355.886222:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211643264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.886232:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211643776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.886239:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211643392:0@lo:400:kworker.0 00000100:00100000:0.0:1782758355.886246:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:0.0:1782758355.886251:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917187968000, transno 4294967361 00000100:00100000:0.0:1782758355.886272:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211643904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758355.886768:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211643648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758356.396572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211644032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758356.396656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758356.396927:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644032 00000100:00100000:2.0:1782758356.396944:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644032 00000100:00100000:2.0:1782758356.396994:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1782758356.397003:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211644032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758356.397038:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758356.397099:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211644032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758356.397110:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1782758356.397249:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211644032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758356.524146:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758357.549326:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758358.572136:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758358.956258:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211644160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758358.956347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758358.958301:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644160 00000100:00100000:0.0:1782758358.958315:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644160 00000100:00100000:0.0:1782758358.958398:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1782758358.958412:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211644160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758358.958451:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782758358.958741:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758358.958884:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211644160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 476us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758358.958892:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:3.0:1782758358.958984:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211644160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758359.598440:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758360.245259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758360.245617:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196795904 00000100:00100000:1.0:1782758360.245629:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196795904 00000100:00100000:1.0:1782758360.246281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00100000:1.0:1782758360.246295:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196795904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758360.246391:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196795904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758360.246399:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00100000:1.0:1782758360.251055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758360.251153:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796032 00000100:00100000:2.0:1782758360.251163:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796032 00000100:00100000:2.0:1782758360.251241:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1732 00000100:00100000:2.0:1782758360.251252:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196796032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758360.251345:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196796032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758360.251352:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1732 00000100:00080000:3.0:1782758360.251519:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758360.254173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758360.254217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758360.254298:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796288 00000100:00100000:3.0:1782758360.254307:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796288 00000100:00100000:3.0:1782758360.254489:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796160 00000100:00100000:3.0:1782758360.254494:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796160 00000100:00100000:3.0:1782758360.254524:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1331 00000100:00100000:3.0:1782758360.254533:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196796288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758360.254756:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196796288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 223us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758360.254765:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1331 00000100:00100000:3.0:1782758360.254783:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1332 00000100:00100000:3.0:1782758360.254789:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196796160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758360.254815:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196796160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758360.254858:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1332 00000100:00080000:2.0:1782758360.255216:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758360.255221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782758360.620738:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758361.004093:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211644416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758361.004101:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211644672:0@lo:400:kworker.0 00000100:00100000:1.0:1782758361.004176:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211644544:0@lo:400:kworker.0 00000100:00100000:3.0:1782758361.004207:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211644288:0@lo:400:kworker.0 00000100:00100000:3.0:1782758361.004274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758361.004274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758361.004344:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211644800:0@lo:400:kworker.0 00000100:00100000:3.0:1782758361.004373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758361.004452:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644288 00000100:00100000:2.0:1782758361.004460:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644288 00000100:00100000:2.0:1782758361.004507:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1782758361.004516:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211644288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758361.004566:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211644288:12345-0@lo:400:kworker.0 Request processed in 51us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758361.004574:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1782758361.004607:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644672 00000100:00100000:2.0:1782758361.004610:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644672 00000100:00080000:0.0:1782758361.007208:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758361.009175:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1782758361.009452:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758361.013146:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211644672:12345-0@lo:400:kworker.0 Request processed in 3702us (8875us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758361.013157:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1782758361.013236:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211644672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758361.015236:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211644288:0@lo:400:kworker.0 00000100:00100000:3.0:1782758361.015258:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758361.015270:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211644928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758361.015428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758361.015469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758361.020533:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644928 00000100:00100000:0.0:1782758361.020549:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644928 00000100:00100000:0.0:1782758361.020654:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1782758361.020665:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211644928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758361.020781:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211644928:12345-0@lo:400:kworker.0 Request processed in 118us (5311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758361.020789:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1782758361.020879:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211644928:0@lo:400:kworker.0 00000100:00100000:1.0:1782758361.021774:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644800 00000100:00100000:1.0:1782758361.021783:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644800 00000100:00080000:3.0:1782758361.021944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758361.021949:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758361.027221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758361.033998:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644416 00000100:00100000:1.0:1782758361.034013:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644416 00000100:00100000:1.0:1782758361.034109:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:1.0:1782758361.034131:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211644800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758361.034233:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211644800:12345-0@lo:400:kworker.0 Request processed in 116us (29859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758361.034242:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:1.0:1782758361.034263:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1782758361.034270:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211644416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758361.034308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211644416:12345-0@lo:400:kworker.0 Request processed in 39us (18881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758361.034314:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1782758361.035165:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211644416:0@lo:400:kworker.0 00000100:00100000:1.0:1782758361.035247:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211644800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758361.040961:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211644544 00000100:00100000:0.0:1782758361.040975:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211644544 00000100:00100000:0.0:1782758361.041053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:0.0:1782758361.041062:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211644544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758361.041152:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758361.046799:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211644544:12345-0@lo:400:kworker.0 Request processed in 5725us (19573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758361.046819:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00100000:2.0:1782758361.046977:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211644544:0@lo:400:kworker.0 00000100:00100000:0.0:1782758361.516534:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211645056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758361.516610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758361.516819:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645056 00000100:00100000:2.0:1782758361.516847:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645056 00000100:00100000:2.0:1782758361.516904:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1782758361.516914:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211645056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758361.516951:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758361.517006:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211645056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758361.517013:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1782758361.517103:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211645056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758361.646451:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758362.668137:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758363.693447:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758364.077131:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211645184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758364.077194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758364.077588:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645184 00000100:00100000:0.0:1782758364.077596:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645184 00000100:00100000:0.0:1782758364.077655:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1782758364.077663:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211645184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758364.077698:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758364.077750:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211645184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758364.077756:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1782758364.077913:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211645184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758364.078112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758364.717364:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758365.365895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758365.365951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758365.366053:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796544 00000100:00100000:3.0:1782758365.366062:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796544 00000100:00100000:3.0:1782758365.366140:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1736 00000100:00100000:3.0:1782758365.366152:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196796544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758365.366229:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196796544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758365.366236:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1736 00000100:00080000:0.0:1782758365.366668:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758365.366791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758365.366848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758365.366892:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796416 00000100:00100000:3.0:1782758365.366897:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796416 00000100:00100000:3.0:1782758365.367072:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00100000:3.0:1782758365.367081:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196796416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758365.367124:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196796416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758365.367131:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00100000:2.0:1782758365.372568:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796800 00000100:00100000:2.0:1782758365.372582:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796800 00000100:00100000:2.0:1782758365.372659:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796672 00000100:00100000:2.0:1782758365.372663:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796672 00000100:00100000:2.0:1782758365.372691:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1335 00000100:00100000:2.0:1782758365.372702:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196796800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758365.372784:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196796800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (6832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758365.372792:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1335 00000100:00100000:2.0:1782758365.372809:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000100:00100000:2.0:1782758365.372816:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196796672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758365.372854:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196796672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (6005us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758365.372861:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000100:00080000:1.0:1782758365.374646:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758365.374656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782758365.740608:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758366.127225:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211645312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758366.127375:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211645824:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758366.127432:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758366.127438:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211645440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758366.127475:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211645952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758366.127532:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645824 00000100:00100000:0.0:1782758366.127553:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645824 00000100:00100000:0.0:1782758366.127605:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645440 00000100:00100000:0.0:1782758366.127608:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645440 00000100:00100000:0.0:1782758366.127696:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:0.0:1782758366.127707:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211645824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127759:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211645824:12345-0@lo:400:kworker.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758366.127766:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:0.0:1782758366.127781:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:0.0:1782758366.127787:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211645440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127815:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211645440:12345-0@lo:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758366.127852:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:0.0:1782758366.127890:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211645440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.127901:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211645824:0@lo:400:kworker.0 00000100:00100000:2.0:1782758366.127987:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645952 00000100:00100000:2.0:1782758366.127992:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645952 00000100:00100000:2.0:1782758366.128027:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1782758366.128033:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211645952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758366.128069:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211645952:12345-0@lo:400:kworker.0 Request processed in 36us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758366.128074:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1782758366.128151:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211645568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758366.128183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758366.128216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758366.128222:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211645696:0@lo:400:kworker.0 00000100:00100000:3.0:1782758366.128244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758366.128272:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645568 00000100:00100000:3.0:1782758366.128276:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645568 00000100:00100000:3.0:1782758366.128318:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1782758366.128325:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211645568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758366.128361:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211645568:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758366.128367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1782758366.128397:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211645568:0@lo:400:kworker.0 00000100:00100000:1.0:1782758366.128639:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645312 00000100:00100000:1.0:1782758366.128644:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645312 00000100:00100000:1.0:1782758366.128680:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1782758366.128688:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211645312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758366.128726:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211645312:12345-0@lo:400:kworker.0 Request processed in 39us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758366.128732:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:1.0:1782758366.128766:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758366.128771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758366.128787:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211645696 00000100:00100000:1.0:1782758366.128790:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211645696 00000100:00100000:1.0:1782758366.128816:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1782758366.128846:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211645696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758366.128882:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211645696:12345-0@lo:400:kworker.0 Request processed in 60us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758366.128901:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00080000:1.0:1782758366.128916:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758366.129297:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211645696:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.129491:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211645952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758366.129501:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211645312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758366.636339:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211646080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758366.636418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758366.636558:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646080 00000100:00100000:2.0:1782758366.636568:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646080 00000100:00100000:2.0:1782758366.636622:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1782758366.636631:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211646080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758366.636672:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758366.636734:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211646080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758366.636741:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1782758366.636848:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211646080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758366.764055:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758367.788568:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758367.999206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758367.999486:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196796928 00000100:00100000:3.0:1782758367.999497:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196796928 00000100:00100000:3.0:1782758367.999597:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1029 00000100:00100000:3.0:1782758367.999607:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196796928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758367.999718:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196796928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 112us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758367.999732:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1029 00000100:00080000:1.0:1782758367.999794:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758368.009124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.009274:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797056 00000100:00100000:0.0:1782758368.009285:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797056 00000100:00100000:0.0:1782758368.009362:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 570 00000100:00100000:0.0:1782758368.009372:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797056:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:1.0:1782758368.009652:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758368.010104:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797056:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 732us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.010113:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 570 00000100:00100000:2.0:1782758368.022960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.028758:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797184 00000100:00100000:0.0:1782758368.028774:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797184 00000100:00100000:0.0:1782758368.028929:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:0.0:1782758368.028941:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758368.029377:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 436us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.029385:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00080000:1.0:1782758368.030554:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758368.032968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758368.033077:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797312 00000100:00100000:1.0:1782758368.033088:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797312 00000100:00100000:1.0:1782758368.033157:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000100:00100000:1.0:1782758368.033168:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797312:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758368.033662:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797312:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 495us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758368.033671:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000100:00100000:3.0:1782758368.044488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.048293:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797440 00000100:00100000:0.0:1782758368.048318:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797440 00000100:00100000:0.0:1782758368.048400:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1031 00000100:00100000:0.0:1782758368.048411:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797440:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758368.048544:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797440:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 134us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.048552:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1031 00000100:00100000:3.0:1782758368.051978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758368.052267:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797568 00000100:00100000:2.0:1782758368.052278:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797568 00000100:00100000:2.0:1782758368.052338:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 572 00000100:00100000:2.0:1782758368.052349:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797568:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758368.052735:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797568:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 388us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758368.052743:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 572 00000100:00100000:1.0:1782758368.056766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.056861:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797696 00000100:00100000:0.0:1782758368.056872:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797696 00000100:00100000:0.0:1782758368.056928:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:0.0:1782758368.056939:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797696:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758368.057295:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:53999:x1869355196797696:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 357us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.057303:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:3.0:1782758368.062614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.062747:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797824 00000100:00100000:0.0:1782758368.062765:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797824 00000100:00100000:0.0:1782758368.062886:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1032 00000100:00100000:0.0:1782758368.062897:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797824:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758368.063963:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:53999:x1869355196797824:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1063us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.063973:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1032 00000100:00100000:3.0:1782758368.111957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.112679:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196797952 00000100:00100000:0.0:1782758368.112694:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196797952 00000100:00100000:0.0:1782758368.112761:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1033 00000100:00100000:0.0:1782758368.112772:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54001:x1869355196797952:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758368.112801:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758368.112858:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c74 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.112948:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.112964:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.112978:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758368.113453:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1782758368.113458:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758368.113562:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.113595:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c74 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.113623:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c74 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758368.113633:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75500) 00010000:00010000:0.0:1782758368.113637:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758368.113650:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758368.113728:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54001:x1869355196797952:12345-192.168.204.31@tcp:101:rm.0 Request processed in 957us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.113735:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1033 00000100:00100000:0.0:1782758368.124303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758368.126336:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196798208 00000100:00100000:2.0:1782758368.126356:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196798208 00000100:00100000:2.0:1782758368.126454:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00100000:2.0:1782758368.126468:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54001:x1869355196798208:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758368.126509:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758368.126543:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c7b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758368.126936:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:2.0:1782758368.127212:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db3c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c7b expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758368.127231:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1f00) 00010000:00010000:2.0:1782758368.127234:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782758368.127241:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c7b expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758368.127262:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758368.127364:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54001:x1869355196798208:12345-192.168.204.31@tcp:101:rm.0 Request processed in 898us (3076us total) trans 4294967696 rc 301/301 00000100:00100000:2.0:1782758368.127373:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00100000:3.0:1782758368.136171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758368.136263:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196798336 00000100:00100000:0.0:1782758368.136277:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196798336 00000100:00100000:0.0:1782758368.136349:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:0.0:1782758368.136372:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54001:x1869355196798336:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:0.0:1782758368.148920:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54001:x1869355196798336:12345-192.168.204.31@tcp:37:rm.0 Request processed in 12542us (12743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758368.148939:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:2.0:1782758368.165558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758368.166046:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196798592 00000100:00100000:1.0:1782758368.166060:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196798592 00000100:00100000:1.0:1782758368.166142:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 105 00000100:00100000:1.0:1782758368.166154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54001:x1869355196798592:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:1.0:1782758368.167105:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54001:x1869355196798592:12345-192.168.204.31@tcp:35:rm.0 Request processed in 949us (1560us total) trans 4294967697 rc 0/0 00000100:00100000:1.0:1782758368.167118:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 105 00000100:00100000:0.0:1782758368.186081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758368.188938:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196798848 00000100:00100000:3.0:1782758368.188964:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196798848 00000100:00100000:3.0:1782758368.189061:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1035 00000100:00100000:3.0:1782758368.189075:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54001:x1869355196798848:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758368.189162:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782758368.189198:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db3bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c74 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189228:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c5f expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189239:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dafb6) 00010000:00010000:3.0:1782758368.189244:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782758368.189259:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758368.189292:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189308:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189320:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189334:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189342:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189348:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189873:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189884:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.189893:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190040:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190049:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190056:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190063:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758368.190067:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190075:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190085:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758368.190088:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758368.190092:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190098:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db3de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190115:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190122:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190128:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190132:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758368.190135:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190145:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190152:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758368.190154:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758368.190157:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190162:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db3d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190172:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190178:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190183:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190188:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758368.190191:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190197:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190203:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75700) 00010000:00010000:3.0:1782758368.190206:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758368.190209:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758368.190219:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db3d7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758368.190343:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54001:x1869355196798848:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1267us (4274us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782758368.190351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1035 00010000:00010000:3.0:1782758368.812593:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758369.196127:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211646208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758369.196246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758369.196421:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646208 00000100:00100000:0.0:1782758369.196431:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646208 00000100:00100000:0.0:1782758369.196506:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1782758369.196517:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211646208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758369.196562:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758369.196628:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211646208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758369.196635:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:0.0:1782758369.196657:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758369.197415:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211646208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758369.837152:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758370.489307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758370.489377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758370.489416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758370.489443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758370.489497:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799360 00000100:00100000:2.0:1782758370.489510:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799360 00000100:00100000:1.0:1782758370.489566:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799104 00000100:00100000:1.0:1782758370.489571:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799104 00000100:00100000:3.0:1782758370.489702:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196798976 00000100:00100000:3.0:1782758370.489707:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196798976 00000100:00100000:3.0:1782758370.489786:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00100000:3.0:1782758370.489800:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196798976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758370.489924:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196798976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758370.489933:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00100000:2.0:1782758370.492603:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799232 00000100:00100000:2.0:1782758370.492622:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799232 00000100:00100000:1.0:1782758370.492749:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1740 00000100:00100000:1.0:1782758370.492765:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196799104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758370.492880:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196799104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 119us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758370.492888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1740 00000100:00100000:0.0:1782758370.493414:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1339 00000100:00100000:0.0:1782758370.493426:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196799360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758370.493493:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196799360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758370.493500:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1339 00000100:00080000:0.0:1782758370.493527:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758370.493533:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758370.493740:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00100000:2.0:1782758370.493751:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196799232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758370.493793:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196799232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (4347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758370.493800:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00080000:0.0:1782758370.494426:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758370.865206:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758371.247375:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211646592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.247484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758371.247569:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758371.247576:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211646720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.247606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758371.247645:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646592 00000100:00100000:0.0:1782758371.247655:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646592 00000100:00100000:0.0:1782758371.247726:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:0.0:1782758371.247738:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211646592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.247804:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211646592:12345-0@lo:400:kworker.0 Request processed in 68us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758371.247813:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:0.0:1782758371.247871:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646720 00000100:00100000:0.0:1782758371.247874:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646720 00000100:00100000:0.0:1782758371.247904:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1782758371.247909:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211646720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.247939:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211646720:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758371.247946:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:0.0:1782758371.247961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758371.247966:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758371.248004:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211646720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.248013:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211646592:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248168:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211646336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758371.248248:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211646848:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758371.248302:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758371.248308:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211646464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758371.248349:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211646976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758371.248399:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646848 00000100:00100000:1.0:1782758371.248403:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646848 00000100:00100000:1.0:1782758371.248450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646464 00000100:00100000:1.0:1782758371.248453:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646464 00000100:00100000:1.0:1782758371.248473:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1782758371.248479:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211646848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248519:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211646848:12345-0@lo:400:kworker.0 Request processed in 40us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758371.248525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1782758371.248543:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782758371.248549:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211646464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248576:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211646464:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758371.248582:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782758371.248601:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646976 00000100:00100000:1.0:1782758371.248604:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646976 00000100:00100000:1.0:1782758371.248631:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1782758371.248637:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211646976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248669:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211646976:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758371.248675:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1782758371.248706:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211646464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248715:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211646976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758371.248723:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211646848:0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.248849:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211646336 00000100:00100000:0.0:1782758371.248853:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211646336 00000100:00100000:0.0:1782758371.248889:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1782758371.248896:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211646336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.248940:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211646336:12345-0@lo:400:kworker.0 Request processed in 45us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758371.248947:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00080000:0.0:1782758371.248980:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758371.248983:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758371.249000:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211646336:0@lo:400:kworker.0 00000100:00100000:0.0:1782758371.759867:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211647104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758371.759969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758371.760596:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647104 00000100:00100000:2.0:1782758371.760608:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647104 00000100:00100000:2.0:1782758371.760676:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1782758371.760688:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211647104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758371.760740:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758371.760807:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211647104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758371.760815:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1782758371.761304:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211647104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758371.886924:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758372.106109:0:91887:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5c1c1b90 20000000:00000080:2.0:1782758372.106132:0:91887:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30c9800 uarg=0000000000000000 00010000:00010000:2.0:1782758372.107000:0:91887:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758372.107019:0:91887:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758372.107035:0:91887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758372.107059:0:91887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.107080:0:91887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.107090:0:91887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.107145:0:91887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.107164:0:91887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 18 pid: 5796 timeout: 2540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758372.107181:0:91887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91887:1869355211647232:0@lo:104: 00000100:00100000:2.0:1782758372.107345:0:91887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758372.107476:0:91887:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c0990000 going to sleep for 11 seconds 00000100:00100000:3.0:1782758372.107538:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647232 00000100:00100000:3.0:1782758372.107547:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647232 00000100:00100000:3.0:1782758372.107662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782758372.107674:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:91887:x1869355211647232:12345-0@lo:104: 00010000:00010000:3.0:1782758372.107689:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758372.107851:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758372.107860:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:91887:x1869355211647232:12345-0@lo:104: Request processed in 188us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758372.107867:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00010000:0.0:1782758372.107946:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758372.107955:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.107964:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758372.107968:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.107979:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758372.107987:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758372.107993:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758372.108027:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108034:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758372.108056:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108064:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777db336 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db33d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108081:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758372.108083:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758372.108085:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758372.108108:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211647360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758372.108144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758372.108194:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647360 00000100:00100000:0.0:1782758372.108199:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647360 00010000:00010000:0.0:1782758372.108236:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 19 pid: 5796 timeout: 2540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758372.108260:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1782758372.108266:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211647360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758372.108278:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758372.108283:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 19 pid: 5796 timeout: 2540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108293:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 19 pid: 5796 timeout: 2540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108311:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108319:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108339:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108346:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108353:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108359:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108364:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758372.108368:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108377:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108385:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758372.108395:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758372.108432:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211647360:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758372.108438:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1782758372.108483:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211647360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758372.108872:0:91887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777db33d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db336 expref: 18 pid: 5796 timeout: 2540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758372.108886:0:91887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91887:1869355211647232:0@lo:104: 00010000:00010000:2.0:1782758372.108903:0:91887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.108914:0:91887:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.108921:0:91887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758372.108928:0:91887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db3e5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758372.876712:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967697 is committed 00010000:00010000:1.0:1782758372.908169:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758373.259393:0:91937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff99c8f550 20000000:00000080:2.0:1782758373.259430:0:91937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30c9400 uarg=0000000000000000 00010000:00010000:2.0:1782758373.260534:0:91937:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758373.260558:0:91937:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758373.260576:0:91937:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758373.260602:0:91937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260622:0:91937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260635:0:91937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260642:0:91937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260650:0:91937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260656:0:91937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260662:0:91937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758373.260667:0:91937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260676:0:91937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260692:0:91937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260700:0:91937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758373.260711:0:91937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777db3ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758373.807900:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758373.807914:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758373.807923:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758373.807994:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758373.808011:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758373.808025:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758373.811655:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211647488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758373.811788:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758373.811877:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059a240 going to sleep for 11 seconds 00000100:00100000:3.0:1782758373.812043:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647488 00000100:00100000:3.0:1782758373.812055:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647488 00000100:00100000:3.0:1782758373.812124:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1782758373.812135:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211647488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758373.812156:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758373.812184:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db3f3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.812222:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.812236:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.812247:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758373.812309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211647488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758373.812317:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1782758373.812399:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211647488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758373.812420:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.812430:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758373.812460:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758373.812467:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.812476:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758373.932292:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758374.323141:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211647616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758374.323240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758374.334548:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647616 00000100:00100000:3.0:1782758374.335126:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647616 00000100:00100000:3.0:1782758374.338974:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1782758374.338996:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211647616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758374.339053:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758374.339184:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211647616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (15944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758374.339193:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1782758374.339274:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211647616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758374.346692:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758374.956158:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758375.615946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758375.616004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758375.616052:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799488 00000100:00100000:3.0:1782758375.616067:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799488 00000100:00100000:3.0:1782758375.616143:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1345 00000100:00100000:3.0:1782758375.616171:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196799488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758375.616278:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196799488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758375.616292:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1345 00000100:00100000:0.0:1782758375.616391:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799744 00000100:00100000:0.0:1782758375.616396:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799744 00000100:00100000:0.0:1782758375.616462:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1343 00000100:00100000:0.0:1782758375.616470:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758375.616507:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758375.616514:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1343 00000100:00080000:3.0:1782758375.618251:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758375.619237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758375.619293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758375.619407:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799616 00000100:00100000:0.0:1782758375.619418:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799616 00000100:00100000:0.0:1782758375.619512:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1744 00000100:00100000:3.0:1782758375.619513:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196799872 00000100:00100000:3.0:1782758375.619519:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196799872 00000100:00100000:0.0:1782758375.619527:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758375.619559:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1344 00000100:00100000:3.0:1782758375.619570:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758375.619629:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 105us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758375.619641:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1744 00000100:00080000:1.0:1782758375.619890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758375.619896:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758375.619902:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196799872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 333us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758375.619911:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1344 00010000:00010000:1.0:1782758375.984105:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758376.373881:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211647744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.373992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374057:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211648256:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374116:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758376.374122:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211648128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374146:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374177:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211647872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374219:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211648384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374258:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758376.374263:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211648000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.374326:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648256 00000100:00100000:0.0:1782758376.374335:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648256 00000100:00100000:0.0:1782758376.374406:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647872 00000100:00100000:0.0:1782758376.374409:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647872 00000100:00100000:0.0:1782758376.374433:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648000 00000100:00100000:0.0:1782758376.374436:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648000 00000100:00100000:0.0:1782758376.374455:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1782758376.374465:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211648256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374528:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211648256:12345-0@lo:400:kworker.0 Request processed in 63us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.374536:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1782758376.374556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1782758376.374561:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211647872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374593:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211647872:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.374599:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1782758376.374610:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1782758376.374616:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211648000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211648000:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.374646:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1782758376.374665:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648128 00000100:00100000:0.0:1782758376.374668:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648128 00000100:00100000:0.0:1782758376.374696:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648384 00000100:00100000:0.0:1782758376.374699:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648384 00000100:00100000:0.0:1782758376.374722:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1782758376.374727:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211648128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374759:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211648128:12345-0@lo:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.374765:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1782758376.374775:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1782758376.374780:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211648384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374808:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211648384:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.374814:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:0.0:1782758376.374870:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758376.374875:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758376.374878:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758376.374929:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211648000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374941:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211647872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374950:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211648384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.374989:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211648128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758376.375000:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211648256:0@lo:400:kworker.0 00000100:00100000:2.0:1782758376.375155:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211647744 00000100:00100000:2.0:1782758376.375160:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211647744 00000100:00100000:2.0:1782758376.375194:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1782758376.375201:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211647744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758376.375245:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211647744:12345-0@lo:400:kworker.0 Request processed in 44us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758376.375251:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1782758376.375291:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211647744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758376.880877:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758376.880911:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758376.881013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758376.881071:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648512 00000100:00100000:0.0:1782758376.881083:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648512 00000100:00100000:0.0:1782758376.881161:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1782758376.881174:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211648512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758376.881225:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758376.881299:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211648512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758376.881307:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1782758376.881679:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211648512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758377.004121:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758377.389594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758377.391649:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196800000 00000100:00100000:0.0:1782758377.391668:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196800000 00000100:00100000:0.0:1782758377.391879:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1036 00000100:00100000:0.0:1782758377.391894:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54114:x1869355196800000:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758377.391924:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1782758377.391932:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758377.391959:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c82 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.392130:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.392151:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.392170:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758377.392542:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758377.392548:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758377.392635:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758377.392671:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777db401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c82 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758377.392693:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c82 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758377.392703:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782758377.392707:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758377.392711:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:1.0:1782758377.392798:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54114:x1869355196800000:12345-192.168.204.31@tcp:101:rm.0 Request processed in 908us (3220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758377.392807:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1036 00000100:00100000:1.0:1782758377.395963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758377.396251:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196800128 00000100:00100000:0.0:1782758377.396265:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196800128 00000100:00100000:0.0:1782758377.396365:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1037 00000100:00100000:0.0:1782758377.396379:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54114:x1869355196800128:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758377.396410:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758377.396441:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db40f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c89 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396523:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396541:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396555:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396584:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396593:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.396599:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397198:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397223:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397233:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758377.397364:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:2.0:1782758377.397369:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758377.397451:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397466:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397474:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397482:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397489:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.397493:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397502:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397516:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782758377.397520:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.397525:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397531:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777db416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397545:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397551:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397557:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397563:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.397566:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397577:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397586:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff91718bcfde00) 00010000:00010000:2.0:1782758377.397588:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.397591:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397597:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db41d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397637:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db40f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c89 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397650:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c89 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.397658:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758377.397660:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758377.397662:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758377.397753:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54114:x1869355196800128:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1377us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758377.397763:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1037 00000100:00100000:3.0:1782758377.404423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758377.404895:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196800384 00000100:00100000:0.0:1782758377.404910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196800384 00000100:00100000:0.0:1782758377.404984:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:0.0:1782758377.404996:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54114:x1869355196800384:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758377.405024:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758377.405050:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db42b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c90 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758377.405421:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:0.0:1782758377.405685:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db42b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c90 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.405703:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758377.405707:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782758377.405712:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db42b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c90 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.405728:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758377.405815:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54114:x1869355196800384:12345-192.168.204.31@tcp:101:rm.0 Request processed in 821us (1406us total) trans 4294967698 rc 301/301 00000100:00100000:0.0:1782758377.405880:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:1.0:1782758377.418080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758377.418203:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196800512 00000100:00100000:3.0:1782758377.418218:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196800512 00000100:00100000:3.0:1782758377.418294:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 106 00000100:00100000:3.0:1782758377.418307:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54114:x1869355196800512:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782758377.427294:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54114:x1869355196800512:12345-192.168.204.31@tcp:37:rm.0 Request processed in 8970us (9210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758377.427313:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 106 00000100:00100000:1.0:1782758377.434191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758377.437003:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196800768 00000100:00100000:0.0:1782758377.437228:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196800768 00000100:00100000:2.0:1782758377.437439:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:2.0:1782758377.437454:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54114:x1869355196800768:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:2.0:1782758377.439524:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54114:x1869355196800768:12345-192.168.204.31@tcp:35:rm.0 Request processed in 2061us (5337us total) trans 4294967699 rc 0/0 00000100:00100000:2.0:1782758377.439542:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:1.0:1782758377.446610:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758377.446931:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801024 00000100:00100000:2.0:1782758377.446946:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801024 00000100:00100000:2.0:1782758377.447017:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1039 00000100:00100000:2.0:1782758377.447030:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54114:x1869355196801024:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782758377.447106:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758377.447143:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c89 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447170:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758377.447192:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db408 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c82 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447203:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782758377.447212:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758377.447244:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447260:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447271:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447286:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447293:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.447302:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.449199:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.449218:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.449229:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758377.453470:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:2.0:1782758377.453513:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453527:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453537:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453545:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.453551:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453561:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453584:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782758377.453588:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758377.453595:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.453603:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db447 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454032:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454042:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454049:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454054:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.454057:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454063:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454073:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782758377.454076:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.454079:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.454085:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db439 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758377.454102:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028c73006 reply state 00000000f0875c34 transno 4294967700 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758377.454121:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758377.454306:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54114:x1869355196801024:12345-192.168.204.31@tcp:36:rm.0 Request processed in 7271us (7706us total) trans 4294967700 rc 0/0 00000100:00100000:2.0:1782758377.454329:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1039 00010000:00010000:0.0:1782758377.468264:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468289:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468298:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468307:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758377.468313:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468336:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468359:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917182dd1500) 00010000:00010000:0.0:1782758377.468363:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758377.468369:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.468376:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db440 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758377.515215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758377.519229:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801152 00000100:00100000:2.0:1782758377.519248:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801152 00000100:00100000:2.0:1782758377.519341:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1040 00000100:00100000:2.0:1782758377.519353:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54118:x1869355196801152:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782758377.519387:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758377.519521:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db44e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c97 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519661:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519677:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519692:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758377.519777:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758377.519782:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758377.519812:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519875:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db44e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c97 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519903:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c97 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.519913:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782758377.519916:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758377.519920:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758377.520063:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54118:x1869355196801152:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 711us (4863us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758377.520072:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1040 00000100:00100000:1.0:1782758377.533376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758377.536453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758377.541774:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801280 00000100:00100000:2.0:1782758377.541796:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801280 00000100:00100000:3.0:1782758377.542163:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801536 00000100:00100000:3.0:1782758377.542168:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801536 00000100:00100000:3.0:1782758377.542211:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1041 00000100:00100000:3.0:1782758377.542224:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2362:x1869355196801280:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:3.0:1782758377.542298:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1782758377.542410:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2362:x1869355196801280:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 188us (9048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758377.542423:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1041 00000100:00100000:3.0:1782758377.542446:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1042 00000100:00100000:3.0:1782758377.542453:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54118:x1869355196801536:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782758377.542501:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758377.542537:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db455 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c97 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.542561:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:3.0:1782758377.542576:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758377.543356:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.543376:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.543388:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.543404:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.543410:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.543418:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758377.546759:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 512 00010000:00010000:3.0:1782758377.546795:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.546809:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.546817:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.547341:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758377.547346:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.547356:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.547378:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758377.547381:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758377.547387:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.547393:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db45c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758377.547425:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009f5319b reply state 00000000647cf1c8 transno 4294967701 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758377.547437:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758377.547655:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:54118:x1869355196801536:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 5194us (11212us total) trans 4294967701 rc 0/0 00000100:00100000:3.0:1782758377.547666:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1042 00010000:00010000:2.0:1782758377.561619:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561749:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561758:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561763:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.561769:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561777:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561800:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75300) 00010000:00010000:2.0:1782758377.561805:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.561810:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.561816:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db463 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758377.643958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758377.644136:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801664 00000100:00100000:3.0:1782758377.644150:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801664 00000100:00100000:3.0:1782758377.644225:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1043 00000100:00100000:3.0:1782758377.644236:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54122:x1869355196801664:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782758377.644270:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758377.644309:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db46a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64c9e expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.644411:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.644429:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.644445:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758377.645244:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758377.645252:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758377.645422:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.645461:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db46a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c9e expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.645487:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c9e expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.645497:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758377.645500:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758377.645505:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758377.645610:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:54122:x1869355196801664:12345-192.168.204.31@tcp:101:chown.0 Request processed in 1374us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758377.645620:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1043 00000100:00100000:1.0:1782758377.649078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758377.649240:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196801792 00000100:00100000:2.0:1782758377.649253:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196801792 00000100:00100000:2.0:1782758377.649385:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:2.0:1782758377.649397:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:54122:x1869355196801792:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:2.0:1782758377.649425:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758377.649451:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ca5 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649535:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649552:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649566:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649583:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649590:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649597:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649741:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649753:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.649760:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758377.649808:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 512 00000004:00200000:2.0:1782758377.649812:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758377.650070:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650086:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650093:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650100:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650107:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.650112:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650126:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650140:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782758377.650144:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.650149:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650156:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777db47f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650171:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650177:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650183:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650188:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758377.650191:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650197:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650205:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917182dd1300) 00010000:00010000:2.0:1782758377.650207:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758377.650210:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650216:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650253:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ca5 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650272:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ca5 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758377.650279:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758377.650281:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758377.650284:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758377.650385:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:54122:x1869355196801792:12345-192.168.204.31@tcp:101:chown.0 Request processed in 989us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758377.650393:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:2.0:1782758377.655338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758377.655573:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802048 00000100:00100000:3.0:1782758377.655586:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802048 00000100:00100000:3.0:1782758377.655662:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1045 00000100:00100000:3.0:1782758377.655674:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:54122:x1869355196802048:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:3.0:1782758377.655754:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758377.655790:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777db48d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ca5 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.655813:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:3.0:1782758377.656013:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758377.656050:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.656067:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758377.656079:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758377.732889:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967698 is committed 00000001:00080000:2.0:1782758377.732920:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967700 is committed 00000001:00080000:2.0:1782758377.732934:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000004:00010000:2.0:1782758377.733364:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022ea3467 reply state 000000009390ec29 transno 4294967702 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758377.733382:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758377.733644:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:2.0:1782758377.733779:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782758377.733804:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54122:x1869355196802048:12345-192.168.204.31@tcp:36:chown.0 Request processed in 78127us (78473us total) trans 4294967702 rc 0/0 00000100:00100000:2.0:1782758377.733815:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1045 00010000:00010000:0.0:1782758377.734521:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734533:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734541:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734547:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758377.734552:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734561:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734585:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75b00) 00010000:00010000:0.0:1782758377.734588:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758377.734593:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758377.734599:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db494 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758378.028098:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758378.611215:0:92132:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb4b8cf50 20000000:00000080:2.0:1782758378.611238:0:92132:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cab000 uarg=0000000000000000 00010000:00010000:2.0:1782758378.612706:0:92132:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758378.612759:0:92132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782758378.612764:0:92132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758378.612779:0:92132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64c9e expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.612808:0:92132:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758378.612870:0:92132:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758378.612887:0:92132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.612902:0:92132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.612911:0:92132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.612960:0:92132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.612976:0:92132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 18 pid: 5796 timeout: 2547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758378.612994:0:92132:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92132:1869355211648640:0@lo:104: 00000100:00100000:2.0:1782758378.613081:0:92132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758378.613151:0:92132:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1480 going to sleep for 11 seconds 00000100:00100000:1.0:1782758378.613284:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648640 00000100:00100000:1.0:1782758378.613310:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648640 00000100:00100000:1.0:1782758378.613399:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1782758378.613410:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92132:x1869355211648640:12345-0@lo:104: 00010000:00010000:1.0:1782758378.613430:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758378.613538:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758378.613547:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92132:x1869355211648640:12345-0@lo:104: Request processed in 138us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758378.613554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:3.0:1782758378.613581:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758378.613592:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.613601:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758378.613604:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.613677:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758378.613688:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758378.613695:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758378.613739:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.613746:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758378.613782:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.613788:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db3f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db3fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.613803:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758378.613804:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758378.613806:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758378.613816:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758378.613850:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211648768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758378.613890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758378.613929:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648768 00000100:00100000:3.0:1782758378.613936:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648768 00010000:00010000:3.0:1782758378.613962:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 19 pid: 5796 timeout: 2547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758378.613996:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1782758378.614006:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211648768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758378.614020:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758378.614027:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 19 pid: 5796 timeout: 2547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614039:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 19 pid: 5796 timeout: 2547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614056:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614065:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614080:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614089:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614097:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614104:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614110:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758378.614114:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614122:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614131:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758378.614146:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758378.614185:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211648768:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758378.614192:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00010000:00010000:2.0:1782758378.614471:0:92132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db3fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db3f3 expref: 18 pid: 5796 timeout: 2547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758378.614486:0:92132:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92132:1869355211648640:0@lo:104: 00010000:00010000:2.0:1782758378.614505:0:92132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.614520:0:92132:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.614526:0:92132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758378.614532:0:92132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db49b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758378.614763:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211648768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758379.052054:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758379.439243:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211648896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758379.439325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758379.439476:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211648896 00000100:00100000:3.0:1782758379.439525:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211648896 00000100:00100000:3.0:1782758379.439582:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1782758379.439591:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211648896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758379.439629:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758379.439677:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211648896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758379.439684:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:3.0:1782758379.439710:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758379.439745:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211648896:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782758379.551616:0:92181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4a8c5770 20000000:00000080:2.0:1782758379.551633:0:92181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cab000 uarg=0000000000000000 00010000:00010000:2.0:1782758379.551886:0:92181:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758379.551901:0:92181:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758379.551914:0:92181:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758379.551935:0:92181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551952:0:92181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551964:0:92181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551971:0:92181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551977:0:92181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551984:0:92181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.551989:0:92181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758379.551994:0:92181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.552001:0:92181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.552014:0:92181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.552022:0:92181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758379.552027:0:92181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777db4a2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758379.694896:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758379.694905:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758379.694912:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758379.694982:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758379.694993:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758379.695014:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758379.695042:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211649024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758379.695122:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758379.695179:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c21e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758379.695293:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649024 00000100:00100000:3.0:1782758379.695301:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649024 00000100:00100000:3.0:1782758379.695353:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1782758379.695362:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211649024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758379.695376:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758379.695389:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db4a9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758379.695413:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758379.695424:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758379.695433:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758379.695474:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211649024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758379.695481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1782758379.695811:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211649024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758379.695853:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758379.695863:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758379.695882:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758379.695887:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758379.695894:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758380.076059:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758380.727270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758380.727317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758380.727340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758380.727361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758380.727442:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802176 00000100:00100000:2.0:1782758380.727452:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802176 00000100:00100000:2.0:1782758380.727508:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1348 00000100:00100000:2.0:1782758380.727518:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196802176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758380.727595:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196802176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758380.727603:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1348 00000100:00100000:0.0:1782758380.729496:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802432 00000100:00100000:0.0:1782758380.729510:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802432 00000100:00100000:0.0:1782758380.729562:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802560 00000100:00100000:0.0:1782758380.729565:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802560 00000100:00100000:0.0:1782758380.729590:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1347 00000100:00100000:0.0:1782758380.729600:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758380.729667:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758380.729675:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1347 00000100:00100000:0.0:1782758380.729690:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1348 00000100:00100000:0.0:1782758380.729696:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758380.729719:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758380.729725:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1348 00000100:00100000:0.0:1782758380.729742:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802304 00000100:00100000:0.0:1782758380.729745:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802304 00000100:00100000:0.0:1782758380.729774:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1748 00000100:00100000:0.0:1782758380.729780:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758380.729810:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758380.729816:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1748 00000100:00080000:2.0:1782758380.730092:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758380.730098:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758380.730100:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758381.104362:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758381.489494:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211649408:0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.489556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758381.489625:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649408 00000100:00100000:2.0:1782758381.489632:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649408 00000100:00100000:2.0:1782758381.489682:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:2.0:1782758381.489691:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211649408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.489742:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211649408:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758381.489750:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00080000:2.0:1782758381.489769:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758381.489796:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211649408:0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.489861:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211649536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.489887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758381.489986:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211649152:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758381.490047:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211649664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758381.490083:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758381.490087:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211649280:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758381.490115:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211649792:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758381.490150:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649664 00000100:00100000:1.0:1782758381.490152:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649664 00000100:00100000:1.0:1782758381.490176:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649280 00000100:00100000:1.0:1782758381.490178:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649280 00000100:00100000:1.0:1782758381.490190:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:1.0:1782758381.490195:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211649664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490222:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211649664:12345-0@lo:400:kworker.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758381.490228:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:1.0:1782758381.490253:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1782758381.490258:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211649280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490280:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211649280:12345-0@lo:400:kworker.0 Request processed in 22us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758381.490285:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1782758381.490307:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649536 00000100:00100000:1.0:1782758381.490310:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649536 00000100:00100000:1.0:1782758381.490334:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649792 00000100:00100000:1.0:1782758381.490336:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649792 00000100:00100000:1.0:1782758381.490353:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1782758381.490358:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211649536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490385:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211649536:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758381.490391:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1782758381.490400:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1782758381.490404:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211649792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490424:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211649792:12345-0@lo:400:kworker.0 Request processed in 20us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758381.490429:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:1.0:1782758381.490447:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758381.490450:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758381.490451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758381.490465:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211649536:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490485:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211649280:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490492:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211649792:0@lo:400:kworker.0 00000100:00100000:1.0:1782758381.490499:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211649664:0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.490648:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649152 00000100:00100000:2.0:1782758381.490653:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649152 00000100:00100000:2.0:1782758381.490717:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1782758381.490725:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211649152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.490766:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211649152:12345-0@lo:400:kworker.0 Request processed in 43us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758381.490772:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1782758381.490846:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211649152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758381.997214:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211649920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758381.997304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758381.997380:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211649920 00000100:00100000:2.0:1782758381.997388:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211649920 00000100:00100000:2.0:1782758381.997440:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1782758381.997451:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211649920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758381.997494:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758381.997547:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211649920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758381.997555:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1782758381.997671:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211649920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758382.134379:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758382.972725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758382.972922:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802688 00000100:00100000:3.0:1782758382.972932:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802688 00000100:00100000:3.0:1782758382.972999:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:3.0:1782758382.973009:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5584:x1869355196802688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758382.973024:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758382.973027:0:5785:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db471) 00010000:00010000:3.0:1782758382.973029:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758382.973078:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5584:x1869355196802688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (364us total) trans 0 rc 116/116 00000100:00100000:3.0:1782758382.973085:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00080000:1.0:1782758382.973466:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758383.148373:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758384.176150:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758384.558866:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758384.558898:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211650048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758384.558959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758384.559014:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650048 00000100:00100000:2.0:1782758384.559020:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650048 00000100:00100000:2.0:1782758384.559067:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1782758384.559075:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211650048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758384.559104:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758384.559140:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211650048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758384.559147:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1782758384.559198:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211650048:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758384.560450:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782758384.946041:0:92425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe93aa5a00 20000000:00000080:1.0:1782758384.946061:0:92425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93f400 uarg=0000000000000000 00010000:00010000:1.0:1782758384.947324:0:92425:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758384.947343:0:92425:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758384.947358:0:92425:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758384.947380:0:92425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.947401:0:92425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.947410:0:92425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.947450:0:92425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.947465:0:92425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 18 pid: 5794 timeout: 2553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758384.947478:0:92425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92425:1869355211650176:0@lo:104: 00000100:00100000:1.0:1782758384.947619:0:92425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758384.947780:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650176 00000100:00100000:0.0:1782758384.947788:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650176 00000100:00100000:0.0:1782758384.947857:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782758384.947867:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92425:x1869355211650176:12345-0@lo:104: 00010000:00010000:0.0:1782758384.947880:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758384.947962:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758384.947969:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92425:x1869355211650176:12345-0@lo:104: Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758384.947976:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1782758384.948066:0:92425:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183344900 going to sleep for 11 seconds 00000100:00100000:1.0:1782758384.948093:0:92425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92425:1869355211650176:0@lo:104: 00010000:00010000:1.0:1782758384.948113:0:92425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948281:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758384.948289:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948297:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758384.948301:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948310:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758384.948317:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758384.948324:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758384.948354:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948361:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782758384.948406:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211650304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758384.948439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782758384.948657:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948665:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50400/0xdd99f5c4777db4a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758384.948685:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758384.948686:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758384.948688:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758384.949338:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650304 00000100:00100000:3.0:1782758384.949347:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650304 00010000:00010000:3.0:1782758384.949379:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 2553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758384.949417:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1782758384.949427:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211650304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758384.949445:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758384.949451:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 2553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949462:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 2553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949478:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777db4b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db4a9 expref: 19 pid: 5794 timeout: 2553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949492:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949500:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949514:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949521:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949528:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949534:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949540:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758384.949544:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949552:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949577:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758384.949587:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758384.949647:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211650304:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758384.949654:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00010000:1.0:1782758384.949721:0:92425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.949730:0:92425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758384.949736:0:92425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db4b7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758384.950316:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211650304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758385.197115:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758385.851369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758385.851422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758385.851449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758385.851475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758385.851512:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803072 00000100:00100000:1.0:1782758385.851523:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803072 00000100:00100000:1.0:1782758385.851584:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803200 00000100:00100000:1.0:1782758385.851587:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803200 00000100:00100000:1.0:1782758385.851611:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1351 00000100:00100000:1.0:1782758385.851622:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196803072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758385.851699:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196803072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758385.851707:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1351 00000100:00100000:1.0:1782758385.851728:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1352 00000100:00100000:1.0:1782758385.851735:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196803200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758385.851759:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196803200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758385.851766:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1352 00000100:00100000:1.0:1782758385.851784:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802944 00000100:00100000:1.0:1782758385.851787:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802944 00000100:00100000:1.0:1782758385.851813:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1752 00000100:00100000:1.0:1782758385.851819:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758385.851871:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196802944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758385.851881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1752 00000100:00100000:3.0:1782758385.852077:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196802816 00000100:00100000:3.0:1782758385.852082:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196802816 00000100:00100000:3.0:1782758385.852116:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1350 00000100:00100000:3.0:1782758385.852123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196802816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758385.852228:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196802816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 104us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758385.852234:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1350 00000100:00080000:3.0:1782758385.852334:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758385.852339:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758385.852341:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758386.228203:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758386.540629:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758386.540639:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758386.540645:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758386.540698:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758386.540710:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758386.540721:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758386.540749:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211650432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758386.540840:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758386.540909:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758386.541063:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650432 00000100:00100000:2.0:1782758386.541072:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650432 00000100:00100000:2.0:1782758386.541121:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1782758386.541131:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211650432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758386.541155:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758386.541181:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db4be expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758386.541205:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758386.541216:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758386.541240:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758386.541292:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211650432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758386.541299:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1782758386.541616:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211650432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758386.541633:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758386.541642:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758386.541662:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758386.541667:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758386.541674:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758386.605458:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211650944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.605534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.605607:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758386.605614:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211650560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.605645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.605666:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211651072:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.605692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.605722:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650944 00000100:00100000:1.0:1782758386.605728:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650944 00000100:00100000:1.0:1782758386.605779:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1782758386.605789:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211650944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.605870:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211650944:12345-0@lo:400:kworker.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.605877:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1782758386.605903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650560 00000100:00100000:1.0:1782758386.605906:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650560 00000100:00100000:1.0:1782758386.605929:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1782758386.605935:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211650560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.605962:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211650560:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.605968:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1782758386.605995:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651072 00000100:00100000:1.0:1782758386.605998:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651072 00000100:00100000:1.0:1782758386.606024:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:1.0:1782758386.606031:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211651072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606062:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211651072:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.606067:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00080000:1.0:1782758386.606084:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758386.606088:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758386.606119:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211650560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606132:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211651072:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606159:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211650944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606197:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211650688:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.606241:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211651200:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.606280:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758386.606286:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211650816:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758386.606331:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650688 00000100:00100000:1.0:1782758386.606334:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650688 00000100:00100000:1.0:1782758386.606369:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211650816 00000100:00100000:1.0:1782758386.606373:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211650816 00000100:00100000:1.0:1782758386.606393:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1782758386.606398:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211650688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211650688:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.606439:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1782758386.606452:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1782758386.606458:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606485:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211650816:12345-0@lo:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.606491:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1782758386.606509:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651200 00000100:00100000:1.0:1782758386.606512:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651200 00000100:00100000:1.0:1782758386.606539:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1782758386.606545:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211651200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606574:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211651200:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758386.606581:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00080000:1.0:1782758386.606606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758386.606609:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758386.606627:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211650816:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606637:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211650688:0@lo:400:kworker.0 00000100:00100000:1.0:1782758386.606646:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211651200:0@lo:400:kworker.0 00000100:00100000:1.0:1782758387.128331:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758387.128354:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211651328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758387.128421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758387.128667:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651328 00000100:00100000:3.0:1782758387.128675:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651328 00000100:00100000:3.0:1782758387.128729:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1782758387.128740:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211651328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758387.128777:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758387.128859:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211651328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758387.128866:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1782758387.128907:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211651328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758387.247696:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758388.270088:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758388.870191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758388.870267:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803328 00000100:00100000:2.0:1782758388.870278:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803328 00000100:00100000:2.0:1782758388.870364:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00100000:2.0:1782758388.870375:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54300:x1869355196803328:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758388.870394:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758388.870416:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777db4cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cac expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870477:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870490:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870503:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758388.870703:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758388.870707:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758388.870791:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870856:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777db4cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cac expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870874:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cac expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758388.870883:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1100) 00010000:00010000:2.0:1782758388.870886:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758388.870889:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758388.870941:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54300:x1869355196803328:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 568us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758388.870948:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00080000:1.0:1782758388.874635:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758388.885481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758388.885561:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803456 00000100:00100000:1.0:1782758388.885571:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803456 00000100:00100000:1.0:1782758388.885648:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:1.0:1782758388.885659:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54300:x1869355196803456:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758388.885680:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758388.885701:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cb3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885763:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885777:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885788:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885803:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885810:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.885817:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886196:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886206:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886214:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758388.886306:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1782758388.886311:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758388.886384:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886397:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886404:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886411:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886417:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758388.886421:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886429:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886441:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1100) 00010000:00010000:1.0:1782758388.886444:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758388.886448:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886455:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777db4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886467:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886474:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886480:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886486:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758388.886489:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886495:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886501:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9171a0e3a900) 00010000:00010000:1.0:1782758388.886504:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758388.886506:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886512:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db4e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886543:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cb3 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886557:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cb3 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.886566:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758388.886569:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758388.886571:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758388.886637:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54300:x1869355196803456:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 979us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758388.886645:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:0.0:1782758388.915037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758388.915112:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803712 00000100:00100000:1.0:1782758388.915124:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803712 00000100:00100000:1.0:1782758388.915199:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1048 00000100:00100000:1.0:1782758388.915211:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54300:x1869355196803712:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758388.915261:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758388.915291:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db4ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cb3 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.915321:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758388.915332:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758388.915356:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.915369:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.915378:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758388.988277:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050a936f2 reply state 00000000c717b799 transno 4294967703 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758388.988692:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782758388.988946:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967703 is committed 00000004:00200000:2.0:1782758388.989077:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:2.0:1782758388.989188:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782758388.989209:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54300:x1869355196803712:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 73997us (74179us total) trans 4294967703 rc 0/0 00000100:00100000:2.0:1782758388.989218:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1048 00010000:00010000:1.0:1782758388.989299:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989309:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989316:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989322:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758388.989326:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989336:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989352:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3a900) 00010000:00010000:1.0:1782758388.989355:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758388.989360:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758388.989365:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db4f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.292227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758389.684225:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211651456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758389.684303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758389.684364:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651456 00000100:00100000:2.0:1782758389.684385:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651456 00000100:00080000:1.0:1782758389.684452:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758389.684463:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1782758389.684473:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211651456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758389.684509:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758389.684565:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211651456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758389.684573:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1782758389.684855:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211651456:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782758389.819183:0:92623:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe44633a30 20000000:00000080:1.0:1782758389.819203:0:92623:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2d12000 uarg=0000000000000000 00010000:00010000:1.0:1782758389.819712:0:92623:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758389.819748:0:92623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1100) 00010000:00010000:1.0:1782758389.819752:0:92623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758389.819764:0:92623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db4d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cac expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.819785:0:92623:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782758389.819801:0:92623:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758389.819815:0:92623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.819831:0:92623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.819860:0:92623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.819898:0:92623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758389.819912:0:92623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 18 pid: 5793 timeout: 2558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758389.819925:0:92623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92623:1869355211651584:0@lo:104: 00000100:00100000:1.0:1782758389.819987:0:92623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758389.820042:0:92623:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758389.820062:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651584 00000100:00100000:0.0:1782758389.820070:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651584 00000100:00100000:0.0:1782758389.820123:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1782758389.820133:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92623:x1869355211651584:12345-0@lo:104: 00010000:00010000:0.0:1782758389.820146:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758389.820215:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758389.820221:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92623:x1869355211651584:12345-0@lo:104: Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758389.820228:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00010000:2.0:1782758389.820283:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758389.820290:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758389.820297:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758389.820301:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758389.820309:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758389.820315:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758389.820320:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758389.820352:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758389.820358:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758389.820380:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758389.820386:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db4be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db4c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758389.820410:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758389.820413:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758389.820415:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758389.820427:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211651712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758389.820459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758389.821934:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651712 00000100:00100000:3.0:1782758389.821942:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651712 00010000:00010000:3.0:1782758389.821974:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 19 pid: 5793 timeout: 2558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758389.823486:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1782758389.823504:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211651712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758389.823520:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758389.823527:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 19 pid: 5793 timeout: 2558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823540:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 19 pid: 5793 timeout: 2558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823561:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823834:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823856:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823863:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823870:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823876:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823883:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758389.823887:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823895:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823904:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758389.823914:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758389.824008:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211651712:12345-0@lo:103:ldlm_bl.0 Request processed in 510us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758389.824016:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1782758389.824152:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211651712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758389.826932:0:92623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777db4c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db4be expref: 18 pid: 5793 timeout: 2558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758389.826953:0:92623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92623:1869355211651584:0@lo:104: 00010000:00010000:0.0:1782758389.826980:0:92623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758389.826992:0:92623:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758389.826999:0:92623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758389.827006:0:92623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777db4fd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758390.321005:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758390.968634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758390.968678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758390.968702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758390.968735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758390.968877:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803968 00000100:00100000:3.0:1782758390.968887:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803968 00000100:00100000:3.0:1782758390.969471:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1756 00000100:00100000:3.0:1782758390.969486:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196803968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758390.969697:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196803968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 213us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758390.969705:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1756 00000100:00100000:3.0:1782758390.969735:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196803840 00000100:00100000:3.0:1782758390.969740:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196803840 00000100:00100000:3.0:1782758390.970369:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1353 00000100:00100000:3.0:1782758390.970379:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196803840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758390.970519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196803840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758390.970734:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1353 00000100:00100000:1.0:1782758390.971352:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804096 00000100:00100000:1.0:1782758390.971360:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804096 00000100:00100000:1.0:1782758390.974024:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804224 00000100:00100000:1.0:1782758390.974037:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804224 00000100:00080000:0.0:1782758390.975881:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758390.975889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758390.975892:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758390.979090:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 574 00000100:00100000:1.0:1782758390.979197:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:1.0:1782758390.979218:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196804224:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1782758390.979254:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db344 00000100:00080000:1.0:1782758390.979264:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917084d27800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782758390.979304:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:1.0:1782758390.979806:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196804224:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 596us (11066us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758390.979814:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 575 00010000:00010000:1.0:1782758390.980898:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758390.994049:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196804096:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782758390.994169:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db042 00000100:00080000:3.0:1782758390.994182:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917081afc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782758390.994228:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:3.0:1782758390.994502:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196804096:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 15398us (25797us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758390.994512:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 574 00010000:00010000:3.0:1782758390.994669:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758391.342310:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758391.468921:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758391.468929:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758391.468934:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758391.468992:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758391.469005:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758391.469018:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758391.469052:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211651840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758391.469130:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.469190:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b32373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758391.469880:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651840 00000100:00100000:3.0:1782758391.469890:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651840 00000100:00100000:3.0:1782758391.473283:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1782758391.473314:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211651840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758391.473334:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758391.473354:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db504 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758391.473920:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758391.473933:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758391.473948:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758391.474055:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211651840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 750us (4925us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758391.474064:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1782758391.474315:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211651840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758391.474336:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758391.474346:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758391.474376:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758391.474381:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758391.474389:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758391.729444:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211652096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729571:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211652608:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729620:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758391.729625:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211651968:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729674:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211652480:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729734:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211652224:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729776:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758391.729783:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211652352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758391.729803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758391.729846:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652096 00000100:00100000:0.0:1782758391.729853:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652096 00000100:00100000:0.0:1782758391.729891:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652480 00000100:00100000:0.0:1782758391.729893:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652480 00000100:00100000:0.0:1782758391.729912:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652224 00000100:00100000:0.0:1782758391.729915:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652224 00000100:00100000:0.0:1782758391.729933:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1782758391.729940:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211652096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730062:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652608 00000100:00100000:1.0:1782758391.730066:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652608 00000100:00100000:1.0:1782758391.730096:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652352 00000100:00100000:1.0:1782758391.730099:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652352 00000100:00100000:1.0:1782758391.730119:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1782758391.730126:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211652608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730185:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211652608:12345-0@lo:400:kworker.0 Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758391.730192:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1782758391.730212:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1782758391.730218:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211652352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730253:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211652352:12345-0@lo:400:kworker.0 Request processed in 36us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758391.730259:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1782758391.730281:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1782758391.730288:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211652480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730317:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211652480:12345-0@lo:400:kworker.0 Request processed in 30us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758391.730323:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1782758391.730335:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1782758391.730341:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211652224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730367:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211652224:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758391.730373:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1782758391.730414:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211652352:0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730425:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211652224:0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730460:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211652480:0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.730470:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211652608:0@lo:400:kworker.0 00000100:00080000:1.0:1782758391.730522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758391.730525:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758391.730528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758391.730696:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211651968 00000100:00100000:3.0:1782758391.730701:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211651968 00000100:00100000:3.0:1782758391.730730:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1782758391.730737:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758391.730781:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211651968:12345-0@lo:400:kworker.0 Request processed in 44us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758391.730787:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1782758391.730841:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211651968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758391.733296:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211652096:12345-0@lo:400:kworker.0 Request processed in 3346us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758391.733310:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1782758391.733443:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211652096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758392.236087:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758392.236119:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758392.236212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758392.236701:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652736 00000100:00100000:1.0:1782758392.236712:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652736 00000100:00100000:1.0:1782758392.236786:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1782758392.236798:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211652736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758392.236880:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758392.236959:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211652736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758392.236967:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1782758392.237001:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211652736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758392.376715:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758393.342813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.343788:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804352 00000100:00100000:3.0:1782758393.343801:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804352 00000100:00100000:3.0:1782758393.343881:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:3.0:1782758393.343892:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54377:x1869355196804352:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758393.343912:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758393.343934:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.343999:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344026:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344038:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344050:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344056:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344062:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344530:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344541:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344549:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758393.344630:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758393.344635:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758393.344726:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344740:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344746:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344757:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344763:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.344767:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344774:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344786:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75100) 00010000:00010000:3.0:1782758393.344789:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.344794:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344801:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344811:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344818:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344841:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344846:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.344849:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344859:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344867:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75700) 00010000:00010000:3.0:1782758393.344869:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.344873:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344877:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344905:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cba expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344919:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cba expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.344926:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758393.344929:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758393.344931:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758393.344996:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54377:x1869355196804352:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1106us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758393.345018:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00080000:3.0:1782758393.345045:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758393.353674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758393.353788:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804608 00000100:00100000:1.0:1782758393.353799:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804608 00000100:00100000:1.0:1782758393.353893:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1050 00000100:00100000:1.0:1782758393.353904:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54377:x1869355196804608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758393.353923:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758393.353942:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db52e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cc1 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354278:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354294:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354305:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354390:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354420:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.354428:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758393.360176:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:1.0:1782758393.360496:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360513:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360526:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360565:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360573:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360581:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360587:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758393.360591:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360599:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360611:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758393.360614:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758393.360619:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360625:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db535 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758393.360637:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000455d5df8 reply state 00000000cec12ecd transno 4294967704 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758393.360646:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758393.360684:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db52e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc1 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360698:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc1 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.360705:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758393.360707:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758393.360709:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758393.360784:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54377:x1869355196804608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 6881us (7117us total) trans 4294967704 rc 0/0 00000100:00100000:1.0:1782758393.360794:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1050 00010000:00010000:1.0:1782758393.367647:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367665:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367672:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367678:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758393.367683:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367691:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367709:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9171a0e3a300) 00010000:00010000:1.0:1782758393.367712:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758393.367716:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.367722:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db53c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758393.370276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.370440:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804864 00000100:00100000:3.0:1782758393.370450:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804864 00000100:00100000:3.0:1782758393.370516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1051 00000100:00100000:3.0:1782758393.370526:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54377:x1869355196804864:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:3.0:1782758393.370585:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758393.370611:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc1 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.370627:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:3.0:1782758393.370638:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758393.370678:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.370692:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.370701:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758393.370849:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d315aa48 reply state 0000000045126354 transno 4294967705 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758393.370858:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758393.370939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54377:x1869355196804864:12345-192.168.204.31@tcp:36:touch.0 Request processed in 414us (673us total) trans 4294967705 rc 0/0 00000100:00100000:3.0:1782758393.370946:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1051 00010000:00010000:1.0:1782758393.372988:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373013:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373027:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373033:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758393.373038:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373046:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373060:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75100) 00010000:00010000:1.0:1782758393.373063:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758393.373067:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758393.373073:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db551 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758393.375871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.376017:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196804992 00000100:00100000:3.0:1782758393.376027:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196804992 00000100:00100000:3.0:1782758393.376098:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1052 00000100:00100000:3.0:1782758393.376108:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54377:x1869355196804992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758393.376133:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758393.376158:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db558 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cc8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.376220:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db558 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc8 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.376233:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db558 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc8 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.376252:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758393.376255:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782758393.376259:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782758393.376312:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54377:x1869355196804992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 205us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758393.376319:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1052 00000100:00100000:0.0:1782758393.381897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758393.382037:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196805120 00000100:00100000:1.0:1782758393.382046:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196805120 00000100:00100000:1.0:1782758393.382091:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 576 00000100:00100000:1.0:1782758393.382100:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196805120:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:1.0:1782758393.382131:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2461 last 0 00000020:00000080:1.0:1782758393.382161:0:9120:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db55f 00002000:00100000:1.0:1782758393.382173:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917084d25000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782758393.382197:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782758393.382288:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782758393.382315:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917084d22800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758393.382397:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196805120:12345-192.168.204.31@tcp:8:touch.0 Request processed in 296us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758393.382405:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 576 00010000:00010000:3.0:1782758393.391808:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758393.401992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758393.402133:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196805248 00000100:00100000:2.0:1782758393.402142:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196805248 00000100:00100000:2.0:1782758393.402293:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 577 00000100:00100000:2.0:1782758393.402304:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196805248:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:3.0:1782758393.403778:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1782758393.509372:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:1.0:1782758393.509392:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00000001:00100000:1.0:1782758393.509400:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758393.509404:0:6622:0:(genops.c:906:class_export_put()) final put ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758393.509431:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917081af9000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:1.0:1782758393.509488:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081afc000 for lustre-OST0000 00000100:00100000:3.0:1782758393.509689:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196805248:12345-192.168.204.31@tcp:2:touch.0 Request processed in 107381us (107701us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782758393.509699:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 577 00000100:00100000:0.0:1782758393.512891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.513052:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196805504 00000100:00100000:3.0:1782758393.513063:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196805504 00000100:00100000:3.0:1782758393.513120:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 108 00000100:00100000:3.0:1782758393.513130:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54377:x1869355196805504:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782758393.513465:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:54377:x1869355196805504:12345-192.168.204.31@tcp:35:touch.0 Request processed in 335us (581us total) trans 4294967706 rc 0/0 00000100:00100000:3.0:1782758393.513473:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 108 00000100:00100000:1.0:1782758393.613072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.613393:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196805632 00000100:00100000:3.0:1782758393.613405:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196805632 00000100:00100000:3.0:1782758393.613468:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:3.0:1782758393.613488:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:54381:x1869355196805632:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758393.613512:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758393.613534:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ccf expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613600:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613614:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613626:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613640:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613647:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613653:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613763:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613773:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613780:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758393.613812:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x56:0x0]: returning size 0 00000004:00200000:3.0:1782758393.613816:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758393.613872:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613884:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613893:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613899:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613907:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613913:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.613917:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613925:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613937:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758393.613941:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.613945:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613952:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db56d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613970:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613977:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613983:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613989:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.613991:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.613998:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.614018:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75300) 00010000:00010000:3.0:1782758393.614021:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.614024:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.614030:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.614060:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ccf expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.614072:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ccf expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.614085:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758393.614099:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758393.614101:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758393.614153:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:54381:x1869355196805632:12345-192.168.204.31@tcp:101:rm.0 Request processed in 676us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758393.614161:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:1.0:1782758393.622651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758393.623443:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196805760 00000100:00100000:2.0:1782758393.623454:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196805760 00000100:00100000:2.0:1782758393.623529:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 578 00000100:00100000:2.0:1782758393.623540:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196805760:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758393.623558:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758393.623577:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cd6 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758393.623603:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x6a42bbf8, atime: 0x6a42bbf8, ctime: 0x6a42bbf8, blocks: 0x1 00010000:00010000:2.0:1782758393.623622:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=2462s v=(0 0) 00010000:00010000:2.0:1782758393.623626:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758393.623635:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758393.623653:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758393.623666:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758393.623727:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196805760:12345-192.168.204.31@tcp:101:rm.0 Request processed in 188us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758393.623737:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 578 00000100:00100000:0.0:1782758393.630882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758393.631100:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806016 00000100:00100000:3.0:1782758393.631110:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806016 00000100:00100000:3.0:1782758393.631174:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1054 00000100:00100000:3.0:1782758393.631184:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:54381:x1869355196806016:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758393.631237:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758393.631265:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db57b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ccf expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631287:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cc8 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631297:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758393.631307:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758393.631337:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631350:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631359:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631373:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631380:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631387:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631519:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631528:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.631534:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758393.632165:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:3.0:1782758393.632178:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2462035354558ns, next at 2463035351675ns, rc = 0 00010000:00010000:3.0:1782758393.632239:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632249:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632258:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632266:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632276:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632282:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632306:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758393.632326:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632333:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632339:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632344:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.632347:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632354:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632364:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758393.632366:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758393.632370:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632376:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db597 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632391:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632398:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632403:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632408:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.632411:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632416:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632423:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758393.632426:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.632429:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.632436:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758393.632445:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af33e0d8 reply state 0000000018771911 transno 4294967707 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758393.632454:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758393.632529:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:54381:x1869355196806016:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1344us (1655us total) trans 4294967707 rc 0/0 00000100:00100000:3.0:1782758393.632537:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1054 00010000:00010000:0.0:1782758393.633100:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758393.633107:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758393.633114:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758393.633117:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758393.633125:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758393.633135:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782758393.633137:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758393.633141:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758393.633146:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db59e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758393.633161:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758393.633163:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758393.633164:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758393.648512:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648535:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648542:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648548:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758393.648553:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648560:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648578:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75300) 00010000:00010000:3.0:1782758393.648581:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758393.648586:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758393.648591:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782758394.338260:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00000001:00080000:0.0:1782758394.338280:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967707 is committed 00000004:00080000:0.0:1782758394.338285:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000100:00100000:0.0:1782758394.338597:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211652864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758394.338667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758394.338818:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211652864 00000100:00100000:2.0:1782758394.338858:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211652864 00000100:00100000:2.0:1782758394.338913:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1782758394.338922:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211652864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782758394.338951:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:2.0:1782758394.338978:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758394.339009:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758394.339019:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758394.339023:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758394.339028:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758394.339054:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758394.339067:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 5 pid: 9120 timeout: 2562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758394.339078:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211652992:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758394.339134:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041300 going to sleep for 11 seconds 00000100:00080000:3.0:1782758394.339187:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758394.348954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758394.348965:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211652992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782758394.349003:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758394.349056:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806144 00000100:00100000:3.0:1782758394.349065:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806144 00010000:00010000:3.0:1782758394.349102:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 2562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758394.349138:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 424 00000100:00100000:3.0:1782758394.349146:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196806144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758394.349163:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758394.349167:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 2562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758394.349178:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 2562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758394.349200:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2680af1/0xdd99f5c4777db582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cd6 expref: 6 pid: 9120 timeout: 2562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758394.349213:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758394.349217:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758394.349223:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758394.349237:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758394.349273:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758394.349332:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196806144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 184us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758394.349340:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 424 00010000:00010000:1.0:1782758394.349532:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.349542:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.349551:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.349558:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.349574:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758394.350158:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211652864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11236us (11489us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1782758394.350167:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00010000:00010000:1.0:1782758394.350192:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758394.350198:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.350207:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758394.350211:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.350221:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.350234:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.350241:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777db5a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758394.350256:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758394.350258:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758394.350260:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758394.350289:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082208e00/2, rc 0, transno 4294967363 00000100:00100000:1.0:1782758394.350296:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211652864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782758394.412464:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758394.796074:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758394.796096:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211653120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758394.796163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758394.796291:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653120 00000100:00100000:0.0:1782758394.796310:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653120 00000100:00100000:0.0:1782758394.796362:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1782758394.796371:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211653120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758394.796409:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758394.796462:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211653120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758394.796469:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1782758394.796514:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211653120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758395.436770:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758395.812763:0:92870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeecbfb160 20000000:00000080:1.0:1782758395.812782:0:92870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3611000 uarg=0000000000000000 00010000:00010000:1.0:1782758395.814578:0:92870:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758395.814618:0:92870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758395.814623:0:92870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758395.814634:0:92870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cba expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.814659:0:92870:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782758395.814676:0:92870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758395.814690:0:92870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.814703:0:92870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.814713:0:92870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.814749:0:92870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.814763:0:92870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 18 pid: 5793 timeout: 2564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758395.814779:0:92870:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92870:1869355211653248:0@lo:104: 00000100:00100000:1.0:1782758395.815104:0:92870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758395.815170:0:92870:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46300 going to sleep for 11 seconds 00000100:00100000:3.0:1782758395.815300:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653248 00000100:00100000:3.0:1782758395.815308:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653248 00000100:00100000:3.0:1782758395.815363:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1782758395.815374:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92870:x1869355211653248:12345-0@lo:104: 00010000:00010000:3.0:1782758395.815392:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758395.815475:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758395.815481:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:92870:x1869355211653248:12345-0@lo:104: Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758395.815489:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00010000:0.0:1782758395.815608:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758395.815615:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758395.815623:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758395.815627:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758395.815636:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758395.815642:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758395.815648:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758395.815685:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758395.815692:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758395.815715:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758395.815721:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777db504 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db50b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758395.815737:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758395.815739:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758395.815740:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758395.815753:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211653376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758395.815784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758395.815953:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653376 00000100:00100000:2.0:1782758395.815968:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653376 00010000:00010000:2.0:1782758395.815992:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 19 pid: 5793 timeout: 2564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758395.816025:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1782758395.816033:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211653376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758395.816044:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758395.816049:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 19 pid: 5793 timeout: 2564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816060:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 19 pid: 5793 timeout: 2564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816076:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816084:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816098:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816106:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816113:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816124:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816130:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758395.816134:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816141:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816150:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758395.816160:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758395.816195:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211653376:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758395.816202:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1782758395.816238:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211653376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758395.816421:0:92870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db50b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db504 expref: 18 pid: 5793 timeout: 2564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758395.816448:0:92870:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92870:1869355211653248:0@lo:104: 00010000:00010000:1.0:1782758395.816465:0:92870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.816474:0:92870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.816481:0:92870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758395.816487:0:92870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db5ac lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1782758395.888906:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758395.888919:0:7507:0:(genops.c:906:class_export_put()) final put ffff917084d25800/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:0.0:1782758395.890558:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d25800/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:0.0:1782758395.890625:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d27800 for lustre-OST0001 00000100:00100000:2.0:1782758396.085738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758396.085785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758396.085882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758396.085915:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806528 00000100:00100000:2.0:1782758396.085924:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806528 00000100:00100000:2.0:1782758396.085996:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1357 00000100:00100000:2.0:1782758396.086006:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196806528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758396.086037:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806272 00000100:00100000:3.0:1782758396.086043:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806272 00000100:00100000:3.0:1782758396.086078:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1356 00000100:00100000:3.0:1782758396.086086:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196806272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758396.086095:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196806528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758396.086107:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1357 00000100:00100000:3.0:1782758396.086121:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196806272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758396.086129:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1356 00000100:00080000:3.0:1782758396.086160:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758396.086262:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806400 00000100:00100000:1.0:1782758396.086267:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806400 00000100:00100000:1.0:1782758396.086322:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1760 00000100:00100000:1.0:1782758396.086331:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196806400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758396.086370:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196806400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758396.086377:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1760 00000100:00080000:3.0:1782758396.086425:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758396.459990:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758396.844025:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211653504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.844109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758396.845464:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758396.845478:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211653632:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.845536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758396.845593:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653504 00000100:00100000:1.0:1782758396.845601:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653504 00000100:00100000:1.0:1782758396.845651:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1782758396.845659:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211653504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.845710:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211653504:12345-0@lo:400:kworker.0 Request processed in 51us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758396.845948:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211653760:0@lo:400:kworker.0 00000100:00100000:0.0:1782758396.845982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758396.846009:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758396.846015:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211653888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758396.846040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758396.846067:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653632 00000100:00100000:0.0:1782758396.846073:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653632 00000100:00100000:0.0:1782758396.846103:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653760 00000100:00100000:0.0:1782758396.846105:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653760 00000100:00100000:0.0:1782758396.846132:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1782758396.846139:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211653632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758396.846186:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211653632:12345-0@lo:400:kworker.0 Request processed in 47us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758396.846192:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1782758396.846209:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1782758396.846215:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211653760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758396.846246:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211653760:12345-0@lo:400:kworker.0 Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758396.846252:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:1.0:1782758396.846407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1782758396.846446:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211654144:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.846472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758396.846490:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758396.846495:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211654016:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.846516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758396.846548:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654016 00000100:00100000:1.0:1782758396.846552:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654016 00000100:00100000:1.0:1782758396.846572:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:1.0:1782758396.846577:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.846610:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211654016:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758396.846616:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:1.0:1782758396.846640:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211653888 00000100:00100000:1.0:1782758396.846644:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211653888 00000100:00100000:1.0:1782758396.846666:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654144 00000100:00100000:1.0:1782758396.846669:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654144 00000100:00100000:1.0:1782758396.846689:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1782758396.846694:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211653888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.846730:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211653888:12345-0@lo:400:kworker.0 Request processed in 36us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758396.846736:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1782758396.846747:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1782758396.846752:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211654144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.846779:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211654144:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758396.846785:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00080000:0.0:1782758396.847000:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758396.847004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758396.847007:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758396.847035:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211653888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758396.847047:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211653760:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.847111:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211654016:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.847124:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211654144:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.847154:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211653632:0@lo:400:kworker.0 00000100:00100000:1.0:1782758396.847164:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211653504:0@lo:400:kworker.0 10000000:01000000:3.0:1782758397.291970:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758397.291979:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758397.291984:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758397.292039:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758397.292052:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758397.292063:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758397.292087:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211654272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758397.292159:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758397.292316:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758397.295405:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654272 00000100:00100000:0.0:1782758397.295421:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654272 00000100:00100000:1.0:1782758397.299191:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1782758397.299206:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211654272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758397.299225:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758397.299259:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db5b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758397.299289:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758397.299300:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758397.299309:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758397.299402:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211654272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (7242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758397.299410:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1782758397.299505:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211654272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758397.299525:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758397.299534:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758397.299554:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758397.299558:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758397.299565:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758397.356106:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211654400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758397.356185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758397.356694:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654400 00000100:00100000:0.0:1782758397.356702:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654400 00000100:00100000:0.0:1782758397.356753:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1782758397.356763:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211654400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758397.356881:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758397.356992:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211654400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758397.357000:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1782758397.358023:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211654400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758397.486595:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758398.509577:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758398.945486:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00000100:00100000:1.0:1782758399.500437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758399.500512:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806656 00000100:00100000:3.0:1782758399.500524:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806656 00000100:00100000:3.0:1782758399.500593:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1055 00000100:00100000:3.0:1782758399.500604:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54469:x1869355196806656:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758399.500626:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758399.500651:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cdd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.500718:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.500732:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.500746:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758399.501008:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758399.501012:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:1.0:1782758399.501197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1782758399.501225:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.501257:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cdd expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.501294:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cdd expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758399.501304:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782758399.501307:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758399.501311:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758399.501411:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54469:x1869355196806656:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 807us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758399.501419:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1055 00000100:00100000:3.0:1782758399.515235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758399.515318:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196806912 00000100:00100000:1.0:1782758399.515327:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196806912 00000100:00100000:1.0:1782758399.515387:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1056 00000100:00100000:1.0:1782758399.515397:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54469:x1869355196806912:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758399.515447:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758399.515474:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db5c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cdd expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.515499:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db527) 00010000:00010000:1.0:1782758399.515503:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782758399.515513:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758399.515535:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.515547:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.515556:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758399.541691:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758399.614675:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00000004:00010000:1.0:1782758399.616032:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6caf89e reply state 00000000744491ae transno 4294967708 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758399.616048:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758399.616356:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:1.0:1782758399.616457:0:5802:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758399.616475:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54469:x1869355196806912:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 101075us (101245us total) trans 4294967708 rc 0/0 00000100:00100000:1.0:1782758399.616484:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1056 00010000:00010000:1.0:1782758399.616523:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616531:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616539:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616544:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758399.616549:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616557:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616575:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3a600) 00010000:00010000:1.0:1782758399.616578:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758399.616582:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758399.616592:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db5cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758399.916718:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211654528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758399.916796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758399.916861:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654528 00000100:00100000:2.0:1782758399.916869:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654528 00000100:00100000:2.0:1782758399.916932:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1782758399.916942:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211654528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758399.916979:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758399.917027:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211654528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758399.917033:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1782758399.917399:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:0.0:1782758399.917405:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082208e00, transno 4294967363 00000100:00100000:0.0:1782758399.917424:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211654528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758399.917570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782758400.419330:0:93069:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff61b50ce0 20000000:00000080:0.0:1782758400.419347:0:93069:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2d12400 uarg=0000000000000000 00010000:00010000:0.0:1782758400.419796:0:93069:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758400.419813:0:93069:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758400.419860:0:93069:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758400.419888:0:93069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758400.419906:0:93069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758400.419915:0:93069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758400.419949:0:93069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758400.419962:0:93069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 18 pid: 5794 timeout: 2568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758400.419975:0:93069:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93069:1869355211654656:0@lo:104: 00000100:00100000:0.0:1782758400.420036:0:93069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758400.420094:0:93069:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448240 going to sleep for 11 seconds 00000100:00100000:1.0:1782758400.420400:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782758400.420412:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654656 00000100:00100000:1.0:1782758400.420417:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654656 00000100:00100000:1.0:1782758400.420468:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1782758400.420476:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93069:x1869355211654656:12345-0@lo:104: 00010000:00010000:1.0:1782758400.420489:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420536:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758400.420543:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93069:x1869355211654656:12345-0@lo:104: Request processed in 67us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758400.420549:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:1.0:1782758400.420596:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758400.420602:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420609:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758400.420613:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420621:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758400.420628:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758400.420634:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758400.420659:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420665:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758400.420680:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420687:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690e00/0xdd99f5c4777db5b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758400.420700:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758400.420702:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758400.420703:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758400.420713:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211654784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758400.420738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758400.420890:0:93069:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93069:1869355211654656:0@lo:104: 00010000:00010000:2.0:1782758400.420908:0:93069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758400.421344:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654784 00000100:00100000:3.0:1782758400.421349:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654784 00010000:00010000:3.0:1782758400.421423:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 2568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758400.421482:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1782758400.421489:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211654784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758400.421500:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758400.421505:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 2568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421515:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 2568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421528:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777db5ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db5b3 expref: 19 pid: 5794 timeout: 2568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421539:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421548:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421560:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421566:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421574:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421580:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421586:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758400.421590:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421602:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421621:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758400.421634:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758400.421671:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211654784:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758400.421678:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1782758400.421723:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211654784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758400.421849:0:93069:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758400.421857:0:93069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758400.421864:0:93069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db5d6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758400.557985:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758401.217868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758401.217905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758401.218340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758401.218371:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807168 00000100:00100000:2.0:1782758401.218380:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807168 00000100:00100000:2.0:1782758401.218447:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1764 00000100:00100000:2.0:1782758401.218458:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196807168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758401.218537:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196807168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758401.218546:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1764 00000100:00080000:2.0:1782758401.218570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758401.218847:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807296 00000100:00100000:0.0:1782758401.218861:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807296 00000100:00100000:0.0:1782758401.218897:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1360 00000100:00100000:0.0:1782758401.218905:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196807296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758401.218936:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196807296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758401.219350:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1360 00000100:00100000:1.0:1782758401.219351:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807040 00000100:00100000:1.0:1782758401.219355:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807040 00000100:00100000:1.0:1782758401.219389:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1359 00000100:00100000:1.0:1782758401.219397:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196807040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758401.219428:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196807040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758401.219435:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1359 00000100:00080000:2.0:1782758401.220332:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758401.582448:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758401.708455:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758401.708472:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758401.708477:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758401.708530:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758401.708543:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758401.708553:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758401.708578:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211654912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758401.708646:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758401.708797:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211654912 00000100:00100000:1.0:1782758401.708804:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211654912 00000100:00100000:1.0:1782758401.708888:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1782758401.708897:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211654912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758401.708910:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758401.708936:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db5dd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758401.708959:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758401.708971:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758401.708979:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758401.709014:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211654912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758401.709020:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:2.0:1782758401.709236:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1782758401.709259:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708220ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211654912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758401.709274:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758401.709287:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758401.709359:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758401.709365:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758401.709372:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758401.966040:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211655168:0@lo:400:kworker.0 00000100:00100000:3.0:1782758401.966118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758401.966202:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758401.966208:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211655296:0@lo:400:kworker.0 00000100:00100000:3.0:1782758401.966235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758401.966264:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655168 00000100:00100000:3.0:1782758401.966271:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655168 00000100:00100000:3.0:1782758401.966552:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:3.0:1782758401.966563:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758401.966617:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211655168:12345-0@lo:400:kworker.0 Request processed in 56us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758401.966624:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:3.0:1782758401.966649:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655296 00000100:00100000:3.0:1782758401.966652:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655296 00000100:00100000:3.0:1782758401.966678:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1782758401.966683:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211655296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758401.966711:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211655296:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758401.966717:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00080000:3.0:1782758401.966730:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758401.966734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758401.966766:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211655296:0@lo:400:kworker.0 00000100:00100000:3.0:1782758401.966777:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211655168:0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967089:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211655424:0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758401.967411:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758401.967417:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211655040:0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758401.967458:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211655552:0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758401.967498:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655424 00000100:00100000:2.0:1782758401.967502:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655424 00000100:00100000:2.0:1782758401.967534:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655040 00000100:00100000:2.0:1782758401.967537:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655040 00000100:00100000:2.0:1782758401.967552:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:2.0:1782758401.967557:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211655424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967595:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211655424:12345-0@lo:400:kworker.0 Request processed in 37us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758401.967602:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:2.0:1782758401.967614:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1782758401.967620:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211655040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967646:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211655040:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758401.967653:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1782758401.967678:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211655040:0@lo:400:kworker.0 00000100:00100000:2.0:1782758401.967688:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211655424:0@lo:400:kworker.0 00000100:00080000:3.0:1782758401.967758:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758401.967860:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655552 00000100:00100000:0.0:1782758401.967864:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655552 00000100:00100000:0.0:1782758401.967895:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1782758401.967903:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211655552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758401.967959:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211655552:12345-0@lo:400:kworker.0 Request processed in 57us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758401.967965:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1782758401.967989:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211655552:0@lo:400:kworker.0 00000100:00080000:3.0:1782758401.969385:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758402.476982:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758402.477004:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211655680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758402.477070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758402.477299:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655680 00000100:00100000:3.0:1782758402.477308:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655680 00000100:00100000:3.0:1782758402.477362:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1782758402.477371:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211655680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758402.477406:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758402.477453:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211655680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758402.477459:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1782758402.477504:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211655680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758402.612553:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758403.631155:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758404.093369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758404.093611:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807424 00000100:00100000:3.0:1782758404.093621:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807424 00000100:00100000:3.0:1782758404.093702:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:3.0:1782758404.093714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54546:x1869355196807424:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758404.093749:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758404.093784:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ce4 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093881:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093894:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093907:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093919:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093925:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.093932:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.094372:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.094381:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.094389:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782758404.094723:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1782758404.095004:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758404.095010:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758404.095095:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095281:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095290:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095297:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095303:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758404.095307:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095315:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095329:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782758404.095332:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758404.095338:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095344:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db5f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095370:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095377:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095382:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095388:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758404.095392:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095397:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095404:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75400) 00010000:00010000:3.0:1782758404.095406:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758404.095409:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095415:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db5f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095577:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ce4 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095598:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ce4 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.095606:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758404.095608:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758404.095611:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758404.097993:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807424:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4271us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758404.098006:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:0.0:1782758404.104627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758404.106951:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807680 00000100:00100000:3.0:1782758404.106968:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807680 00000100:00100000:3.0:1782758404.107044:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:3.0:1782758404.107056:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807680:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758404.107083:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758404.107355:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db607 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ceb expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108261:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108277:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108288:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108302:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108309:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.108315:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758404.109977:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00010000:1.0:1782758404.115093:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115244:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115254:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115260:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.115264:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115272:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115290:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.115293:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.115298:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115304:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db60e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115330:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115336:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115342:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115348:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.115350:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115356:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115363:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75300) 00010000:00010000:1.0:1782758404.115365:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.115368:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115374:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115438:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db607 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ceb expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115525:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.115528:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.115532:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db607 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ceb expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.115544:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:1.0:1782758404.116061:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807680:12345-192.168.204.31@tcp:101:touch.0 Request processed in 9004us (11440us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758404.116072:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:3.0:1782758404.121630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758404.121696:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807808 00000100:00100000:1.0:1782758404.121706:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807808 00000100:00100000:1.0:1782758404.121773:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00100000:1.0:1782758404.121802:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807808:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758404.121837:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758404.121858:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db61c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cf2 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121924:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121938:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121949:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121963:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121970:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.121976:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122182:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122190:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122196:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122202:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.122206:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122212:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122224:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.122227:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.122231:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122237:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777db623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122249:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122255:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122261:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122266:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.122269:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122275:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122281:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9171a0e3a900) 00010000:00010000:1.0:1782758404.122283:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.122286:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122291:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db62a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122324:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db61c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cf2 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122334:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.122336:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.122340:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db61c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cf2 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.122350:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758404.125639:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807808:12345-192.168.204.31@tcp:101:touch.0 Request processed in 3834us (4006us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758404.125652:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00100000:2.0:1782758404.131376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758404.131530:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196807936 00000100:00100000:3.0:1782758404.131541:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196807936 00000100:00100000:3.0:1782758404.131600:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1060 00000100:00100000:3.0:1782758404.131610:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807936:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758404.131633:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758404.131653:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64cf9 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.131735:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.131750:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.131762:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.131776:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.132038:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758404.132046:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132287:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132295:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132303:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132309:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.132313:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132320:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132332:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.132335:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.132339:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132345:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132369:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132376:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132382:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132387:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758404.132389:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132394:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132401:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75500) 00010000:00010000:1.0:1782758404.132403:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.132406:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132411:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db63f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132640:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db631 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cf9 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132651:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758404.132654:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758404.132658:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777db631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64cf9 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758404.132677:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:1.0:1782758404.132758:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54546:x1869355196807936:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1148us (1389us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758404.132768:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1060 00010000:00010000:2.0:1782758404.661153:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758405.042665:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758405.042689:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211655808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758405.042950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758405.043017:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655808 00000100:00100000:1.0:1782758405.043025:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655808 00000100:00100000:1.0:1782758405.043074:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1782758405.043083:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211655808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758405.047548:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758405.047642:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211655808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4557us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758405.047653:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00080000:1.0:1782758405.047691:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758405.047735:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211655808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758405.676015:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758406.245734:0:93317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5b77ecf0 20000000:00000080:3.0:1782758406.245751:0:93317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917183838400 uarg=0000000000000000 00010000:00010000:3.0:1782758406.248496:0:93317:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758406.248549:0:93317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758406.248554:0:93317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758406.248567:0:93317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ce4 expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758406.248605:0:93317:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758406.248628:0:93317:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758406.248643:0:93317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758406.248657:0:93317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758406.248666:0:93317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758406.248702:0:93317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758406.248715:0:93317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 18 pid: 5794 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758406.248730:0:93317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93317:1869355211655936:0@lo:104: 00000100:00100000:3.0:1782758406.248802:0:93317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758406.248954:0:93317:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b586240 going to sleep for 11 seconds 00000100:00100000:2.0:1782758406.249049:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211655936 00000100:00100000:2.0:1782758406.249057:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211655936 00000100:00100000:2.0:1782758406.253706:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782758406.253726:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93317:x1869355211655936:12345-0@lo:104: 00010000:00010000:2.0:1782758406.253745:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758406.254209:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758406.254218:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93317:x1869355211655936:12345-0@lo:104: Request processed in 501us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758406.254232:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:0.0:1782758406.254293:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758406.254299:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.254308:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758406.254312:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.254321:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758406.254329:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758406.254335:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758406.254379:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.254385:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758406.254407:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255224:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db5dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db5e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255243:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758406.255245:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758406.255247:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758406.255264:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211656064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758406.255316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758406.255385:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656064 00000100:00100000:0.0:1782758406.255392:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656064 00010000:00010000:0.0:1782758406.255420:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 19 pid: 5794 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758406.255447:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1782758406.255455:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211656064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758406.255467:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758406.255473:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 19 pid: 5794 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255484:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 19 pid: 5794 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255502:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255511:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255528:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255535:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255542:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255549:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255556:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758406.255560:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255568:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255577:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758406.255586:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758406.255617:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211656064:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758406.255624:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1782758406.255661:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211656064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758406.258018:0:93317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777db5e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db5dd expref: 18 pid: 5794 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758406.258037:0:93317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93317:1869355211655936:0@lo:104: 00010000:00010000:3.0:1782758406.258062:0:93317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758406.261358:0:93317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758406.261375:0:93317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758406.261383:0:93317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db646 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758406.333336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758406.333381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758406.333411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758406.333444:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808320 00000100:00100000:3.0:1782758406.333455:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808320 00000100:00100000:3.0:1782758406.333527:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1363 00000100:00100000:3.0:1782758406.333538:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196808320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758406.333612:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196808320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758406.333620:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1363 00000100:00100000:1.0:1782758406.333890:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808192 00000100:00100000:1.0:1782758406.333895:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808192 00000100:00100000:1.0:1782758406.333930:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1768 00000100:00100000:1.0:1782758406.333939:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196808192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758406.333973:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196808192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758406.333980:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1768 00000100:00100000:1.0:1782758406.334002:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808064 00000100:00100000:1.0:1782758406.334006:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808064 00000100:00100000:1.0:1782758406.334028:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1361 00000100:00100000:1.0:1782758406.334034:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196808064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758406.334058:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196808064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758406.334064:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1361 00000100:00080000:1.0:1782758406.334096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758406.334100:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758406.700018:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758407.085912:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211656576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086134:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758407.086141:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211656192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086200:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211656704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086262:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211656320:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086307:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211656832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758407.086352:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211656448:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.086410:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656576 00000100:00100000:2.0:1782758407.086418:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656576 00000100:00100000:2.0:1782758407.086483:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656832 00000100:00100000:2.0:1782758407.086487:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656832 00000100:00100000:2.0:1782758407.086514:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1782758407.086524:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211656576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086584:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211656576:12345-0@lo:400:kworker.0 Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758407.086592:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1782758407.086610:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1782758407.086616:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211656832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086646:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211656832:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758407.086652:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1782758407.086669:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656192 00000100:00100000:2.0:1782758407.086672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656192 00000100:00100000:2.0:1782758407.086698:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1782758407.086703:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211656192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.086731:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211656192:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758407.086795:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656704 00000100:00100000:0.0:1782758407.086800:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656704 00000100:00100000:0.0:1782758407.086856:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656320 00000100:00100000:0.0:1782758407.086860:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656320 00000100:00100000:0.0:1782758407.086880:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656448 00000100:00100000:0.0:1782758407.086883:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656448 00000100:00100000:0.0:1782758407.086898:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:0.0:1782758407.086905:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211656704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758407.086947:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211656704:12345-0@lo:400:kworker.0 Request processed in 42us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758407.086954:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:0.0:1782758407.086968:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:0.0:1782758407.086974:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211656320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758407.087005:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211656320:12345-0@lo:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758407.087011:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:0.0:1782758407.087021:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:0.0:1782758407.087026:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211656448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758407.087052:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211656448:12345-0@lo:400:kworker.0 Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758407.087059:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:2.0:1782758407.088938:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00080000:2.0:1782758407.089026:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758407.089035:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758407.089039:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758407.089261:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211656448:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.089279:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211656320:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.089292:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211656832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.089346:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211656192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.089359:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211656704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.089368:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211656576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758407.598165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758407.598196:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211656960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758407.598299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758407.598382:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211656960 00000100:00100000:2.0:1782758407.598394:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211656960 00000100:00100000:2.0:1782758407.598452:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1782758407.598462:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211656960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758407.598509:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758407.598565:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211656960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758407.598573:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1782758407.598631:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211656960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758407.726240:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758408.109560:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758408.109572:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758408.109579:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758408.109654:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758408.109668:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758408.109682:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758408.109728:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211657088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758408.109848:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758408.109916:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758408.110947:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657088 00000100:00100000:1.0:1782758408.110960:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657088 00000100:00100000:1.0:1782758408.111039:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1782758408.111051:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211657088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758408.111071:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758408.111209:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db64d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758408.111244:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758408.111257:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758408.111268:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758408.111344:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211657088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758408.111351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1782758408.112907:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211657088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758408.112938:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758408.112951:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758408.112980:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758408.112987:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758408.112995:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758408.758282:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758409.772017:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758410.159793:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758410.159814:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758410.159903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758410.160138:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657216 00000100:00100000:1.0:1782758410.160146:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657216 00000100:00100000:1.0:1782758410.160204:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1782758410.160214:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211657216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758410.160248:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758410.160296:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211657216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758410.160303:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00080000:2.0:1782758410.160342:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758410.160384:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758410.552346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758410.552529:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808448 00000100:00100000:0.0:1782758410.552540:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808448 00000100:00100000:0.0:1782758410.552622:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1061 00000100:00100000:0.0:1782758410.552633:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54633:x1869355196808448:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758410.552659:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758410.552704:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777db65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d00 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.552780:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.552794:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.552806:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758410.553044:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:0.0:1782758410.553048:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758410.553126:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.553156:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777db65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d00 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.553175:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d00 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.553185:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758410.553188:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758410.553191:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782758410.553245:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54633:x1869355196808448:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 614us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758410.553252:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1061 00000100:00080000:1.0:1782758410.553695:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758410.556437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758410.556530:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808704 00000100:00100000:0.0:1782758410.556539:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808704 00000100:00100000:0.0:1782758410.556589:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1062 00000100:00100000:0.0:1782758410.556600:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54633:x1869355196808704:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758410.556666:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758410.556974:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777db662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d00 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.556989:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db600) 00010000:00010000:0.0:1782758410.556994:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758410.557007:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758410.557033:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.557046:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758410.557058:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758410.557729:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005820c249 reply state 00000000a048abeb transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758410.557741:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758410.557815:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:0.0:1782758410.559612:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54633:x1869355196808704:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 3006us (3241us total) trans 4294967709 rc 0/0 00000100:00100000:0.0:1782758410.559623:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1062 00010000:00010000:2.0:1782758410.569784:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569802:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569850:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569858:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758410.569863:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569872:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569894:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:2.0:1782758410.569897:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758410.569902:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758410.569909:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758410.796610:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758411.445069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758411.445127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758411.445179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758411.445646:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809088 00000100:00100000:0.0:1782758411.445665:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809088 00000100:00100000:0.0:1782758411.445737:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1366 00000100:00080000:3.0:1782758411.445744:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758411.445748:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196809088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758411.445805:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808832 00000100:00100000:1.0:1782758411.445810:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808832 00000100:00100000:0.0:1782758411.445859:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196809088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 113us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758411.445867:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1366 00000100:00100000:1.0:1782758411.445871:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1364 00000100:00100000:1.0:1782758411.445877:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196808832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758411.445906:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196808832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758411.445912:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1364 00000100:00100000:2.0:1782758411.447090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196808960 00000100:00100000:2.0:1782758411.447097:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196808960 00000100:00100000:2.0:1782758411.447158:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1772 00000100:00100000:2.0:1782758411.447167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196808960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758411.447215:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196808960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758411.447221:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1772 00000020:00000080:3.0:1782758411.720674:0:93514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffea7abe30 20000000:00000080:3.0:1782758411.720698:0:93514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a1400 uarg=0000000000000000 00010000:00010000:3.0:1782758411.722485:0:93514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758411.722506:0:93514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758411.722522:0:93514:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758411.722540:0:93514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.722558:0:93514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.722567:0:93514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.722610:0:93514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.722629:0:93514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 18 pid: 5794 timeout: 2580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758411.722644:0:93514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93514:1869355211657344:0@lo:104: 00000100:00100000:3.0:1782758411.722720:0:93514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758411.722775:0:93514:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b697cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758411.723142:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657344 00000100:00100000:0.0:1782758411.723150:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657344 00000100:00100000:0.0:1782758411.723200:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1782758411.723208:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93514:x1869355211657344:12345-0@lo:104: 00010000:00010000:0.0:1782758411.723220:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758411.723288:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758411.723294:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:93514:x1869355211657344:12345-0@lo:104: Request processed in 88us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758411.723302:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00010000:1.0:1782758411.723456:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758411.723463:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723477:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758411.723481:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723490:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758411.723497:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758411.723503:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758411.723544:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723550:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758411.723572:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723578:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db64d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db654 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723594:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758411.723596:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758411.723597:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758411.723606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758411.723615:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211657472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758411.723658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758411.723697:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657472 00000100:00100000:1.0:1782758411.723701:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657472 00010000:00010000:1.0:1782758411.723724:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 19 pid: 5794 timeout: 2580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758411.723748:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1782758411.723755:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211657472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758411.723766:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758411.723771:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 19 pid: 5794 timeout: 2580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723781:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 19 pid: 5794 timeout: 2580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723797:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723806:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723819:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723873:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723880:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723886:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723891:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758411.723896:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723903:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723911:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758411.723922:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758411.723953:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211657472:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758411.724136:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1782758411.724184:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211657472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758411.724478:0:93514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db654 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db64d expref: 18 pid: 5794 timeout: 2580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758411.724489:0:93514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93514:1869355211657344:0@lo:104: 00010000:00010000:3.0:1782758411.724505:0:93514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.724514:0:93514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.724520:0:93514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.724526:0:93514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db670 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758411.837291:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758412.205405:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211657600:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758412.205556:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211658112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758412.205610:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758412.205616:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211657728:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758412.205680:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211657984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758412.205721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758412.205726:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211657856:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758412.205779:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658112 00000100:00100000:2.0:1782758412.205787:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658112 00000100:00100000:2.0:1782758412.205878:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657856 00000100:00100000:2.0:1782758412.205882:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657856 00000100:00100000:2.0:1782758412.205909:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1782758412.205917:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211658112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.205986:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211658112:12345-0@lo:400:kworker.0 Request processed in 69us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758412.205994:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1782758412.206009:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1782758412.206015:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211657856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.206047:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211657856:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758412.206052:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00080000:2.0:1782758412.206072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758412.206076:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758412.206103:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211657856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758412.206414:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657600 00000100:00100000:3.0:1782758412.206420:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657600 00000100:00100000:3.0:1782758412.206445:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657728 00000100:00100000:3.0:1782758412.206448:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657728 00000100:00100000:3.0:1782758412.206469:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211657984 00000100:00100000:3.0:1782758412.206473:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211657984 00000100:00100000:3.0:1782758412.206489:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:3.0:1782758412.206495:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758412.206537:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211657600:12345-0@lo:400:kworker.0 Request processed in 41us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758412.206543:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:3.0:1782758412.206556:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:3.0:1782758412.206563:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211657728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758412.206591:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211657728:12345-0@lo:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758412.206597:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:3.0:1782758412.206607:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:3.0:1782758412.206612:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211657984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758412.206654:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211657984:12345-0@lo:400:kworker.0 Request processed in 41us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758412.206660:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:2.0:1782758412.207244:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211658112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.207277:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211657728:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.207286:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211657600:0@lo:400:kworker.0 00000100:00080000:2.0:1782758412.207313:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758412.207332:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211657984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758412.717505:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211658240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758412.717585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758412.725609:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658240 00000100:00100000:1.0:1782758412.725624:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658240 00000100:00100000:1.0:1782758412.725696:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1782758412.725706:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211658240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758412.725747:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758412.725867:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211658240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (8281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758412.725874:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1782758412.726184:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211658240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758412.850794:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758412.979931:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758412.979943:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758412.979947:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758412.979995:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758412.980006:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758412.980017:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758412.980044:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211658368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758412.980117:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758412.980182:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782758412.980357:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658368 00000100:00100000:2.0:1782758412.980365:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658368 00000100:00100000:2.0:1782758412.980417:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1782758412.980426:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211658368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758412.980441:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758412.980454:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db677 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758412.980477:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758412.980488:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758412.980498:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758412.980543:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211658368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758412.980550:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1782758412.980849:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211658368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758412.980866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758412.980875:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758412.980894:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758412.980899:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758412.980926:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758413.878196:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758414.895953:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758415.290817:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758415.290863:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211658496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758415.290932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758415.290991:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658496 00000100:00100000:2.0:1782758415.290998:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658496 00000100:00100000:2.0:1782758415.291046:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1782758415.291053:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211658496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758415.291093:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758415.291137:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211658496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758415.291146:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:2.0:1782758415.291166:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758415.291197:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211658496:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782758415.382568:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967709 is committed 00010000:00010000:3.0:1782758415.918803:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758416.262434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758416.262533:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809216 00000100:00100000:3.0:1782758416.262544:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809216 00000100:00100000:3.0:1782758416.262642:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00100000:3.0:1782758416.262653:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809216:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758416.262765:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809216:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758416.262773:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00080000:2.0:1782758416.263452:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758416.268316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.268422:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809344 00000100:00100000:0.0:1782758416.268432:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809344 00000100:00100000:0.0:1782758416.268509:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:0.0:1782758416.268520:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809344:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758416.268944:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809344:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 424us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758416.268952:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00080000:2.0:1782758416.269175:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758416.277254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.277352:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809472 00000100:00100000:0.0:1782758416.277363:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809472 00000100:00100000:0.0:1782758416.277415:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00100000:0.0:1782758416.277423:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196809472:12345-192.168.204.31@tcp:8:lfs.0 00010000:00080000:0.0:1782758416.277458:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2484 last 0 00000020:00000080:0.0:1782758416.277493:0:6599:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db685 00002000:00100000:0.0:1782758416.277507:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff9171a93e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782758416.277531:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782758416.277775:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782758416.277806:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9171a93e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758416.278163:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196809472:12345-192.168.204.31@tcp:8:lfs.0 Request processed in 739us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758416.278172:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00100000:1.0:1782758416.290474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.290641:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809600 00000100:00100000:0.0:1782758416.290651:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809600 00000100:00100000:0.0:1782758416.290716:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:0.0:1782758416.290726:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54718:x1869355196809600:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758416.291118:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54718:x1869355196809600:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 392us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758416.291126:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:3.0:1782758416.293038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758416.293186:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809728 00000100:00100000:1.0:1782758416.293195:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809728 00000100:00100000:1.0:1782758416.293250:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00100000:1.0:1782758416.293260:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809728:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758416.293693:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809728:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 433us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758416.293701:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00080000:2.0:1782758416.294112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758416.300917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758416.300955:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809856 00000100:00100000:1.0:1782758416.300965:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809856 00000100:00100000:1.0:1782758416.301012:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1065 00000100:00100000:1.0:1782758416.301021:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809856:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758416.301114:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809856:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758416.301121:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1065 00000100:00100000:3.0:1782758416.308754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.308972:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196809984 00000100:00100000:0.0:1782758416.308982:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196809984 00000100:00100000:0.0:1782758416.309031:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:0.0:1782758416.309041:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809984:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758416.309450:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196809984:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 408us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758416.309458:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:3.0:1782758416.311705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758416.313304:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810112 00000100:00100000:2.0:1782758416.313318:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810112 00000100:00100000:2.0:1782758416.313383:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:2.0:1782758416.313393:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54718:x1869355196810112:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758416.313675:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54718:x1869355196810112:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 282us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758416.313683:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:1.0:1782758416.316393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758416.316493:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810240 00000100:00100000:2.0:1782758416.316502:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810240 00000100:00100000:2.0:1782758416.316565:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1066 00000100:00100000:2.0:1782758416.316575:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196810240:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758416.316969:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54718:x1869355196810240:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 394us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758416.316976:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1066 00000001:00100000:3.0:1782758416.382316:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:3.0:1782758416.442904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.443092:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810368 00000100:00100000:0.0:1782758416.443102:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810368 00000100:00100000:0.0:1782758416.443166:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1067 00000100:00100000:0.0:1782758416.443175:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54722:x1869355196810368:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782758416.443198:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758416.443223:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d07 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443284:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443296:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443308:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443320:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443326:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443333:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443763:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443772:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.443779:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758416.447733:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1782758416.447744:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758416.448357:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448377:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448384:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448392:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448397:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758416.448402:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448421:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448437:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfd000) 00010000:00010000:1.0:1782758416.448441:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758416.448444:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448450:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777db693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448462:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448467:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448471:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448476:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758416.448478:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448483:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448489:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff91718bcfd800) 00010000:00010000:1.0:1782758416.448491:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758416.448493:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448498:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777db69a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448534:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777db68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d07 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448547:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d07 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.448564:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:1.0:1782758416.448566:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758416.448568:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:1.0:1782758416.448644:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54722:x1869355196810368:12345-192.168.204.31@tcp:101:dd.0 Request processed in 5468us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758416.448653:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1067 00000100:00100000:3.0:1782758416.461744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.462161:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810624 00000100:00100000:0.0:1782758416.462171:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810624 00000100:00100000:0.0:1782758416.462235:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1068 00000100:00100000:0.0:1782758416.462245:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54722:x1869355196810624:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782758416.462265:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758416.462286:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db6a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d0e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462648:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462664:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462674:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462688:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462694:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.462700:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758416.469482:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:0.0:1782758416.471858:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.471896:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.471910:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475117:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475135:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475143:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475149:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758416.475155:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475163:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475181:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:0.0:1782758416.475183:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758416.475189:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475195:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777db6af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758416.475213:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b3ae9cf reply state 000000007e0cc8fd transno 4294967710 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758416.475224:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758416.475274:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777db6a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d0e expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475289:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d0e expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.475297:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758416.475299:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758416.475302:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758416.475788:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:54722:x1869355196810624:12345-192.168.204.31@tcp:101:dd.0 Request processed in 13542us (14052us total) trans 4294967710 rc 0/0 00000100:00100000:0.0:1782758416.475798:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1068 00010000:00010000:1.0:1782758416.494098:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494116:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494124:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494130:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758416.494135:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494146:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494163:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff91718bcfde00) 00010000:00010000:1.0:1782758416.494166:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758416.494171:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758416.494176:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db6b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758416.494469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.494535:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810752 00000100:00100000:0.0:1782758416.494545:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810752 00000100:00100000:0.0:1782758416.494608:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:0.0:1782758416.494617:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54722:x1869355196810752:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782758416.494635:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758416.494653:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d15 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758416.494678:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782758416.494697:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=2484s v=(0 0) 00010000:00010000:0.0:1782758416.494702:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758416.494711:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.494734:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758416.494745:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758416.494804:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54722:x1869355196810752:12345-192.168.204.31@tcp:101:dd.0 Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758416.494811:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:2.0:1782758416.529218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.529312:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196810880 00000100:00100000:0.0:1782758416.529322:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196810880 00002000:00100000:0.0:1782758416.529374:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9171bdef5500 x1869355196810880/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:332/0 lens 488/0 e 0 to 0 dl 1782758427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782758416.529384:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171bdef5500 with x1869355196810880 ext(0->1048575) 00002000:00010000:0.0:1782758416.529390:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171bdef5500 00000100:00100000:0.0:1782758416.529429:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1782758416.529439:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196810880:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:0.0:1782758416.559221:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196810880:12345-192.168.204.31@tcp:4:dd.0 Request processed in 29771us (30001us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1782758416.559237:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00002000:00100000:0.0:1782758416.559250:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9171bdef5500 x1869355196810880/t4294967362(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:332/0 lens 488/448 e 0 to 0 dl 1782758427 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782758416.559261:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171bdef5500 with x1869355196810880 ext(0->1048575) 00002000:00010000:0.0:1782758416.559267:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171bdef5500 00000100:00100000:2.0:1782758416.567145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758416.569981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758416.574134:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811008 00000100:00100000:0.0:1782758416.574153:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811008 00000100:00100000:0.0:1782758416.574245:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1069 00000100:00100000:0.0:1782758416.574257:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54722:x1869355196811008:12345-192.168.204.31@tcp:44:dd.0 00000100:00100000:1.0:1782758416.584040:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811136 00000100:00100000:1.0:1782758416.584055:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811136 00000100:00100000:1.0:1782758416.584129:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1366 00000100:00100000:1.0:1782758416.584140:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196811136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758416.584224:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196811136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (17089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758416.584233:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1366 00000100:00100000:3.0:1782758416.659905:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54722:x1869355196811008:12345-192.168.204.31@tcp:44:dd.0 Request processed in 85638us (89926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758416.659920:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1069 00000001:00080000:1.0:1782758416.660509:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967710 is committed 00000100:00100000:3.0:1782758416.662239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758416.662319:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811264 00000100:00100000:2.0:1782758416.662328:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811264 00000100:00100000:2.0:1782758416.662381:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:2.0:1782758416.662392:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196811264:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:3.0:1782758416.724792:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196811264:12345-192.168.204.31@tcp:16:dd.0 Request processed in 62389us (62547us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758416.724809:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 586 00000001:00080000:3.0:1782758416.725499:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:0.0:1782758416.727577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758416.727894:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811520 00000100:00100000:3.0:1782758416.727904:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811520 00000100:00100000:3.0:1782758416.727963:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 109 00000100:00100000:3.0:1782758416.727973:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54722:x1869355196811520:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:3.0:1782758416.728441:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54722:x1869355196811520:12345-192.168.204.31@tcp:35:dd.0 Request processed in 467us (871us total) trans 4294967711 rc 0/0 00000100:00100000:3.0:1782758416.728450:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 109 00010000:00010000:1.0:1782758416.940145:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758417.332234:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211658624:0@lo:400:kworker.0 00000100:00100000:0.0:1782758417.332317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758417.332380:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211659136:0@lo:400:kworker.0 00000100:00100000:0.0:1782758417.332408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758417.332432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758417.332438:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211659008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758417.332464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758417.332505:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659008 00000100:00100000:0.0:1782758417.332512:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659008 00000100:00100000:0.0:1782758417.332588:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1782758417.332598:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211659008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758417.332649:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211659008:12345-0@lo:400:kworker.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758417.332656:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00080000:0.0:1782758417.332679:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758417.332715:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211659008:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.333086:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211658752:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.333118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758417.333148:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211659264:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.333172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758417.333187:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758417.333192:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211658880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.333212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758417.333461:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659136 00000100:00100000:1.0:1782758417.333466:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659136 00000100:00100000:1.0:1782758417.333504:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658752 00000100:00100000:1.0:1782758417.333507:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658752 00000100:00100000:1.0:1782758417.333544:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658880 00000100:00100000:1.0:1782758417.333548:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658880 00000100:00100000:1.0:1782758417.333565:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1782758417.333572:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211659136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758417.333619:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211659136:12345-0@lo:400:kworker.0 Request processed in 47us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758417.333626:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1782758417.333642:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1782758417.333648:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211658752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758417.333675:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211658752:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758417.333680:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1782758417.333689:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1782758417.333695:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211658880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758417.333720:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211658880:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758417.333726:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1782758417.333745:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659264 00000100:00100000:1.0:1782758417.333749:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659264 00000100:00100000:1.0:1782758417.333771:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1782758417.333778:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211659264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758417.334136:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211659264:12345-0@lo:400:kworker.0 Request processed in 67us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758417.334144:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1782758417.334333:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211659136:0@lo:400:kworker.0 00000100:00080000:3.0:1782758417.334415:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758417.334420:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758417.334439:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211658880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.334448:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211658752:0@lo:400:kworker.0 00000100:00100000:3.0:1782758417.334456:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211659264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758417.334861:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211658624 00000100:00100000:2.0:1782758417.334868:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211658624 00000100:00100000:2.0:1782758417.334909:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1782758417.334918:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758417.334975:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211658624:12345-0@lo:400:kworker.0 Request processed in 58us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758417.334981:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1782758417.335111:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211658624:0@lo:400:kworker.0 00000100:00100000:1.0:1782758417.845169:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211659392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758417.845259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758417.845429:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659392 00000100:00100000:2.0:1782758417.845448:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659392 00000100:00100000:2.0:1782758417.845521:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1782758417.845542:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211659392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758417.845581:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782758417.849075:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211659392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3535us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758417.849091:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1782758417.850652:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211659392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758417.977174:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758418.516357:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 00010000:00010000:3.0:1782758418.988081:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758419.983598:0:93763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2488386771815ns, next at 2463035351675ns, rc = 0 00000004:00080000:3.0:1782758419.983714:0:93763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2488386890668ns, next at 2420682570956ns, rc = 0 00000004:00080000:1.0:1782758419.994898:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00000004:00080000:1.0:1782758419.994923:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00010000:00010000:0.0:1782758420.013244:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758420.396182:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758420.396207:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211659520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758420.396288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758420.396756:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659520 00000100:00100000:2.0:1782758420.396765:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659520 00000100:00100000:2.0:1782758420.396863:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1782758420.396885:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211659520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758420.396923:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758420.397200:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211659520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 328us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758420.397208:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1782758420.397298:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211659520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758420.397374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758421.036234:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758421.667712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758421.667797:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811648 00000100:00100000:0.0:1782758421.667807:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811648 00000100:00100000:0.0:1782758421.667900:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1070 00000100:00100000:0.0:1782758421.667913:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196811648:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758421.668011:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196811648:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758421.668019:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1070 00000100:00080000:3.0:1782758421.668279:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758421.670525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758421.670960:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811776 00000100:00100000:2.0:1782758421.670970:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811776 00000100:00100000:2.0:1782758421.671036:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00100000:2.0:1782758421.671048:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54915:x1869355196811776:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758421.671425:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54915:x1869355196811776:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 378us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758421.671433:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00080000:3.0:1782758421.671541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758421.676657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758421.678780:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196811904 00000100:00100000:2.0:1782758421.678794:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196811904 00000100:00080000:0.0:1782758421.678860:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758421.678899:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:2.0:1782758421.678912:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54915:x1869355196811904:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758421.679314:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54915:x1869355196811904:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 404us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758421.679322:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:2.0:1782758421.685857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758421.691845:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812032 00000100:00100000:3.0:1782758421.691859:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812032 00000100:00100000:3.0:1782758421.691918:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1071 00000100:00100000:3.0:1782758421.691928:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812032:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758421.692302:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812032:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 374us (6454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758421.692310:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1071 00000100:00100000:3.0:1782758421.692413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758421.692494:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812160 00000100:00100000:3.0:1782758421.692499:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812160 00000100:00100000:3.0:1782758421.692525:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1368 00000100:00100000:3.0:1782758421.692531:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196812160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758421.692562:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196812160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758421.692567:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1368 00000100:00100000:3.0:1782758421.714488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758421.716920:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812288 00000100:00100000:1.0:1782758421.716933:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812288 00000100:00100000:1.0:1782758421.716992:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:1.0:1782758421.717002:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812288:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758421.717123:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812288:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 111us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758421.717131:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1072 00000100:00100000:2.0:1782758421.730615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758421.731238:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812416 00000100:00100000:0.0:1782758421.731249:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812416 00000100:00100000:0.0:1782758421.731301:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:0.0:1782758421.731310:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54915:x1869355196812416:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758421.731673:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:54915:x1869355196812416:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 363us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758421.731681:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:1.0:1782758421.742387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758421.742666:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812544 00000100:00100000:2.0:1782758421.742675:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812544 00000100:00100000:2.0:1782758421.742761:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:2.0:1782758421.743021:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54915:x1869355196812544:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758421.743551:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:54915:x1869355196812544:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 533us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758421.743560:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:1.0:1782758421.746265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758421.746355:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812672 00000100:00100000:0.0:1782758421.746366:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812672 00000100:00100000:0.0:1782758421.746467:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1073 00000100:00100000:0.0:1782758421.746478:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812672:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758421.746964:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54915:x1869355196812672:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 487us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758421.746972:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1073 00000100:00100000:1.0:1782758421.804799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758421.804923:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196812928 00000100:00100000:3.0:1782758421.804933:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196812928 00000100:00100000:3.0:1782758421.804991:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1074 00000100:00100000:3.0:1782758421.805002:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:54919:x1869355196812928:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758421.805061:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758421.805091:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777db6bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d0e expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805123:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:3.0:1782758421.805135:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758421.805157:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805170:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805181:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805195:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805202:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805208:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805598:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805606:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.805612:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758421.806544:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:3.0:1782758421.806556:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2490209732568ns, next at 2491209730297ns, rc = 0 00010000:00010000:3.0:1782758421.806651:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806663:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806671:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806680:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806686:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806691:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806709:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758421.806729:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806735:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806742:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806748:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758421.806752:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806760:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806770:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758421.806773:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758421.806777:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db6e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806800:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806805:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806811:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806816:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758421.806819:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806855:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806862:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782758421.806865:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758421.806869:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758421.806875:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777db6d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758421.806885:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ed4768b reply state 00000000ae4cd132 transno 4294967712 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758421.806895:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758421.806973:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:54919:x1869355196812928:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1970us (2182us total) trans 4294967712 rc 0/0 00000100:00100000:3.0:1782758421.806980:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1074 00010000:00010000:0.0:1782758421.807569:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758421.807577:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758421.807584:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758421.807587:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758421.807594:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758421.807604:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff917191f75b00) 00010000:00010000:0.0:1782758421.807606:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758421.807609:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758421.807615:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db6e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758421.807631:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758421.807633:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758421.807635:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758421.811849:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811869:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811882:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811888:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758421.811893:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811901:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811917:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75900) 00010000:00010000:2.0:1782758421.811920:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758421.811924:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758421.811930:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db6d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758422.060912:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758422.446567:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211659776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.446649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758422.446701:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211660288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.446727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758422.446749:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758422.446754:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211659904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.446862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758422.446898:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659776 00000100:00100000:2.0:1782758422.446906:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659776 00000100:00100000:2.0:1782758422.446948:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659904 00000100:00100000:2.0:1782758422.446952:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659904 00000100:00100000:2.0:1782758422.446985:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1782758422.446994:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211659776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.447050:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211659776:12345-0@lo:400:kworker.0 Request processed in 57us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758422.447058:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1782758422.447077:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:2.0:1782758422.447083:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211659904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.447112:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211659904:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758422.447117:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00080000:2.0:1782758422.447134:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758422.447167:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211659904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758422.447178:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211659776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447276:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211660032:0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758422.447330:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758422.447336:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211659648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758422.447380:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211660160:0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758422.447423:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211659648 00000100:00100000:1.0:1782758422.447427:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211659648 00000100:00100000:1.0:1782758422.447468:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1782758422.447475:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211659648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447511:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211659648:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758422.447520:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1782758422.447552:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660160 00000100:00100000:1.0:1782758422.447556:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660160 00000100:00100000:1.0:1782758422.447578:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1782758422.447583:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447609:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211660160:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758422.447615:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1782758422.447635:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211659648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758422.447644:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211660160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758422.447893:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660288 00000100:00100000:0.0:1782758422.447898:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660288 00000100:00100000:0.0:1782758422.447933:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660032 00000100:00100000:0.0:1782758422.447936:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660032 00000100:00100000:0.0:1782758422.447958:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1782758422.447964:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211660288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758422.448006:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211660288:12345-0@lo:400:kworker.0 Request processed in 43us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758422.448013:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1782758422.448025:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1782758422.448031:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211660032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758422.448061:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211660032:12345-0@lo:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758422.448067:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1782758422.448098:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211660288:0@lo:400:kworker.0 00000100:00100000:0.0:1782758422.448122:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211660032:0@lo:400:kworker.0 00000100:00080000:2.0:1782758422.448190:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758422.448194:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758422.448196:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1782758422.956868:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2491360041584ns, next at 2492359996764ns, rc = 0 00000100:00100000:0.0:1782758422.957051:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758422.957073:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211660416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758422.957152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758422.957205:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660416 00000100:00100000:3.0:1782758422.957213:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660416 00000100:00100000:3.0:1782758422.957267:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1782758422.957278:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211660416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758422.957316:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758422.957373:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211660416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758422.957381:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1782758422.957441:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211660416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758423.087854:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758423.981383:0:93908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2492384557825ns, next at 2463035351675ns, rc = 0 00000004:00080000:0.0:1782758423.981515:0:93908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2492384691748ns, next at 2492359996764ns, rc = 0 00000004:00080000:1.0:1782758424.100918:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000004:00080000:1.0:1782758424.100953:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00000004:00080000:1.0:1782758424.100969:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000001:00080000:1.0:1782758424.100980:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967712 is committed 00000004:00080000:1.0:1782758424.100985:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000100:00100000:1.0:1782758424.101196:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211660544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782758424.101276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758424.101340:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660544 00000100:00100000:2.0:1782758424.101348:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660544 00000100:00080000:1.0:1782758424.101391:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758424.101402:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1782758424.101423:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211660544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782758424.101452:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:2.0:1782758424.101476:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.101496:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.101511:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1782758424.101515:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758424.101519:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.101545:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.101557:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 5 pid: 6597 timeout: 2592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758424.101568:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211660672:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758424.101639:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171860676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758424.107858:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211660672:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758424.107888:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758424.108024:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758424.118979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758424.121415:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813056 00000100:00100000:0.0:1782758424.121431:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813056 00010000:00010000:0.0:1782758424.121524:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 2592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758424.121578:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00100000:0.0:1782758424.121599:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196813056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758424.121619:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758424.121626:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 2592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758424.121641:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 2592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758424.121675:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb9b8580/0xdd99f5c4777db6cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d15 expref: 6 pid: 6597 timeout: 2592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758424.121693:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758424.121697:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758424.121703:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758424.121713:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758424.121744:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758424.121814:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196813056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 227us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758424.121857:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00080000:1.0:1782758424.121935:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758424.121941:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.121954:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.121964:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.121972:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758424.122000:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782758424.122651:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211660544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21229us (21373us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782758424.122660:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00010000:00010000:1.0:1782758424.122748:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758424.122763:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758424.122772:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758424.122777:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758424.122787:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758424.122801:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758424.122809:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667d5209/0xdd99f5c4777db6ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758424.122860:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758424.122863:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758424.122865:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758424.123261:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170810bbb80/2, rc 0, transno 4294967363 00000100:00100000:0.0:1782758424.123285:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211660544:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782758425.133123:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758425.523406:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211660800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758425.523487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758425.523603:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660800 00000100:00100000:2.0:1782758425.523613:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660800 00000100:00100000:2.0:1782758425.523688:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1782758425.523698:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211660800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758425.523753:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758425.523800:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211660800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758425.523808:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1782758425.523878:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211660800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758425.524076:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758426.157323:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758426.620108:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00000100:00100000:3.0:1782758426.807412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758426.807462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758426.807501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758426.807527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758426.807568:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813440 00000100:00100000:3.0:1782758426.807581:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813440 00000100:00100000:3.0:1782758426.807646:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813568 00000100:00100000:3.0:1782758426.807649:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813568 00000100:00100000:2.0:1782758426.807724:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813184 00000100:00100000:2.0:1782758426.807745:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813184 00000100:00100000:2.0:1782758426.807808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1370 00000100:00100000:2.0:1782758426.807819:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196813184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758426.807925:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196813184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 107us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758426.807933:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1370 00000100:00100000:2.0:1782758426.807970:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813312 00000100:00100000:2.0:1782758426.807974:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813312 00000100:00100000:2.0:1782758426.808024:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1782 00000100:00100000:2.0:1782758426.808032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196813312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758426.808067:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196813312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758426.808073:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1782 00000100:00100000:2.0:1782758426.808095:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1373 00000100:00100000:2.0:1782758426.808104:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196813440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758426.808131:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196813440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758426.808136:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1373 00000100:00100000:2.0:1782758426.808150:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1374 00000100:00100000:2.0:1782758426.808157:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196813568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758426.808177:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196813568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758426.808182:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1374 00000100:00080000:3.0:1782758426.809593:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758426.809606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758426.809610:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758427.180895:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758427.568559:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211661056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.568672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.568751:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211661568:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.568785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.568848:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758427.568855:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211660928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.568888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.568913:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211661440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.568935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.568960:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211661312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.568984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.569002:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758427.569007:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211661184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758427.569059:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661056 00000100:00100000:0.0:1782758427.569067:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661056 00000100:00100000:0.0:1782758427.569117:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661440 00000100:00100000:0.0:1782758427.569120:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661440 00000100:00100000:0.0:1782758427.569145:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661184 00000100:00100000:0.0:1782758427.569147:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661184 00000100:00100000:0.0:1782758427.569165:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:0.0:1782758427.569174:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211661056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569235:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211661056:12345-0@lo:400:kworker.0 Request processed in 61us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569254:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:0.0:1782758427.569274:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:0.0:1782758427.569280:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211661440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569309:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211661440:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569315:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:0.0:1782758427.569326:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1782758427.569331:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211661184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569373:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211661184:12345-0@lo:400:kworker.0 Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569383:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1782758427.569404:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661568 00000100:00100000:0.0:1782758427.569408:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661568 00000100:00100000:0.0:1782758427.569437:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661312 00000100:00100000:0.0:1782758427.569440:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661312 00000100:00100000:0.0:1782758427.569460:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1782758427.569466:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211661568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569496:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211661568:12345-0@lo:400:kworker.0 Request processed in 30us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569503:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1782758427.569513:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1782758427.569518:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211661312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569542:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211661312:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569549:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1782758427.569565:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211660928 00000100:00100000:0.0:1782758427.569569:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211660928 00000100:00100000:0.0:1782758427.569593:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1782758427.569598:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211660928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569626:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211660928:12345-0@lo:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758427.569632:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00080000:0.0:1782758427.569677:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758427.569683:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758427.569685:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758427.569737:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211661184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569752:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211661312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569786:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211660928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569795:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211661440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569804:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211661056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758427.569812:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:0.0:1782758427.569817:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170810bbb80, transno 4294967363 00000100:00100000:0.0:1782758427.569858:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211661568:0@lo:400:kworker.0 00000100:00100000:0.0:1782758428.076171:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211661696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758428.076489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758428.076847:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661696 00000100:00100000:2.0:1782758428.076858:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661696 00000100:00100000:2.0:1782758428.076932:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1782758428.076944:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211661696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758428.076990:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758428.077896:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211661696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 950us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758428.077906:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1782758428.080379:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211661696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758428.204084:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758429.230741:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758430.255559:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758430.637446:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211661824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758430.637520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758430.639711:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661824 00000100:00100000:2.0:1782758430.639726:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661824 00000100:00100000:2.0:1782758430.639856:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1782758430.639868:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211661824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758430.639908:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782758430.640199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758430.640371:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211661824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758430.640526:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211661824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758430.640535:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00010000:00010000:3.0:1782758431.276318:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758431.924508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758431.924559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758431.924727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758431.925514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758431.925542:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814080 00000100:00100000:3.0:1782758431.925551:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814080 00000100:00100000:3.0:1782758431.925597:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813952 00000100:00100000:3.0:1782758431.925599:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813952 00000100:00100000:3.0:1782758431.925803:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1377 00000100:00100000:3.0:1782758431.925814:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196814080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758431.925912:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196814080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758431.925919:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1377 00000100:00100000:3.0:1782758431.925935:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1378 00000100:00100000:3.0:1782758431.925943:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196813952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758431.925973:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196813952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758431.925979:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1378 00000100:00080000:3.0:1782758431.925999:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758431.926004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758431.926103:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813824 00000100:00100000:0.0:1782758431.926108:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813824 00000100:00080000:3.0:1782758431.926145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758431.926157:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:0.0:1782758431.926166:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196813824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758431.926208:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196813824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758431.926215:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:1.0:1782758431.936589:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196813696 00000100:00100000:1.0:1782758431.936615:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196813696 00000100:00100000:1.0:1782758431.936696:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1372 00000100:00100000:1.0:1782758431.936707:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196813696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758431.936809:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196813696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (12081us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758431.936817:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1372 00010000:00010000:3.0:1782758432.304705:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758432.684625:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211662208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.684632:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211662080:0@lo:400:kworker.0 00000100:00100000:1.0:1782758432.684709:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211661952:0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.689468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758432.689555:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211662592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.689592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758432.689669:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211662336:0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.689692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758432.689735:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662592 00000100:00100000:0.0:1782758432.689743:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662592 00000100:00100000:3.0:1782758432.689744:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662336 00000100:00100000:3.0:1782758432.689751:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662336 00000100:00100000:0.0:1782758432.689804:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1782758432.689878:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662080 00000100:00100000:2.0:1782758432.689883:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662080 00000100:00100000:2.0:1782758432.689915:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:2.0:1782758432.689922:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211662080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758432.689983:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211662080:12345-0@lo:400:kworker.0 Request processed in 61us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758432.689990:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1782758432.690161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758432.690191:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211661952 00000100:00100000:1.0:1782758432.690194:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211661952 00000100:00100000:1.0:1782758432.690224:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1782758432.690230:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211661952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.690946:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211662592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758432.690991:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211662592:12345-0@lo:400:kworker.0 Request processed in 1178us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758432.691053:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211661952:12345-0@lo:400:kworker.0 Request processed in 823us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758432.691060:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1782758432.691123:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211661952:0@lo:400:kworker.0 00000100:00100000:1.0:1782758432.691133:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211662464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758432.691158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758432.691182:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662464 00000100:00100000:1.0:1782758432.691186:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662464 00000100:00100000:1.0:1782758432.691216:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1782758432.691222:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211662464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758432.691271:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211662464:12345-0@lo:400:kworker.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758432.691278:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1782758432.691304:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211662464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758432.694018:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1782758432.694125:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211662080:0@lo:400:kworker.0 00000100:00100000:2.0:1782758432.694143:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211662592:0@lo:400:kworker.0 00000100:00100000:2.0:1782758432.694218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758432.694274:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662208 00000100:00100000:2.0:1782758432.694281:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662208 00000100:00100000:2.0:1782758432.694321:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1782758432.694328:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211662208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758432.694378:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211662208:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758432.694384:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1782758432.694417:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211662208:0@lo:400:kworker.0 00000100:00080000:2.0:1782758432.694442:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758432.694448:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758432.694451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758432.695688:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211662336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758432.695780:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211662336:12345-0@lo:400:kworker.0 Request processed in 1749us (6086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758432.695788:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1782758432.695952:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1782758432.696713:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211662336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758433.196238:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211662720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758433.196319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758433.196507:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662720 00000100:00100000:1.0:1782758433.196516:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662720 00000100:00100000:1.0:1782758433.196587:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1782758433.196598:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211662720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758433.196634:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758433.196693:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211662720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758433.196700:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1782758433.196961:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211662720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758433.324085:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758434.348155:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758435.372092:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758435.756368:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758435.756449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758435.756870:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662848 00000100:00100000:2.0:1782758435.756878:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662848 00000100:00100000:2.0:1782758435.756944:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1782758435.756955:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211662848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758435.756991:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758435.757049:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211662848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758435.757056:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00080000:3.0:1782758435.757117:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758435.757197:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211662848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758436.396904:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758437.052949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758437.052981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758437.053018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758437.053066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758437.053101:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814464 00000100:00100000:3.0:1782758437.053111:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814464 00000100:00100000:3.0:1782758437.053187:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814592 00000100:00100000:3.0:1782758437.053191:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814592 00000100:00100000:3.0:1782758437.053222:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1381 00000100:00100000:3.0:1782758437.053231:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196814464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758437.053304:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196814464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758437.053311:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1381 00000100:00100000:3.0:1782758437.053326:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1382 00000100:00100000:3.0:1782758437.053332:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196814592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758437.053350:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196814592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 19us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758437.053356:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1382 00000100:00080000:3.0:1782758437.053371:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758437.053374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758437.053567:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814208 00000100:00100000:0.0:1782758437.053572:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814208 00000100:00100000:0.0:1782758437.053606:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1374 00000100:00100000:0.0:1782758437.053614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196814208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758437.053649:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196814208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758437.053655:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1374 00000100:00100000:1.0:1782758437.053856:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814336 00000100:00100000:1.0:1782758437.053861:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814336 00000100:00100000:1.0:1782758437.053907:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1790 00000100:00100000:1.0:1782758437.053916:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196814336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758437.053954:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196814336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758437.053961:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1790 00000100:00080000:0.0:1782758437.054105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758437.422520:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758437.807625:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211663232:0@lo:400:kworker.0 00000100:00100000:0.0:1782758437.807709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758437.807873:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211662976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758437.807908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758437.807941:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758437.807947:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211663104:0@lo:400:kworker.0 00000100:00100000:1.0:1782758437.807970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758437.808004:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663232 00000100:00100000:1.0:1782758437.808010:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663232 00000100:00100000:1.0:1782758437.808063:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663104 00000100:00100000:1.0:1782758437.808066:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663104 00000100:00100000:1.0:1782758437.808084:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1782758437.808092:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211663232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.810253:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1782758437.810279:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.810381:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211663104:12345-0@lo:400:kworker.0 Request processed in 115us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758437.810388:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1782758437.810437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211662976 00000100:00100000:2.0:1782758437.810445:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211662976 00000100:00100000:2.0:1782758437.810483:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1782758437.810489:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211662976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.810522:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211662976:12345-0@lo:400:kworker.0 Request processed in 33us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758437.810528:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1782758437.810576:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663360:0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.810612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782758437.810649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758437.810670:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663360 00000100:00100000:2.0:1782758437.810674:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663360 00000100:00100000:2.0:1782758437.810710:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:2.0:1782758437.810716:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.810751:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663360:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758437.810757:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00080000:2.0:1782758437.810770:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758437.810796:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663360:0@lo:400:kworker.0 00000100:00100000:3.0:1782758437.820645:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211663616:0@lo:400:kworker.0 00000100:00100000:3.0:1782758437.820722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758437.820767:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758437.820773:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211663488:0@lo:400:kworker.0 00000100:00100000:3.0:1782758437.820799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758437.820859:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663616 00000100:00100000:3.0:1782758437.820866:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663616 00000100:00100000:3.0:1782758437.820928:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1782758437.820937:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211663616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758437.820993:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211663616:12345-0@lo:400:kworker.0 Request processed in 57us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758437.821001:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00080000:3.0:1782758437.821025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758437.825429:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211663104:0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.825447:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211662976:0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.825504:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663488 00000100:00100000:2.0:1782758437.825512:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663488 00000100:00100000:2.0:1782758437.825579:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:2.0:1782758437.825588:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211663488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758437.825671:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211663488:12345-0@lo:400:kworker.0 Request processed in 83us (4869us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758437.825678:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00080000:2.0:1782758437.825711:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758437.826800:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211663232:12345-0@lo:400:kworker.0 Request processed in 18704us (19087us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758437.826811:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00100000:3.0:1782758437.827154:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211663616:0@lo:400:kworker.0 00000100:00100000:3.0:1782758437.827189:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211663488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758437.831111:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211663232:0@lo:400:kworker.0 00000100:00100000:2.0:1782758438.319521:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758438.319545:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758438.319620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758438.319795:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663744 00000100:00100000:3.0:1782758438.319804:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663744 00000100:00100000:3.0:1782758438.319871:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1782758438.319881:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758438.319917:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758438.320014:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758438.320022:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1782758438.323010:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758438.448998:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758439.468175:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758440.145322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.145511:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814720 00000100:00100000:2.0:1782758440.145522:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814720 00000100:00100000:2.0:1782758440.145595:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1075 00000100:00100000:2.0:1782758440.145606:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196814720:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758440.145722:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196814720:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.145729:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1075 00000100:00080000:3.0:1782758440.149883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758440.150817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.151261:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814848 00000100:00100000:2.0:1782758440.151806:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814848 00000100:00100000:2.0:1782758440.151928:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 592 00000100:00100000:2.0:1782758440.151941:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196814848:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:3.0:1782758440.152907:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758440.154118:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196814848:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2172us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.154131:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 592 00000100:00100000:0.0:1782758440.163658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758440.163848:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196814976 00000100:00100000:3.0:1782758440.163859:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196814976 00000100:00100000:3.0:1782758440.163933:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 593 00000100:00100000:3.0:1782758440.163945:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196814976:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758440.164583:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196814976:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 639us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758440.164592:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 593 00000100:00080000:2.0:1782758440.164715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758440.167186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.167357:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815104 00000100:00100000:2.0:1782758440.167367:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815104 00000100:00100000:2.0:1782758440.167444:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1076 00000100:00100000:2.0:1782758440.167454:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758440.168259:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 803us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.168268:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1076 00000100:00100000:1.0:1782758440.178895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.179165:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815232 00000100:00100000:2.0:1782758440.179177:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815232 00000100:00100000:2.0:1782758440.179245:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00100000:2.0:1782758440.179256:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815232:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758440.179371:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815232:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 117us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.179380:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1077 00000100:00100000:0.0:1782758440.187714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.189108:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815360 00000100:00100000:2.0:1782758440.189122:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815360 00000100:00100000:2.0:1782758440.189202:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:2.0:1782758440.189214:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196815360:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758440.191837:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196815360:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2600us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.191851:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:3.0:1782758440.201754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758440.202864:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815488 00000100:00100000:0.0:1782758440.202877:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815488 00000100:00100000:0.0:1782758440.202943:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:0.0:1782758440.202954:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196815488:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758440.203370:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55137:x1869355196815488:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 417us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758440.203378:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:1.0:1782758440.217472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758440.217744:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815616 00000100:00100000:2.0:1782758440.217755:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815616 00000100:00100000:2.0:1782758440.217815:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1078 00000100:00100000:2.0:1782758440.217865:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815616:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758440.218510:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55137:x1869355196815616:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 682us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758440.218519:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1078 00010000:00010000:2.0:1782758440.509387:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758440.878022:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758440.878102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758440.880350:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211663872 00000100:00100000:3.0:1782758440.880361:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211663872 00000100:00100000:3.0:1782758440.880438:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1782758440.880449:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758440.880487:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758440.887780:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211663872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7323us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758440.887795:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00080000:3.0:1782758440.889064:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758440.889209:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211663872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758441.516274:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758442.165081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758442.165125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758442.165134:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815744 00000100:00100000:3.0:1782758442.165146:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815744 00000100:00100000:2.0:1782758442.165165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758442.165199:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1376 00000100:00100000:2.0:1782758442.165201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758442.165211:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196815744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758442.165230:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196815872 00000100:00100000:2.0:1782758442.165235:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196815872 00000100:00100000:2.0:1782758442.165282:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:3.0:1782758442.165299:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196815744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758442.165299:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196815872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758442.165312:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1376 00000100:00080000:3.0:1782758442.165344:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758442.165345:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196815872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758442.165354:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:2.0:1782758442.165384:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816000 00000100:00100000:2.0:1782758442.165389:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816000 00000100:00100000:2.0:1782758442.165420:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816128 00000100:00100000:2.0:1782758442.165423:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816128 00000100:00100000:2.0:1782758442.165452:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1385 00000100:00080000:3.0:1782758442.165456:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758442.165460:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758442.165471:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196816000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758442.165515:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196816000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758442.165521:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1385 00000100:00100000:2.0:1782758442.165533:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1386 00000100:00100000:2.0:1782758442.165540:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196816128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758442.165562:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196816128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758442.165568:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1386 00010000:00010000:0.0:1782758442.540066:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758442.925321:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211664000:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925459:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211664512:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925518:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758442.925524:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211664128:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925565:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211664640:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925624:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211664384:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758442.925670:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211664256:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.925688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758442.925711:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664000 00000100:00100000:3.0:1782758442.925718:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664000 00000100:00100000:1.0:1782758442.925868:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664512 00000100:00100000:1.0:1782758442.925873:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664512 00000100:00100000:1.0:1782758442.925918:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664128 00000100:00100000:1.0:1782758442.925921:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664128 00000100:00100000:1.0:1782758442.925938:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664256 00000100:00100000:1.0:1782758442.925940:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664256 00000100:00100000:1.0:1782758442.925957:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1782758442.925966:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211664512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758442.926032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211664512:12345-0@lo:400:kworker.0 Request processed in 67us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758442.926050:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1782758442.926070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1782758442.926076:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211664128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758442.926105:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211664128:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758442.926111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1782758442.926122:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1782758442.926129:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211664256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758442.926158:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211664256:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758442.926164:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00080000:1.0:1782758442.926178:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758442.926221:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211664256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758442.926249:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211664128:0@lo:400:kworker.0 00000100:00100000:1.0:1782758442.926258:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211664512:0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.931637:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1782758442.931655:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.931758:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211664000:12345-0@lo:400:kworker.0 Request processed in 109us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758442.931767:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1782758442.931854:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664640 00000100:00100000:3.0:1782758442.931862:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664640 00000100:00100000:3.0:1782758442.931909:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664384 00000100:00100000:3.0:1782758442.931913:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664384 00000100:00100000:3.0:1782758442.931938:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1782758442.931944:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211664640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.931978:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211664640:12345-0@lo:400:kworker.0 Request processed in 35us (6386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758442.931985:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1782758442.931996:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1782758442.932001:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211664384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758442.932033:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211664384:12345-0@lo:400:kworker.0 Request processed in 32us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758442.932049:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00080000:3.0:1782758442.932076:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758442.932080:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758442.932116:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211664384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758442.932696:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211664640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758442.932709:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211664000:0@lo:400:kworker.0 00000020:00000080:3.0:1782758443.073103:0:94177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd18139c60 20000000:00000080:3.0:1782758443.073127:0:94177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfee400 uarg=0000000000000000 00010000:00010000:3.0:1782758443.073646:0:94177:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758443.073684:0:94177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:3.0:1782758443.073688:0:94177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758443.073700:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db6a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d07 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.073723:0:94177:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758443.073740:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758443.073754:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.073768:0:94177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.073776:0:94177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.073812:0:94177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.073859:0:94177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 18 pid: 5796 timeout: 2611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758443.073875:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94177:1869355211664768:0@lo:104: 00000100:00100000:3.0:1782758443.073943:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758443.075641:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170824489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758443.077028:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664768 00000100:00100000:1.0:1782758443.077154:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664768 00000100:00100000:1.0:1782758443.077290:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1782758443.077301:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94177:x1869355211664768:12345-0@lo:104: 00010000:00010000:1.0:1782758443.077320:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758443.077435:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758443.077441:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94177:x1869355211664768:12345-0@lo:104: Request processed in 142us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758443.077448:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:0.0:1782758443.077499:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758443.077507:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077515:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758443.077519:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077528:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758443.077540:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758443.077546:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758443.077585:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077591:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758443.077615:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077621:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777db677 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db67e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077637:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758443.077639:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758443.077641:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758443.077664:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211664896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758443.077715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758443.077769:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211664896 00000100:00100000:0.0:1782758443.077773:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211664896 00010000:00010000:0.0:1782758443.077796:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 19 pid: 5796 timeout: 2611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758443.077854:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1782758443.077862:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211664896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758443.077875:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758443.077880:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 19 pid: 5796 timeout: 2611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077891:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 19 pid: 5796 timeout: 2611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077911:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077921:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077939:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077947:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077954:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077959:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077964:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758443.077968:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077975:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077984:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758443.077999:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758443.078028:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211664896:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758443.078046:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1782758443.078110:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211664896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758443.079687:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777db67e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db677 expref: 18 pid: 5796 timeout: 2611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758443.079707:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94177:1869355211664768:0@lo:104: 00010000:00010000:3.0:1782758443.079727:0:94177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.079736:0:94177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.079742:0:94177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758443.079747:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db6f5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758443.437050:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758443.437074:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211665024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758443.437144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758443.437353:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665024 00000100:00100000:0.0:1782758443.437361:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665024 00000100:00100000:0.0:1782758443.437490:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1782758443.437499:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211665024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758443.437538:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758443.437594:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211665024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758443.437601:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1782758443.437690:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211665024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758443.567487:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758444.588111:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758444.852809:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758444.852848:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758444.852856:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758444.853399:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758444.853414:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758444.853429:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758444.853465:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211665152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758444.853556:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758444.853632:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067300 going to sleep for 11 seconds 00000100:00100000:3.0:1782758444.853785:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665152 00000100:00100000:3.0:1782758444.853798:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665152 00000100:00100000:3.0:1782758444.853894:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1782758444.853904:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211665152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758444.854219:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758444.854240:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db6fc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758444.854270:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758444.854283:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758444.854294:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758444.854360:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211665152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 457us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758444.854368:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1782758444.854468:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211665152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758444.854487:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758444.854496:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758444.854523:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758444.854528:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758444.854535:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758445.615993:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758445.996548:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211665280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758445.996618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758445.996691:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665280 00000100:00100000:2.0:1782758445.996698:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665280 00000100:00100000:2.0:1782758445.996750:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1782758445.996759:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211665280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758445.996797:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758445.996862:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211665280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758445.996870:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00080000:2.0:1782758445.996893:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758445.996933:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211665280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758446.497314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758446.497450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816256 00000100:00100000:2.0:1782758446.497460:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816256 00000100:00100000:2.0:1782758446.497536:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1079 00000100:00100000:2.0:1782758446.497546:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55224:x1869355196816256:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758446.497567:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758446.497592:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d1c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.497670:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.497684:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.497844:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758446.498132:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1782758446.498137:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758446.498212:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.498240:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d1c expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.498261:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d1c expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758446.498271:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782758446.498274:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758446.498277:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758446.498411:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55224:x1869355196816256:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 865us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758446.498420:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1079 00000100:00080000:3.0:1782758446.498500:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758446.502378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758446.504086:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816512 00000100:00100000:1.0:1782758446.504101:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816512 00000100:00100000:1.0:1782758446.504219:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1080 00000100:00100000:1.0:1782758446.504230:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55224:x1869355196816512:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758446.504297:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758446.504333:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777db711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d1c expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.504356:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db6a1) 00010000:00010000:1.0:1782758446.504361:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1000) 00010000:00010000:1.0:1782758446.504375:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758446.504412:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.504425:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.504436:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758446.588734:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00000004:00010000:0.0:1782758446.588866:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000764f113b reply state 000000007ae88d24 transno 4294967713 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758446.588880:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758446.589079:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:0.0:1782758446.589185:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782758446.589202:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55224:x1869355196816512:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 84970us (86831us total) trans 4294967713 rc 0/0 00000100:00100000:0.0:1782758446.589210:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1080 00010000:00010000:1.0:1782758446.589366:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589375:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589381:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589387:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758446.589392:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589399:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589416:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758446.589419:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758446.589561:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758446.589569:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db718 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758446.636059:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758447.285134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758447.285241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758447.285341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758447.285372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758447.285408:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817024 00000100:00100000:3.0:1782758447.285417:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817024 00000100:00100000:3.0:1782758447.285474:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816896 00000100:00100000:3.0:1782758447.285477:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816896 00000100:00100000:3.0:1782758447.285499:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1389 00000100:00100000:3.0:1782758447.285509:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196817024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758447.285579:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196817024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758447.285587:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1389 00000100:00100000:3.0:1782758447.285601:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1390 00000100:00100000:3.0:1782758447.285607:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196816896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758447.285628:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196816896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758447.285634:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1390 00000100:00080000:3.0:1782758447.285651:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758447.285655:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758447.286257:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816640 00000100:00100000:1.0:1782758447.286264:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816640 00000100:00100000:1.0:1782758447.286316:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1379 00000100:00100000:1.0:1782758447.286323:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196816640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758447.286368:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196816640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758447.286375:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1379 00000100:00100000:2.0:1782758447.288259:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196816768 00000100:00100000:2.0:1782758447.288282:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196816768 00000100:00100000:2.0:1782758447.288347:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00100000:2.0:1782758447.288358:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196816768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758447.288439:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196816768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758447.288447:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000020:00000080:3.0:1782758447.522512:0:94375:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc26eea300 20000000:00000080:3.0:1782758447.522533:0:94375:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917187966800 uarg=0000000000000000 00010000:00010000:3.0:1782758447.523485:0:94375:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758447.523503:0:94375:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758447.523518:0:94375:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758447.523537:0:94375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758447.523555:0:94375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758447.523563:0:94375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758447.523612:0:94375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758447.523630:0:94375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 18 pid: 5793 timeout: 2615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758447.523647:0:94375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94375:1869355211665408:0@lo:104: 00000100:00100000:3.0:1782758447.523720:0:94375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758447.523883:0:94375:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758447.523906:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665408 00000100:00100000:1.0:1782758447.523915:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665408 00000100:00100000:1.0:1782758447.523971:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1782758447.523981:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94375:x1869355211665408:12345-0@lo:104: 00010000:00010000:1.0:1782758447.523994:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524050:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758447.524056:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94375:x1869355211665408:12345-0@lo:104: Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758447.524064:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782758447.524094:0:94375:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94375:1869355211665408:0@lo:104: 00010000:00010000:3.0:1782758447.524112:0:94375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524235:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758447.524243:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524250:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758447.524254:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524263:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758447.524270:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758447.524277:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758447.524316:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524323:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782758447.524367:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211665536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758447.524396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782758447.524499:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524507:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777db6fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db703 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.524524:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758447.524525:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758447.524527:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758447.524634:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665536 00000100:00100000:1.0:1782758447.524639:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665536 00010000:00010000:1.0:1782758447.524658:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 2615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758447.524710:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1782758447.524718:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211665536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758447.524730:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758447.524734:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 2615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524744:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 2615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524756:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777db703 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db6fc expref: 19 pid: 5793 timeout: 2615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524772:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524779:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524790:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524796:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524802:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524808:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524813:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758447.524817:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.524857:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.525296:0:94375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758447.525305:0:94375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.527176:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.527200:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db71f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758447.527379:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758447.527470:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211665536:12345-0@lo:103:ldlm_bl.0 Request processed in 2750us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758447.527480:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1782758447.529787:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211665536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758447.660120:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758448.044060:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211665792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.044098:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211665920:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758448.044230:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211666304:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758448.044291:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782758448.044297:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211665664:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758448.044352:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211666176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758448.044380:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665664 00000100:00100000:1.0:1782758448.044389:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665664 00000100:00100000:3.0:1782758448.044398:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211666048:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758448.044440:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1782758448.044452:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666304 00000100:00100000:1.0:1782758448.044453:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211665664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044457:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666304 00000100:00100000:3.0:1782758448.044492:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666048 00000100:00100000:3.0:1782758448.044506:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666048 00000100:00100000:1.0:1782758448.044516:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211665664:12345-0@lo:400:kworker.0 Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758448.044525:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1782758448.044534:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1782758448.044543:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211666304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758448.044579:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211665664:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044581:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211666304:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758448.044591:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1782758448.044600:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211666304:0@lo:400:kworker.0 00000100:00100000:3.0:1782758448.044609:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1782758448.044617:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211666048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.044745:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665792 00000100:00100000:0.0:1782758448.044750:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665792 00000100:00100000:0.0:1782758448.044782:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666176 00000100:00100000:0.0:1782758448.044785:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666176 00000100:00100000:0.0:1782758448.044807:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:0.0:1782758448.044814:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211665792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.044880:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211665792:12345-0@lo:400:kworker.0 Request processed in 67us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758448.044887:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:0.0:1782758448.044913:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:0.0:1782758448.044919:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211666176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.044957:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211666176:12345-0@lo:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758448.044963:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:3.0:1782758448.045024:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211666048:12345-0@lo:400:kworker.0 Request processed in 409us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758448.045031:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00080000:3.0:1782758448.045051:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758448.045055:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758448.045057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758448.045073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758448.045739:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211665920 00000100:00100000:0.0:1782758448.045749:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211665920 00000100:00100000:0.0:1782758448.045799:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1782758448.045807:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211665920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.045878:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211665920:12345-0@lo:400:kworker.0 Request processed in 73us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758448.045886:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1782758448.045923:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211665920:0@lo:400:kworker.0 00000100:00080000:2.0:1782758448.046137:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758448.046898:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211666176:0@lo:400:kworker.0 00000100:00100000:0.0:1782758448.046913:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211665792:0@lo:400:kworker.0 00000100:00100000:1.0:1782758448.047000:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211666048:0@lo:400:kworker.0 00000100:00100000:1.0:1782758448.556214:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758448.556237:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211666432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758448.556672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758448.557386:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666432 00000100:00100000:2.0:1782758448.557396:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666432 00000100:00100000:2.0:1782758448.557459:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:2.0:1782758448.557470:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211666432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758448.557508:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758448.557566:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211666432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758448.557573:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1782758448.557699:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211666432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758448.684023:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758449.325185:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758449.325196:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758449.325201:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758449.325244:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758449.325256:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758449.325268:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758449.325295:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211666560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758449.325381:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758449.325443:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b32373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758449.325510:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666560 00000100:00100000:3.0:1782758449.325518:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666560 00000100:00100000:3.0:1782758449.325572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1782758449.325583:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211666560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758449.325597:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758449.325610:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db726 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758449.325636:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758449.325648:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758449.325658:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758449.325712:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211666560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758449.325719:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1782758449.327656:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211666560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758449.327682:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758449.327694:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758449.327721:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758449.327727:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758449.327733:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758449.712657:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758450.732351:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758450.924399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758450.924438:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817152 00000100:00100000:1.0:1782758450.924448:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817152 00000100:00100000:1.0:1782758450.924549:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:1.0:1782758450.924560:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55301:x1869355196817152:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782758450.924584:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758450.924608:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d23 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924676:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924691:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924706:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924718:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924726:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.924733:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925409:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925420:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925429:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758450.925515:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1782758450.925520:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758450.925601:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925614:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925621:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925628:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925634:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758450.925639:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925647:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925662:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171a0e3a400) 00010000:00010000:1.0:1782758450.925665:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758450.925670:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925676:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777db73b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925688:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925695:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925706:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925712:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758450.925715:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925721:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925728:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9171a0e3af00) 00010000:00010000:1.0:1782758450.925731:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758450.925734:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925740:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777db742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925772:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777db734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d23 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925789:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d23 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.925797:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758450.925799:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758450.925802:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00080000:0.0:1782758450.926994:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758450.927567:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55301:x1869355196817152:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 3001us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758450.927581:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1081 00000100:00100000:1.0:1782758450.942959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758450.943149:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817408 00000100:00100000:3.0:1782758450.943159:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817408 00000100:00100000:3.0:1782758450.943235:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1082 00000100:00100000:3.0:1782758450.943247:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55301:x1869355196817408:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758450.943270:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758450.943291:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db750 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d2a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943642:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943663:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943674:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943688:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943695:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.943700:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782758450.944754:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1782758450.945325:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945340:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945352:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945388:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945395:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945402:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945408:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758450.945413:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945421:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945434:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782758450.945437:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758450.945442:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945449:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db757 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758450.945461:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001caea37e reply state 000000007c592ecf transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758450.945470:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758450.945503:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db750 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d2a expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945518:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d2a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.945525:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758450.945528:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758450.945530:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758450.945618:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55301:x1869355196817408:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2372us (2669us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1782758450.945628:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1082 00000100:00100000:3.0:1782758450.949536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758450.949576:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817664 00000100:00100000:3.0:1782758450.949586:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817664 00000100:00100000:3.0:1782758450.949641:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1083 00000100:00100000:3.0:1782758450.949651:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55301:x1869355196817664:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:3.0:1782758450.949707:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758450.949911:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949923:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949931:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949937:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758450.949942:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949949:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949966:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75100) 00010000:00010000:1.0:1782758450.949970:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758450.949975:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.949983:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777db75e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.952887:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d2a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.952915:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758450.952928:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758450.952981:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.952995:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.953006:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758450.953159:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000225415c9 reply state 00000000f2ac3ca1 transno 4294967715 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758450.953169:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758450.953476:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55301:x1869355196817664:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 3822us (3948us total) trans 4294967715 rc 0/0 00000100:00100000:3.0:1782758450.953486:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1083 00000100:00100000:1.0:1782758450.957210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758450.957246:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817792 00000100:00100000:1.0:1782758450.957255:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817792 00000100:00100000:1.0:1782758450.957301:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1084 00000100:00100000:1.0:1782758450.957311:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55301:x1869355196817792:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782758450.957337:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758450.957359:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db77a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d31 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.957415:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db77a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d31 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.957429:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db77a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d31 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758450.957446:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75b00) 00010000:00010000:1.0:1782758450.957449:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758450.957452:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758450.957499:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:55301:x1869355196817792:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 190us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758450.957506:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1084 00010000:00010000:3.0:1782758450.959228:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959245:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959252:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959258:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758450.959263:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959270:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959288:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758450.959291:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758450.959295:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758450.959301:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758450.962632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758450.962787:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196817920 00000100:00100000:3.0:1782758450.962798:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196817920 00000100:00100000:3.0:1782758450.962910:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 596 00000100:00100000:3.0:1782758450.962923:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196817920:12345-192.168.204.31@tcp:2:touch.60003 00000100:00080000:2.0:1782758450.963451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758450.963598:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196817920:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 676us (975us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1782758450.963608:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 596 00000100:00100000:1.0:1782758450.968453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758450.968533:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818176 00000100:00100000:3.0:1782758450.968543:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818176 00000100:00100000:3.0:1782758450.968605:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 110 00000100:00100000:3.0:1782758450.968615:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55301:x1869355196818176:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:3.0:1782758450.969034:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:55301:x1869355196818176:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 419us (590us total) trans 4294967716 rc 0/0 00000100:00100000:3.0:1782758450.969043:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 110 00000100:00100000:1.0:1782758451.014617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758451.014945:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818304 00000100:00100000:3.0:1782758451.014956:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818304 00000100:00100000:3.0:1782758451.015020:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00100000:3.0:1782758451.015031:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:55305:x1869355196818304:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:3.0:1782758451.015056:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758451.015076:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d38 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015143:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015159:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015170:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015185:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015542:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015557:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015666:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015675:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015681:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758451.015719:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 0 00000004:00200000:3.0:1782758451.015724:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758451.015744:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015755:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015762:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015768:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015775:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015780:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758451.015784:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015792:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015802:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782758451.015805:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758451.015810:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015816:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015863:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015885:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015892:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015896:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758451.015899:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015905:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015912:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75900) 00010000:00010000:3.0:1782758451.015915:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758451.015918:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015927:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db78f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015960:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d38 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015973:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d38 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.015980:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758451.015982:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758451.015985:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782758451.016054:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:55305:x1869355196818304:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 1024us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758451.016062:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1085 00000100:00100000:1.0:1782758451.019700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758451.019777:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818432 00000100:00100000:3.0:1782758451.019787:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818432 00000100:00100000:3.0:1782758451.019895:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 597 00000100:00100000:3.0:1782758451.019905:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196818432:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:3.0:1782758451.019925:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758451.019956:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d3f expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758451.019984:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a42bc32, atime: 0x6a42bc32, ctime: 0x6a42bc32, blocks: 0x1 00010000:00010000:3.0:1782758451.020003:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=2519s v=(0 0) 00010000:00010000:3.0:1782758451.020008:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758451.020018:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.020037:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.020051:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782758451.020107:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196818432:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 204us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758451.020115:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 597 00000100:00100000:1.0:1782758451.027256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758451.027443:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818688 00000100:00100000:3.0:1782758451.027453:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818688 00000100:00100000:3.0:1782758451.027515:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1086 00000100:00100000:3.0:1782758451.027526:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:55305:x1869355196818688:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782758451.027586:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758451.027613:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d38 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027635:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777db77a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d31 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027645:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758451.027656:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758451.027676:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027689:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027699:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027713:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027733:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.027740:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.028035:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.028044:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.028051:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758451.029149:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:3.0:1782758451.029166:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2519432342525ns, next at 2520432339245ns, rc = 0 00010000:00010000:3.0:1782758451.029397:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029411:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029422:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029435:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029441:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029447:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029476:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758451.029497:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029503:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029510:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029515:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758451.029520:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029528:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029540:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758451.029543:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758451.029546:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029556:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029574:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029579:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029585:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029589:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758451.029592:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029598:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029606:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782758451.029608:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758451.029612:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758451.029618:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758451.029627:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c369e55b reply state 000000006bf11a95 transno 4294967717 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758451.029637:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758451.029752:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:55305:x1869355196818688:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 2224us (2502us total) trans 4294967717 rc 0/0 00000100:00100000:3.0:1782758451.029762:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1086 00010000:00010000:0.0:1782758451.030552:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758451.030561:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758451.030569:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758451.030573:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758451.030581:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758451.030592:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff917191f75f00) 00010000:00010000:0.0:1782758451.030595:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758451.030598:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758451.030603:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777db7b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758451.030620:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758451.030622:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758451.030624:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758451.033177:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033206:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033214:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033220:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758451.033225:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033233:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033253:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75900) 00010000:00010000:2.0:1782758451.033256:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758451.033262:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.033273:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777db7ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758451.119003:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758451.119032:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211666688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758451.119252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758451.119324:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666688 00000100:00100000:2.0:1782758451.119332:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666688 00000100:00100000:2.0:1782758451.119393:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1782758451.119402:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211666688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758451.119438:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758451.119483:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211666688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758451.119491:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00080000:2.0:1782758451.119512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758451.119549:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211666688:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1782758451.712695:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967717 is committed 00000004:00080000:1.0:1782758451.712713:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000100:00100000:0.0:1782758451.713597:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758451.713621:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211666816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758451.713710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758451.713928:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211666816 00000100:00100000:1.0:1782758451.713936:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211666816 00000100:00100000:1.0:1782758451.713987:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1782758451.713997:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211666816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782758451.714030:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:1.0:1782758451.714060:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.714084:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.714093:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782758451.714097:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758451.714101:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.714130:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.714144:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 6 pid: 6598 timeout: 2620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758451.714155:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211666944:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758451.714297:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758451.720436:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211666944:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758451.720467:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758451.721028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758451.721097:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818816 00000100:00100000:2.0:1782758451.721105:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818816 00010000:00010000:2.0:1782758451.721141:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 2620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758451.721174:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 432 00000100:00100000:2.0:1782758451.721193:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196818816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758451.721209:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758451.721215:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 2620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.721227:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 2620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.721253:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6c1b1be/0xdd99f5c4777db79d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d3f expref: 7 pid: 6598 timeout: 2620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.721269:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758451.721273:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758451.721278:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.721286:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.721317:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758451.721366:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196818816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758451.721374:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 432 00010000:00010000:1.0:1782758451.721795:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.721805:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.721851:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.721860:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758451.721890:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758451.722477:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211666816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8478us (8764us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1782758451.722487:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000004:00080000:3.0:1782758451.722956:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b77c4a80/2, rc 0, transno 4294967365 00000100:00100000:3.0:1782758451.722964:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211666816:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782758451.723156:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758451.723165:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.723182:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758451.723199:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.723211:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.723229:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.723236:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777db7c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758451.723257:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758451.723259:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758451.723261:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758451.764689:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758452.290704:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000001:00080000:1.0:1782758452.290726:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000100:00100000:2.0:1782758452.406792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758452.406866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758452.406909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758452.406938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758452.406963:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819328 00000100:00100000:2.0:1782758452.406973:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819328 00000100:00100000:2.0:1782758452.407027:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819200 00000100:00100000:2.0:1782758452.407030:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819200 00000100:00100000:2.0:1782758452.407056:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1393 00000100:00100000:2.0:1782758452.407066:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196819328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758452.407150:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196819328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758452.407158:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1393 00000100:00100000:2.0:1782758452.407188:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1394 00000100:00100000:2.0:1782758452.407195:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196819200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758452.407220:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196819200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758452.407226:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1394 00000100:00100000:2.0:1782758452.407244:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196818944 00000100:00100000:2.0:1782758452.407247:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196818944 00000100:00100000:2.0:1782758452.407272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1382 00000100:00100000:2.0:1782758452.407278:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196818944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758452.407303:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196818944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758452.407309:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1382 00000100:00080000:2.0:1782758452.407332:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758452.407336:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758452.407806:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819072 00000100:00100000:0.0:1782758452.407811:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819072 00000100:00100000:0.0:1782758452.407886:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00100000:0.0:1782758452.407894:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196819072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758452.407968:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196819072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758452.407974:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00080000:2.0:1782758452.409506:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758452.780338:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758453.018676:0:94621:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffccfab5d0 20000000:00000080:0.0:1782758453.018698:0:94621:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d2400 uarg=0000000000000000 00010000:00010000:0.0:1782758453.019304:0:94621:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782758453.019354:0:94621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:0.0:1782758453.019358:0:94621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758453.019369:0:94621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777db749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d23 expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758453.019401:0:94621:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782758453.019423:0:94621:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758453.019438:0:94621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758453.019452:0:94621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758453.019460:0:94621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758453.019494:0:94621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758453.019513:0:94621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 18 pid: 5796 timeout: 2621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758453.019527:0:94621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94621:1869355211667072:0@lo:104: 00000100:00100000:0.0:1782758453.019587:0:94621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758453.019651:0:94621:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758453.019859:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667072 00000100:00100000:1.0:1782758453.019867:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667072 00000100:00100000:1.0:1782758453.019914:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1782758453.019925:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94621:x1869355211667072:12345-0@lo:104: 00010000:00010000:1.0:1782758453.019938:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758453.020006:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758453.020013:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94621:x1869355211667072:12345-0@lo:104: Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758453.020020:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782758453.020130:0:94621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94621:1869355211667072:0@lo:104: 00010000:00010000:3.0:1782758453.020149:0:94621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020278:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758453.020284:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020292:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758453.020296:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020304:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758453.020319:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758453.020326:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758453.020361:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020368:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758453.020391:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020402:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777db726 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db72d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020415:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758453.020416:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758453.020418:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758453.020429:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211667200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758453.020459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758453.020526:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667200 00000100:00100000:3.0:1782758453.020530:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667200 00010000:00010000:3.0:1782758453.020551:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 2621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758453.020575:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1782758453.020582:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211667200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758453.020593:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758453.020598:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 2621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020608:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 2621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020619:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db72d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db726 expref: 19 pid: 5796 timeout: 2621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020629:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020641:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020654:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020660:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020667:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020673:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020677:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758453.020681:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020688:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020701:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020709:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758453.020737:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211667200:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758453.020743:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1782758453.020774:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211667200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758453.020794:0:94621:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020801:0:94621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758453.020807:0:94621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777db7c7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758453.174796:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211667456:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.174903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.174956:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782758453.174963:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211667328:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.174998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.175014:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211667840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.175060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.175100:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211667584:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.175125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.175144:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758453.175149:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211667712:0@lo:400:kworker.0 00000100:00100000:2.0:1782758453.177537:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667456 00000100:00100000:2.0:1782758453.177554:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667456 00000100:00100000:2.0:1782758453.177642:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667328 00000100:00100000:2.0:1782758453.177647:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667328 00000100:00100000:2.0:1782758453.177683:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:2.0:1782758453.177694:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211667456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758453.177803:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211667456:12345-0@lo:400:kworker.0 Request processed in 110us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758453.177814:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:2.0:1782758453.177859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1782758453.177867:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758453.177896:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211667328:12345-0@lo:400:kworker.0 Request processed in 30us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758453.177901:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00080000:2.0:1782758453.177925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758453.177963:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211667328:0@lo:400:kworker.0 00000100:00100000:2.0:1782758453.177992:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211667456:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.179154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.179285:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667840 00000100:00100000:1.0:1782758453.179293:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667840 00000100:00100000:1.0:1782758453.179345:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667584 00000100:00100000:1.0:1782758453.179348:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667584 00000100:00100000:1.0:1782758453.179381:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1782758453.179389:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211667840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.179440:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211667840:12345-0@lo:400:kworker.0 Request processed in 52us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758453.179447:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1782758453.179467:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1782758453.179473:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211667584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.179507:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211667584:12345-0@lo:400:kworker.0 Request processed in 35us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758453.179514:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1782758453.179555:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:1.0:1782758453.179561:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b77c4a80, transno 4294967365 00000100:00100000:1.0:1782758453.179574:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211667584:0@lo:400:kworker.0 00000100:00100000:0.0:1782758453.180909:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667712 00000100:00100000:0.0:1782758453.180919:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667712 00000100:00100000:0.0:1782758453.180967:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:0.0:1782758453.180988:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211667712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758453.181056:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211667712:12345-0@lo:400:kworker.0 Request processed in 82us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758453.181063:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00080000:2.0:1782758453.181221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758453.181227:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758453.181229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758453.181264:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211667840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758453.182095:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211667712:0@lo:400:kworker.0 00000100:00100000:0.0:1782758453.679443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758453.679471:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211667968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758453.679546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758453.679746:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211667968 00000100:00100000:1.0:1782758453.679754:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211667968 00000100:00100000:1.0:1782758453.679812:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1782758453.679848:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211667968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758453.679886:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758453.679935:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211667968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758453.679943:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1782758453.679992:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211667968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758453.812954:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758454.379971:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758454.379980:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758454.379985:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758454.380035:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758454.380046:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758454.380057:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758454.380086:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081252a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211668096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758454.380165:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758454.380234:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171932a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758454.380479:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668096 00000100:00100000:3.0:1782758454.380487:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668096 00000100:00100000:3.0:1782758454.380533:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1782758454.380541:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211668096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758454.380566:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758454.380579:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db7ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758454.380601:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758454.380610:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758454.380619:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758454.380666:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211668096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758454.380673:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1782758454.380978:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081252a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211668096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758454.380993:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758454.381004:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758454.381022:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758454.381027:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758454.381034:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758454.834431:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758455.852226:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758456.238015:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211668224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758456.238106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758456.246466:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668224 00000100:00100000:1.0:1782758456.246481:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668224 00000100:00100000:1.0:1782758456.246543:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1782758456.246551:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211668224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758456.246593:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758456.246681:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211668224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (8585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758456.246689:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00080000:1.0:1782758456.246717:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758456.246762:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211668224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758456.255414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758456.258182:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819456 00000100:00100000:3.0:1782758456.258198:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819456 00000100:00100000:3.0:1782758456.258352:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1087 00000100:00100000:3.0:1782758456.258365:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55393:x1869355196819456:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758456.258389:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758456.258476:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d46 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258547:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258562:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258576:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758456.258811:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758456.258818:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758456.258935:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258963:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d46 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258986:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d46 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.258995:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758456.258998:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758456.259002:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758456.259079:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55393:x1869355196819456:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 716us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758456.259087:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1087 00000100:00080000:2.0:1782758456.259727:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758456.266797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758456.266897:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819712 00000100:00100000:3.0:1782758456.266914:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819712 00000100:00100000:3.0:1782758456.266994:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1088 00000100:00100000:3.0:1782758456.267007:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55393:x1869355196819712:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758456.267083:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758456.267130:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d46 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.267151:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db749) 00010000:00010000:3.0:1782758456.267156:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758456.267179:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758456.267215:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.267230:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.267242:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758456.329122:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 00000004:00010000:3.0:1782758456.333286:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9919550 reply state 0000000075cd7b58 transno 4294967718 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758456.333302:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782758456.333482:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:3.0:1782758456.333601:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782758456.333621:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55393:x1869355196819712:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 66612us (66838us total) trans 4294967718 rc 0/0 00000100:00100000:3.0:1782758456.333634:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1088 00010000:00010000:3.0:1782758456.334035:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334045:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334053:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334059:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758456.334063:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334071:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334088:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758456.334091:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758456.334096:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758456.334102:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db7ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758456.876292:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758457.224652:0:94816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1b6b37f0 20000000:00000080:0.0:1782758457.224670:0:94816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30d8000 uarg=0000000000000000 00010000:00010000:0.0:1782758457.225227:0:94816:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758457.225244:0:94816:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758457.225257:0:94816:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758457.225274:0:94816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.225293:0:94816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.225301:0:94816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.225336:0:94816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.225350:0:94816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 18 pid: 5793 timeout: 2625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758457.225364:0:94816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94816:1869355211668352:0@lo:104: 00000100:00100000:0.0:1782758457.225426:0:94816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758457.225475:0:94816:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b582300 going to sleep for 11 seconds 00000100:00100000:2.0:1782758457.225967:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668352 00000100:00100000:2.0:1782758457.225975:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668352 00000100:00100000:2.0:1782758457.226018:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1782758457.226027:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94816:x1869355211668352:12345-0@lo:104: 00010000:00010000:2.0:1782758457.226041:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226116:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758457.226123:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:94816:x1869355211668352:12345-0@lo:104: Request processed in 97us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758457.226130:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00010000:3.0:1782758457.226186:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758457.226193:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758457.226201:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758457.226205:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758457.226214:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758457.226221:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758457.226228:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758457.226262:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758457.226269:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758457.226301:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758457.226309:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777db7ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758457.226323:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758457.226325:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758457.226327:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758457.226454:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211668480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758457.226495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758457.226562:0:94816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94816:1869355211668352:0@lo:104: 00010000:00010000:0.0:1782758457.226582:0:94816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758457.226628:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668480 00000100:00100000:2.0:1782758457.226633:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668480 00010000:00010000:2.0:1782758457.226650:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 2625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758457.226677:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1782758457.226684:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211668480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758457.226693:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758457.226698:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 2625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226708:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 2625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226722:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777db7d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db7ce expref: 19 pid: 5793 timeout: 2625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226734:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226742:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226767:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226775:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226782:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226789:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226795:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758457.226799:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226806:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226841:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758457.226849:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758457.226887:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211668480:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758457.226892:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1782758457.226953:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211668480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758457.226986:0:94816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.226994:0:94816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758457.226999:0:94816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777db7f1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758457.528089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758457.528132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758457.528283:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819968 00000100:00100000:3.0:1782758457.528293:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819968 00000100:00100000:3.0:1782758457.528351:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:3.0:1782758457.528360:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196819968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758457.528457:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196819968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758457.528466:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:2.0:1782758457.529002:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196819840 00000100:00100000:2.0:1782758457.529008:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196819840 00000100:00100000:2.0:1782758457.529043:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1384 00000100:00100000:2.0:1782758457.529050:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196819840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758457.529108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196819840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 58us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758457.529115:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1384 00000100:00100000:0.0:1782758457.532557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758457.532713:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820096 00000100:00100000:1.0:1782758457.532723:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820096 00000100:00100000:1.0:1782758457.532811:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1397 00000100:00100000:1.0:1782758457.532851:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758457.532921:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758457.532928:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1397 00000100:00080000:2.0:1782758457.533581:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758457.534882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758457.535020:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820224 00000100:00100000:0.0:1782758457.535029:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820224 00000100:00100000:0.0:1782758457.535105:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1398 00000100:00100000:0.0:1782758457.535115:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196820224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782758457.535234:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758457.535308:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196820224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 193us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758457.535316:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1398 00010000:00010000:2.0:1782758457.901981:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758458.285112:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211668608:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.285249:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211669120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.285304:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758458.285309:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211668736:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.285340:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211669248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.285393:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669120 00000100:00100000:0.0:1782758458.285399:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669120 00000100:00100000:0.0:1782758458.285450:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668736 00000100:00100000:0.0:1782758458.285454:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668736 00000100:00100000:0.0:1782758458.285491:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:0.0:1782758458.285500:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211669120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285552:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211669120:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758458.285563:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:0.0:1782758458.285586:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1782758458.285592:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211668736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285619:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211668736:12345-0@lo:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758458.285624:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1782758458.285646:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669248 00000100:00100000:0.0:1782758458.285649:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669248 00000100:00100000:0.0:1782758458.285675:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1782758458.285681:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211669248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285710:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211669248:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758458.285717:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:0.0:1782758458.285734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758458.285750:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758458.285784:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211668736:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285795:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211669248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.285804:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211669120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758458.286161:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668608 00000100:00100000:2.0:1782758458.286166:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668608 00000100:00100000:2.0:1782758458.286197:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1782758458.286204:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211668608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758458.286261:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211668608:12345-0@lo:400:kworker.0 Request processed in 57us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758458.286267:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:0.0:1782758458.286361:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211668864:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.286413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.286450:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758458.286512:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211668992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.286539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758458.286573:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211668608:0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.286594:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668992 00000100:00100000:0.0:1782758458.286597:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668992 00000100:00100000:0.0:1782758458.286627:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1782758458.286632:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211668992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758458.286669:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211668992:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758458.286675:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00080000:0.0:1782758458.286692:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758458.286711:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211668992:0@lo:400:kworker.0 00000100:00100000:2.0:1782758458.287770:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211668864 00000100:00100000:2.0:1782758458.287778:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211668864 00000100:00100000:2.0:1782758458.287844:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1782758458.287851:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211668864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758458.287926:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211668864:12345-0@lo:400:kworker.0 Request processed in 75us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758458.287933:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00080000:0.0:1782758458.288034:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758458.288068:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211668864:0@lo:400:kworker.0 00000100:00100000:3.0:1782758458.796635:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758458.796659:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211669376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758458.796753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758458.796814:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669376 00000100:00100000:3.0:1782758458.796844:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669376 00000100:00100000:3.0:1782758458.796890:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1782758458.796898:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211669376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758458.796934:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758458.796978:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211669376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758458.796985:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1782758458.797031:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211669376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758458.923977:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758459.052015:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758459.052026:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758459.052032:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758459.052094:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758459.052106:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758459.052117:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758459.052144:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211669504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758459.052210:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758459.052268:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758459.052780:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669504 00000100:00100000:1.0:1782758459.052789:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669504 00000100:00100000:1.0:1782758459.052887:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1782758459.052897:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211669504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758459.052913:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758459.052929:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db7f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758459.052953:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758459.052964:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758459.052973:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758459.053022:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211669504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758459.053033:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1782758459.053613:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211669504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758459.053631:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758459.053641:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758459.053661:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758459.053666:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758459.053673:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758459.948008:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758460.419776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758460.419870:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820352 00000100:00100000:3.0:1782758460.419882:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820352 00000100:00100000:3.0:1782758460.419943:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1089 00000100:00100000:3.0:1782758460.419952:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55470:x1869355196820352:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758460.419974:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758460.419997:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d4d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420060:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420074:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420087:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420103:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420110:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420116:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420535:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420545:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420552:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758460.420620:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758460.420625:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758460.420689:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420716:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420723:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420730:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420741:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758460.420745:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420754:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420765:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75700) 00010000:00010000:3.0:1782758460.420769:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758460.420773:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420779:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420790:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420796:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420802:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420807:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758460.420810:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420816:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420848:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75500) 00010000:00010000:3.0:1782758460.420851:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758460.420853:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420859:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420887:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d4d expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420900:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d4d expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758460.420908:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758460.420910:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758460.420912:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758460.420975:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55470:x1869355196820352:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1023us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758460.420982:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1089 00000100:00080000:3.0:1782758460.421009:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758460.980428:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758461.362255:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211669632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758461.362327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758461.362399:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669632 00000100:00100000:2.0:1782758461.362407:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669632 00000100:00100000:2.0:1782758461.362458:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1782758461.362468:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211669632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758461.362503:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758461.362546:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211669632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758461.362553:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1782758461.365279:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211669632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758461.371981:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758461.997936:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758462.246583:0:95061:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff614f3460 20000000:00000080:3.0:1782758462.246604:0:95061:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718337e800 uarg=0000000000000000 00010000:00010000:3.0:1782758462.247219:0:95061:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758462.247254:0:95061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758462.247258:0:95061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758462.247269:0:95061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db81b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d4d expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.247298:0:95061:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758462.247314:0:95061:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758462.247326:0:95061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.247340:0:95061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.247349:0:95061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.247386:0:95061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.247400:0:95061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 18 pid: 5793 timeout: 2630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758462.247416:0:95061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95061:1869355211669760:0@lo:104: 00000100:00100000:3.0:1782758462.247485:0:95061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758462.247601:0:95061:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171891ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758462.248243:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782758462.248259:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669760 00000100:00100000:0.0:1782758462.248265:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669760 00000100:00100000:0.0:1782758462.248355:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782758462.248365:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7839450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95061:x1869355211669760:12345-0@lo:104: 00010000:00010000:0.0:1782758462.248380:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758462.248452:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758462.248458:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7839450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95061:x1869355211669760:12345-0@lo:104: Request processed in 95us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758462.248465:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782758462.248555:0:95061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95061:1869355211669760:0@lo:104: 00010000:00010000:3.0:1782758462.248575:0:95061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248643:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758462.248650:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248668:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758462.248672:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248681:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758462.248687:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758462.248694:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758462.248729:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248736:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758462.248755:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248762:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777db7f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db7ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248777:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758462.248779:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758462.248780:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758462.248792:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211669888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758462.248846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758462.248888:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211669888 00000100:00100000:1.0:1782758462.248891:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211669888 00010000:00010000:1.0:1782758462.248909:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 2630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758462.248930:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1782758462.248936:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211669888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758462.248946:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758462.248951:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 2630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248962:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 2630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248974:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db7ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db7f8 expref: 19 pid: 5793 timeout: 2630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248987:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.248996:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249009:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249017:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249024:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249032:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249038:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758462.249042:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249048:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249058:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758462.249066:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758462.249091:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211669888:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758462.249097:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1782758462.249125:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211669888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758462.249281:0:95061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.249289:0:95061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758462.249296:0:95061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777db822 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758462.650945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758462.650999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758462.651028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758462.651057:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820608 00000100:00100000:1.0:1782758462.651065:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820608 00000100:00100000:1.0:1782758462.651121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1810 00000100:00100000:1.0:1782758462.651129:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758462.651201:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758462.651212:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1810 00000100:00080000:1.0:1782758462.651242:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758462.651676:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820480 00000100:00100000:3.0:1782758462.651682:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820480 00000100:00100000:3.0:1782758462.651720:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1387 00000100:00100000:3.0:1782758462.651727:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196820480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758462.651764:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196820480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758462.651772:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1387 00000100:00100000:0.0:1782758462.652143:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820736 00000100:00100000:0.0:1782758462.652148:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820736 00000100:00100000:0.0:1782758462.652197:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1401 00000100:00100000:0.0:1782758462.652206:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758462.652244:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196820736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758462.652250:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1401 00000100:00080000:3.0:1782758462.653420:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758462.661216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758462.661321:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820864 00000100:00100000:0.0:1782758462.661331:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820864 00000100:00100000:0.0:1782758462.661398:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 599 00000100:00100000:0.0:1782758462.661409:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196820864:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782758462.661442:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db685 00000100:00080000:0.0:1782758462.661452:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171a93e7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758462.661491:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967363 00000100:00100000:0.0:1782758462.661797:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196820864:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 388us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758462.661805:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 599 00010000:00010000:0.0:1782758462.661850:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782758462.661993:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758463.020107:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758463.414397:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211670400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414510:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758463.414527:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211670016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414574:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211670528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414615:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211670144:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414675:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211670656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414710:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758463.414714:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211670272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.414761:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670400 00000100:00100000:3.0:1782758463.414768:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670400 00000100:00100000:3.0:1782758463.414811:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670656 00000100:00100000:3.0:1782758463.414814:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670656 00000100:00100000:3.0:1782758463.414852:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1782758463.414861:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211670400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414909:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211670400:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.414917:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1782758463.414932:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1782758463.414937:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211670656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.414960:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211670656:12345-0@lo:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.414966:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1782758463.414981:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670016 00000100:00100000:3.0:1782758463.414984:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670016 00000100:00100000:3.0:1782758463.415003:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1782758463.415008:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415031:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211670016:12345-0@lo:400:kworker.0 Request processed in 24us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.415037:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1782758463.415061:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670528 00000100:00100000:3.0:1782758463.415063:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670528 00000100:00100000:3.0:1782758463.415084:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670144 00000100:00100000:3.0:1782758463.415086:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670144 00000100:00100000:3.0:1782758463.415227:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670272 00000100:00100000:3.0:1782758463.415231:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670272 00000100:00100000:3.0:1782758463.415245:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1782758463.415250:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211670528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415279:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211670528:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.415285:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1782758463.415294:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1782758463.415299:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211670144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415319:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211670144:12345-0@lo:400:kworker.0 Request processed in 20us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.415324:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1782758463.415332:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1782758463.415337:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415357:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211670272:12345-0@lo:400:kworker.0 Request processed in 21us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.415362:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:3.0:1782758463.415386:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758463.415390:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758463.415392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758463.415424:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211670272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415433:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211670144:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415441:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211670656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415468:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211670016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415476:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211670528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.415485:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211670400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758463.916737:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211670784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758463.916808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758463.916894:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670784 00000100:00100000:3.0:1782758463.916901:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670784 00000100:00100000:3.0:1782758463.916948:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1782758463.916956:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211670784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758463.916990:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758463.917028:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211670784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758463.917035:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1782758463.917293:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211670784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758464.048243:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758464.172430:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758464.172437:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758464.172441:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758464.172489:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758464.172501:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758464.172512:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758464.172540:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211670912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758464.172610:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758464.172677:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758464.172739:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211670912 00000100:00100000:1.0:1782758464.172747:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211670912 00000100:00100000:1.0:1782758464.172797:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:1.0:1782758464.172807:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211670912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758464.172850:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758464.172867:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db829 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758464.172892:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758464.172902:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758464.172911:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782758464.172954:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211670912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758464.172961:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1782758464.173061:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211670912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758464.173079:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758464.173087:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758464.173107:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758464.173113:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758464.173124:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758465.068706:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758465.515258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758465.515350:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196820992 00000100:00100000:3.0:1782758465.515361:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196820992 00000100:00100000:3.0:1782758465.515448:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1090 00000100:00100000:3.0:1782758465.515459:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55559:x1869355196820992:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758465.515479:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758465.515504:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d54 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515578:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515592:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515615:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758465.515849:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1782758465.515854:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758465.515935:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515963:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d54 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515986:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d54 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758465.515995:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758465.515998:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758465.516002:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758465.516060:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55559:x1869355196820992:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 604us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758465.516067:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1090 00000100:00080000:0.0:1782758465.516388:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758465.532629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758465.536036:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821248 00000100:00100000:2.0:1782758465.536051:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821248 00000100:00100000:2.0:1782758465.539283:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1091 00000100:00100000:2.0:1782758465.539304:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55559:x1869355196821248:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758465.539578:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758465.539625:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777db83e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d54 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758465.539643:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db81b) 00010000:00010000:2.0:1782758465.539648:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782758465.539660:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758465.539686:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758465.539700:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758465.539710:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758465.540159:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034c5c783 reply state 000000008368bd13 transno 4294967719 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758465.540170:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758465.540242:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:2.0:1782758465.540682:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55559:x1869355196821248:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 1382us (8060us total) trans 4294967719 rc 0/0 00000100:00100000:2.0:1782758465.540692:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1091 00010000:00010000:1.0:1782758465.546656:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546677:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546684:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546693:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758465.546697:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546705:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546733:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1300) 00010000:00010000:1.0:1782758465.546736:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758465.546741:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758465.546747:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758466.093200:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758466.388737:0:95257:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1c33db20 20000000:00000080:1.0:1782758466.388760:0:95257:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d5800 uarg=0000000000000000 00010000:00010000:1.0:1782758466.389024:0:95257:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758466.389040:0:95257:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758466.389054:0:95257:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758466.389074:0:95257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.389091:0:95257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.389099:0:95257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.389136:0:95257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.389150:0:95257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 18 pid: 5793 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758466.389165:0:95257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95257:1869355211671040:0@lo:104: 00000100:00100000:1.0:1782758466.389230:0:95257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758466.389280:0:95257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170812ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758466.389386:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671040 00000100:00100000:0.0:1782758466.389394:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671040 00000100:00100000:0.0:1782758466.389438:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1782758466.389447:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95257:x1869355211671040:12345-0@lo:104: 00010000:00010000:0.0:1782758466.389460:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758466.389522:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758466.389528:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95257:x1869355211671040:12345-0@lo:104: Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758466.389535:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:3.0:1782758466.389770:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758466.389779:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.389786:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758466.389790:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.389799:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758466.389811:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758466.389817:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758466.389868:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.389876:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758466.389911:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.389917:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777db829 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db830 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.389933:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758466.389935:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758466.389937:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758466.389944:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758466.389955:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211671168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758466.389986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758466.390021:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671168 00000100:00100000:3.0:1782758466.390026:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671168 00010000:00010000:3.0:1782758466.390047:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 19 pid: 5793 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758466.390067:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1782758466.390073:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211671168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758466.390083:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758466.390089:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 19 pid: 5793 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390099:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 19 pid: 5793 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390116:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390124:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390138:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390145:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390151:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390157:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390161:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758466.390165:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390171:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390180:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758466.390188:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758466.390216:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211671168:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758466.390223:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1782758466.390259:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211671168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758466.393818:0:95257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777db830 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db829 expref: 18 pid: 5793 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758466.393865:0:95257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95257:1869355211671040:0@lo:104: 00010000:00010000:1.0:1782758466.393894:0:95257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.393905:0:95257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.393912:0:95257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758466.393918:0:95257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db84c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758466.478815:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758466.478859:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211671296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758466.478958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758466.479353:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671296 00000100:00100000:2.0:1782758466.479361:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671296 00000100:00100000:2.0:1782758466.479414:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1782758466.479422:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211671296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758466.479455:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758466.479498:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211671296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758466.479505:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00080000:0.0:1782758466.479584:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758466.479615:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211671296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782758466.539565:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967719 is committed 00010000:00010000:3.0:1782758467.115955:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782758467.599350:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758467.599361:0:7507:0:(genops.c:906:class_export_put()) final put ffff9171a93e3000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758467.599439:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171a93e3000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:1.0:1782758467.599491:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171a93e7000 for lustre-OST0001 10000000:01000000:0.0:1782758467.691983:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758467.692007:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758467.692014:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758467.692070:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758467.692084:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758467.692096:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758467.692122:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211671424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758467.692195:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758467.692271:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182c540 going to sleep for 11 seconds 00000100:00100000:3.0:1782758467.692776:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671424 00000100:00100000:3.0:1782758467.692789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671424 00000100:00100000:2.0:1782758467.693057:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1782758467.693069:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211671424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758467.693084:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758467.693099:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db853 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758467.693123:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758467.693133:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758467.693147:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758467.693208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211671424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758467.693216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1782758467.693298:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211671424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758467.693316:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758467.693325:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758467.693345:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758467.693350:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758467.693356:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758467.764405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758467.764457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758467.764569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758467.764605:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821632 00000100:00100000:3.0:1782758467.764614:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821632 00000100:00100000:3.0:1782758467.764682:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00100000:3.0:1782758467.764692:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196821632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758467.764772:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196821632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758467.764780:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00080000:3.0:1782758467.764804:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758467.764978:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821504 00000100:00100000:1.0:1782758467.764983:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821504 00000100:00100000:1.0:1782758467.765026:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:1.0:1782758467.765033:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196821504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758467.765080:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196821504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758467.765087:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:2.0:1782758467.765340:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821376 00000100:00100000:2.0:1782758467.765344:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821376 00000100:00100000:2.0:1782758467.765388:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1391 00000100:00100000:2.0:1782758467.765396:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196821376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758467.765441:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196821376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758467.765448:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1391 00000100:00080000:3.0:1782758467.765959:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758468.143134:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758468.525011:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211671552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758468.525087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758468.533289:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758468.533311:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211671680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758468.533384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758468.535095:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671552 00000100:00100000:2.0:1782758468.535110:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671552 00000100:00100000:2.0:1782758468.535159:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671680 00000100:00100000:2.0:1782758468.535163:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671680 00000100:00100000:2.0:1782758468.535196:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:2.0:1782758468.535206:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211671552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758468.535307:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758468.535323:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211671808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758468.535471:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211671552:12345-0@lo:400:kworker.0 Request processed in 266us (10383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758468.535479:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:2.0:1782758468.535497:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1782758468.535504:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211671680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758468.535547:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211671680:12345-0@lo:400:kworker.0 Request processed in 31us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758468.535555:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1782758468.535638:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758468.535647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211671936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758468.535690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758468.535748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758468.535756:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211672064:0@lo:400:kworker.0 00000100:00100000:2.0:1782758468.535785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782758468.535878:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758468.535889:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671936 00000100:00100000:2.0:1782758468.535893:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671936 00000100:00100000:2.0:1782758468.535923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1782758468.535930:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211671936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758468.535965:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211671936:12345-0@lo:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758468.535971:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00080000:2.0:1782758468.535984:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758468.536012:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211671936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758468.539107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758468.540029:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672064 00000100:00100000:0.0:1782758468.540041:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672064 00000100:00100000:0.0:1782758468.540104:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211671808 00000100:00100000:0.0:1782758468.540108:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211671808 00000100:00100000:0.0:1782758468.540136:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1782758468.540145:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211672064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758468.540233:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211672064:12345-0@lo:400:kworker.0 Request processed in 88us (4445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758468.540241:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1782758468.540268:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782758468.540275:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211671808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758468.540307:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211671808:12345-0@lo:400:kworker.0 Request processed in 33us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758468.540313:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782758468.540362:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211672064:0@lo:400:kworker.0 00000100:00080000:1.0:1782758468.540576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758468.540581:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758468.540613:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211671808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758468.541491:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211671680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758468.541511:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211671552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758469.036426:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211672192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758469.036500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758469.036620:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672192 00000100:00100000:1.0:1782758469.036628:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672192 00000100:00100000:1.0:1782758469.036682:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1782758469.036692:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211672192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758469.036727:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758469.036777:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211672192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758469.036784:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1782758469.042648:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211672192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758469.181641:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758469.954039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758469.956274:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821760 00000100:00100000:2.0:1782758469.956292:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821760 00000100:00100000:2.0:1782758469.956395:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1092 00000100:00080000:1.0:1782758469.956495:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758469.957546:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196821760:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758469.957723:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196821760:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 192us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758469.957732:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1092 00000100:00100000:3.0:1782758469.967505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758469.968302:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196821888 00000100:00100000:0.0:1782758469.968330:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196821888 00000100:00100000:0.0:1782758469.968414:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 600 00000100:00100000:0.0:1782758469.968425:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196821888:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758469.968923:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196821888:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 497us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758469.968933:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 600 00000100:00080000:1.0:1782758469.969541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758469.972615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758469.972792:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822016 00000100:00100000:3.0:1782758469.972802:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822016 00000100:00100000:3.0:1782758469.972890:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 601 00000100:00100000:3.0:1782758469.972898:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196822016:12345-192.168.204.31@tcp:8:lfs.60003 00010000:00080000:3.0:1782758469.972930:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2538 last 0 00000020:00000080:3.0:1782758469.972961:0:6599:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777db861 00002000:00100000:3.0:1782758469.972973:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917082a78000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758469.972985:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758469.974367:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782758469.974410:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758469.974490:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196822016:12345-192.168.204.31@tcp:8:lfs.60003 Request processed in 1590us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758469.974501:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 601 00000100:00100000:2.0:1782758469.977880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758469.977974:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822144 00000100:00100000:0.0:1782758469.977985:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822144 00000100:00100000:0.0:1782758469.978070:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 602 00000100:00100000:0.0:1782758469.978082:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55644:x1869355196822144:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:1.0:1782758469.978119:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758469.978466:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55644:x1869355196822144:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 384us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758469.978474:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 602 00000100:00100000:1.0:1782758469.982076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758469.982244:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822272 00000100:00100000:2.0:1782758469.982255:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822272 00000100:00100000:2.0:1782758469.982316:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:2.0:1782758469.982327:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822272:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758469.982801:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822272:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 473us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758469.982811:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1093 00000100:00100000:1.0:1782758469.986712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758469.987259:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822400 00000100:00100000:3.0:1782758469.987269:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822400 00000100:00100000:3.0:1782758469.987324:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1094 00000100:00100000:3.0:1782758469.987334:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822400:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758469.987483:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822400:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 149us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758469.987492:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1094 00000100:00100000:3.0:1782758469.989740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758469.990225:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822528 00000100:00100000:1.0:1782758469.990235:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822528 00000100:00100000:0.0:1782758469.990399:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 603 00000100:00100000:0.0:1782758469.990410:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822528:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758469.992300:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822528:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1882us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758469.992312:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 603 00000100:00100000:3.0:1782758469.994710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758469.995126:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822656 00000100:00100000:0.0:1782758469.995137:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822656 00000100:00100000:0.0:1782758469.995267:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 604 00000100:00100000:0.0:1782758469.995279:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55644:x1869355196822656:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758469.996972:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55644:x1869355196822656:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1685us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758469.996984:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 604 00000100:00100000:0.0:1782758469.999383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758469.999493:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822784 00000100:00100000:2.0:1782758469.999504:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822784 00000100:00100000:2.0:1782758469.999612:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1095 00000100:00100000:2.0:1782758469.999622:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822784:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758470.001249:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55644:x1869355196822784:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1620us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758470.001262:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1095 00000100:00100000:1.0:1782758470.058985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758470.059414:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196822912 00000100:00100000:2.0:1782758470.059425:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196822912 00000100:00100000:2.0:1782758470.059494:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000100:00100000:2.0:1782758470.059515:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55648:x1869355196822912:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758470.059537:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758470.059589:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777db868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d5b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059656:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059670:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059683:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059703:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059711:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.059729:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.060873:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.060888:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.060898:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758470.060987:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1782758470.060992:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758470.061075:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061089:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061095:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061102:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061113:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758470.061117:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061124:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061137:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782758470.061140:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758470.061146:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061152:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777db86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061165:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061171:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061177:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061182:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758470.061184:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061189:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061206:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917182dd1c00) 00010000:00010000:2.0:1782758470.061208:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758470.061211:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061217:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777db876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061252:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777db868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d5b expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061269:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d5b expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758470.061276:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782758470.061278:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758470.061280:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758470.061340:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55648:x1869355196822912:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1836us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758470.061348:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1096 00000100:00100000:3.0:1782758470.068597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758470.068699:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823168 00000100:00100000:0.0:1782758470.068710:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823168 00000100:00100000:0.0:1782758470.068787:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1097 00000100:00100000:0.0:1782758470.068799:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55648:x1869355196823168:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782758470.069063:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758470.069085:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db884 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d62 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069421:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069442:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069455:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069469:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069475:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.069481:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758470.070635:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1782758470.071685:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.071704:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.071714:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072120:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072127:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072134:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072140:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758470.072144:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072151:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072174:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1400) 00010000:00010000:0.0:1782758470.072177:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758470.072182:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072187:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777db88b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758470.072199:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f08bdb1f reply state 00000000c3a0ec1b transno 4294967720 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758470.072208:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758470.072243:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777db884 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d62 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072257:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d62 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.072264:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758470.072266:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758470.072268:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758470.072346:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:55648:x1869355196823168:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 3549us (3759us total) trans 4294967720 rc 0/0 00000100:00100000:0.0:1782758470.072354:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1097 00010000:00010000:3.0:1782758470.076472:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076503:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076521:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076527:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758470.076533:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076542:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076561:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff91718bcfdb00) 00010000:00010000:3.0:1782758470.076564:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758470.076568:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758470.076575:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777db892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758470.081330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758470.082465:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823296 00000100:00100000:0.0:1782758470.082557:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823296 00000100:00100000:0.0:1782758470.082670:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 605 00000100:00100000:0.0:1782758470.082682:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55648:x1869355196823296:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782758470.082700:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758470.082734:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d69 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758470.082764:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782758470.082787:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2538s v=(0 0) 00010000:00010000:0.0:1782758470.082793:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758470.082803:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.082853:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758470.082866:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758470.082931:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55648:x1869355196823296:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 251us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758470.082938:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 605 00000100:00100000:2.0:1782758470.109937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758470.110113:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823424 00000100:00100000:3.0:1782758470.110123:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823424 00002000:00100000:3.0:1782758470.110176:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9170818cd880 x1869355196823424/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:386/0 lens 488/0 e 0 to 0 dl 1782758481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1782758470.110187:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170818cd880 with x1869355196823424 ext(0->1048575) 00002000:00010000:3.0:1782758470.110193:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9170818cd880 00000100:00100000:3.0:1782758470.110228:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1782758470.110238:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196823424:12345-192.168.204.31@tcp:4:dd.60003 00000001:00100000:3.0:1782758470.171481:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00010000:00010000:3.0:1782758470.188169:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758470.216339:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196823424:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 106091us (106401us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1782758470.216356:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00002000:00100000:0.0:1782758470.216371:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9170818cd880 x1869355196823424/t4294967364(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:386/0 lens 488/448 e 0 to 0 dl 1782758481 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1782758470.216382:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170818cd880 with x1869355196823424 ext(0->1048575) 00002000:00010000:0.0:1782758470.216390:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9170818cd880 00000001:00080000:3.0:1782758470.219395:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000100:00100000:1.0:1782758470.221313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758470.221603:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823552 00000100:00100000:2.0:1782758470.221614:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823552 00000100:00100000:2.0:1782758470.221682:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1098 00000100:00100000:2.0:1782758470.221693:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:55648:x1869355196823552:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:0.0:1782758470.259315:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967720 is committed 00000100:00100000:2.0:1782758470.259550:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55648:x1869355196823552:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 37851us (38239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758470.259565:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1098 00000100:00100000:1.0:1782758470.267292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758470.267393:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823680 00000100:00100000:3.0:1782758470.267406:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823680 00000100:00100000:3.0:1782758470.267481:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 606 00000100:00100000:3.0:1782758470.267494:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196823680:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:3.0:1782758470.267628:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196823680:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 136us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758470.267636:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 606 00000100:00100000:0.0:1782758470.271418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758470.271602:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196823936 00000100:00100000:3.0:1782758470.271615:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196823936 00000100:00100000:3.0:1782758470.271740:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 111 00000100:00100000:3.0:1782758470.271752:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55648:x1869355196823936:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:3.0:1782758470.273273:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:55648:x1869355196823936:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 1514us (1855us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1782758470.273287:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 111 00010000:00010000:1.0:1782758471.212390:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758471.495010:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00000100:00100000:3.0:1782758471.598846:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758471.598872:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211672320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758471.598942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758471.599604:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672320 00000100:00100000:0.0:1782758471.599613:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672320 00000100:00100000:0.0:1782758471.599676:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1782758471.599685:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211672320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758471.599734:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758471.599790:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211672320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758471.599797:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00080000:3.0:1782758471.600107:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758471.600147:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211672320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758472.236902:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758472.886941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758472.886983:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758472.887015:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824064 00000100:00100000:2.0:1782758472.887024:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824064 00000100:00100000:2.0:1782758472.887070:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1392 00000100:00100000:2.0:1782758472.887080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196824064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758472.887874:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824320 00000100:00100000:1.0:1782758472.887882:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824320 00000100:00100000:1.0:1782758472.887934:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1407 00000100:00100000:2.0:1782758472.887939:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196824064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 860us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758472.887942:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196824320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758472.887948:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1392 00000100:00100000:1.0:1782758472.887976:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196824320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758472.887983:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1407 00000100:00080000:0.0:1782758472.888387:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758472.912045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758472.912223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758472.912350:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824448 00000100:00100000:1.0:1782758472.912360:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824448 00000100:00100000:1.0:1782758472.912436:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000100:00100000:1.0:1782758472.912447:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196824448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758472.912520:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196824448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758472.912527:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000100:00080000:1.0:1782758472.912550:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758472.917408:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824192 00000100:00100000:0.0:1782758472.917437:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824192 00000100:00100000:0.0:1782758472.917538:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:0.0:1782758472.917549:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196824192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758472.917648:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196824192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (5616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758472.917656:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00080000:2.0:1782758472.919555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1782758472.964781:0:95504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2541367955387ns, next at 2520432339245ns, rc = 0 00000004:00080000:3.0:1782758472.966962:0:95504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2541370127190ns, next at 2492359996764ns, rc = 0 00000004:00080000:0.0:1782758472.970616:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:0.0:1782758472.970646:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00010000:00010000:3.0:1782758473.260016:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758473.649210:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211672576:0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758473.649326:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211673088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758473.649373:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758473.649379:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211672704:0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758473.649462:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672576 00000100:00100000:3.0:1782758473.649469:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672576 00000100:00100000:3.0:1782758473.649511:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672704 00000100:00100000:3.0:1782758473.649515:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672704 00000100:00100000:3.0:1782758473.649546:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:3.0:1782758473.649554:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211672576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649603:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211672576:12345-0@lo:400:kworker.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758473.649610:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:3.0:1782758473.649629:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1782758473.649636:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211672704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649662:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211672704:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758473.649668:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1782758473.649708:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211672704:0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.649718:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211672576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650130:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211672448:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758473.650202:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211672960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758473.650244:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758473.650248:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211672832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758473.650294:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672960 00000100:00100000:2.0:1782758473.650297:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672960 00000100:00100000:2.0:1782758473.650324:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:2.0:1782758473.650331:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211672960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650368:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211672960:12345-0@lo:400:kworker.0 Request processed in 37us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758473.650373:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00080000:2.0:1782758473.650390:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758473.650418:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673088 00000100:00100000:2.0:1782758473.650421:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673088 00000100:00100000:2.0:1782758473.650461:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672832 00000100:00100000:2.0:1782758473.650464:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672832 00000100:00100000:2.0:1782758473.650487:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1782758473.650493:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211673088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650530:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211673088:12345-0@lo:400:kworker.0 Request processed in 37us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758473.650536:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1782758473.650547:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1782758473.650553:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211672832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650578:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211672832:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758473.650583:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00080000:2.0:1782758473.650602:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758473.650605:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758473.650623:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211672832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650631:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211672960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758473.650659:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211673088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.651019:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211672448 00000100:00100000:3.0:1782758473.651025:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211672448 00000100:00100000:3.0:1782758473.651058:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:3.0:1782758473.651065:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211672448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758473.651115:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211672448:12345-0@lo:400:kworker.0 Request processed in 51us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758473.651122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1782758473.651230:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211672448:0@lo:400:kworker.0 00000100:00100000:0.0:1782758474.160382:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758474.160405:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211673216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758474.160492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758474.160604:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673216 00000100:00100000:1.0:1782758474.160612:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673216 00000100:00100000:1.0:1782758474.160666:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1782758474.160676:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211673216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758474.160712:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782758474.160758:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211673216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758474.160765:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1782758474.160883:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211673216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758474.285227:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758474.554075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758474.556246:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824576 00000100:00100000:1.0:1782758474.556261:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824576 00000100:00100000:1.0:1782758474.556382:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1099 00000100:00100000:1.0:1782758474.556394:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196824576:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758474.556510:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196824576:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 119us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758474.556518:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1099 00000100:00100000:0.0:1782758474.560059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758474.560165:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824704 00000100:00100000:1.0:1782758474.560175:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824704 00000100:00080000:2.0:1782758474.561695:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758474.561705:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758474.562261:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 607 00000100:00100000:1.0:1782758474.562276:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55840:x1869355196824704:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758474.562704:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55840:x1869355196824704:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 431us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758474.562715:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 607 00000100:00100000:0.0:1782758474.567355:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.570663:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824832 00000100:00100000:3.0:1782758474.570678:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824832 00000100:00100000:3.0:1782758474.570775:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 608 00000100:00100000:3.0:1782758474.570786:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55840:x1869355196824832:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758474.571204:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55840:x1869355196824832:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 419us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.571213:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 608 00000100:00080000:0.0:1782758474.571339:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758474.573210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.573288:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196824960 00000100:00100000:3.0:1782758474.573298:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196824960 00000100:00100000:3.0:1782758474.573352:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:3.0:1782758474.573363:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196824960:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758474.573912:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196824960:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 549us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.573922:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1100 00000100:00100000:0.0:1782758474.576641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.576727:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825088 00000100:00100000:3.0:1782758474.576751:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825088 00000100:00100000:3.0:1782758474.576811:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1101 00000100:00100000:3.0:1782758474.576845:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196825088:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758474.576937:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196825088:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.576944:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1101 00000100:00100000:0.0:1782758474.581773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.581892:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825216 00000100:00100000:3.0:1782758474.581902:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825216 00000100:00100000:3.0:1782758474.581957:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 609 00000100:00100000:3.0:1782758474.581968:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55840:x1869355196825216:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758474.582358:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:55840:x1869355196825216:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 391us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.582367:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 609 00000100:00100000:0.0:1782758474.584511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.584583:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825344 00000100:00100000:3.0:1782758474.584593:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825344 00000100:00100000:3.0:1782758474.584645:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:3.0:1782758474.584655:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55840:x1869355196825344:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758474.585096:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:55840:x1869355196825344:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 441us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.585106:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:0.0:1782758474.587232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.587305:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825472 00000100:00100000:3.0:1782758474.587315:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825472 00000100:00100000:3.0:1782758474.587365:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1102 00000100:00100000:3.0:1782758474.587375:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196825472:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758474.587885:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55840:x1869355196825472:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 509us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758474.587894:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1102 00000100:00100000:1.0:1782758474.694878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758474.695055:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825728 00000100:00100000:3.0:1782758474.695066:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825728 00000100:00100000:3.0:1782758474.695132:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1103 00000100:00100000:3.0:1782758474.695141:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:55844:x1869355196825728:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:3.0:1782758474.695196:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758474.695226:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777db899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d62 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695246:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:3.0:1782758474.695265:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758474.695288:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695301:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695310:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695323:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695330:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695337:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695724:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695953:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.695966:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758474.697492:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:3.0:1782758474.697507:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2543100683765ns, next at 2544100681235ns, rc = 0 00010000:00010000:3.0:1782758474.697620:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697634:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697645:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697654:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697660:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697667:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697869:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758474.697896:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697903:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697910:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697916:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758474.697921:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697929:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697940:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758474.697943:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758474.697948:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697954:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697972:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697979:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697989:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.697995:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758474.697998:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.698003:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.698010:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782758474.698012:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758474.698015:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758474.698021:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777db8ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758474.698028:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054b39875 reply state 00000000bb8a5a0f transno 4294967722 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758474.698037:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758474.698123:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:55844:x1869355196825728:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 2980us (3253us total) trans 4294967722 rc 0/0 00000100:00100000:3.0:1782758474.698131:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1103 00010000:00010000:0.0:1782758474.705067:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758474.705082:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758474.705094:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758474.705098:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758474.705108:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758474.705126:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff917191f75300) 00010000:00010000:0.0:1782758474.705129:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758474.705134:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758474.705140:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777db8c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758474.705169:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758474.705171:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758474.705173:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758474.706612:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706628:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706636:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706641:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758474.706646:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706653:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706668:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff917191f75400) 00010000:00010000:2.0:1782758474.706671:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758474.706674:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758474.706679:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777db8b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758475.309761:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758476.334928:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758476.716507:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758476.716533:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211673344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758476.716620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758476.716861:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673344 00000100:00100000:0.0:1782758476.716870:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673344 00000100:00080000:1.0:1782758476.716924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758476.716939:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1782758476.716950:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211673344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758476.716990:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758476.717057:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211673344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758476.717064:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1782758476.717229:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211673344:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782758476.822623:0:95648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2545225797453ns, next at 2520432339245ns, rc = 0 00000004:00080000:0.0:1782758476.822758:0:95648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2545225934829ns, next at 2544100681235ns, rc = 0 00000004:00080000:3.0:1782758476.894407:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000004:00080000:3.0:1782758476.894432:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000001:00080000:3.0:1782758476.894448:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000004:00080000:3.0:1782758476.894452:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000100:00100000:3.0:1782758476.894589:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758476.894612:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211673472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782758476.894688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758476.894757:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673472 00000100:00100000:3.0:1782758476.894763:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673472 00000100:00080000:1.0:1782758476.894817:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758476.894843:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1782758476.894854:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211673472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782758476.894881:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:3.0:1782758476.894904:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758476.894924:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758476.894933:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782758476.894937:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758476.894940:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758476.894964:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758476.894979:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 5 pid: 9120 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758476.894991:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211673600:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758476.895055:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171869993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758476.900076:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211673600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758476.900076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782758476.900107:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758476.900180:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825856 00000100:00100000:2.0:1782758476.900186:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825856 00010000:00010000:2.0:1782758476.900238:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 6 pid: 9120 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758476.900271:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 437 00000100:00100000:2.0:1782758476.900280:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196825856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758476.900293:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758476.900298:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 6 pid: 9120 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.900310:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 6 pid: 9120 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.900333:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777db8a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d69 expref: 6 pid: 9120 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.900348:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758476.900352:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758476.900358:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.900367:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.900405:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758476.900445:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196825856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758476.900453:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 437 00010000:00010000:0.0:1782758476.900574:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758476.900583:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758476.900593:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758476.900601:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758476.900628:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782758476.901200:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211673472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6345us (6509us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1782758476.901209:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000004:00080000:3.0:1782758476.901294:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170826b8a80/2, rc 0, transno 4294967365 00000100:00100000:3.0:1782758476.901309:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211673472:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1782758476.901789:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758476.902032:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758476.902039:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.902057:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758476.902062:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.902070:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.902088:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.902095:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd19ce7c/0xdd99f5c4777db8ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758476.902114:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758476.902115:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758476.902117:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758477.357329:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758478.004510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758478.004551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758478.004587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758478.004617:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758478.004645:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196825984 00000100:00100000:1.0:1782758478.004654:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196825984 00000100:00100000:1.0:1782758478.004711:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1394 00000100:00100000:1.0:1782758478.004731:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196825984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758478.004803:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196825984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.004812:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1394 00000100:00100000:1.0:1782758478.004866:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826368 00000100:00100000:1.0:1782758478.004869:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826368 00000100:00100000:1.0:1782758478.004894:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826240 00000100:00100000:1.0:1782758478.004897:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826240 00000100:00100000:1.0:1782758478.004915:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1411 00000100:00100000:1.0:1782758478.004921:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196826368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758478.004946:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196826368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.004952:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1411 00000100:00100000:1.0:1782758478.004961:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1412 00000100:00100000:1.0:1782758478.004966:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196826240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758478.004985:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196826240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 18us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.004991:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1412 00000100:00080000:1.0:1782758478.005100:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758478.005104:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758478.005273:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826112 00000100:00100000:0.0:1782758478.005278:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826112 00000100:00100000:0.0:1782758478.005319:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:0.0:1782758478.005325:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196826112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758478.005372:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196826112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758478.005378:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00080000:1.0:1782758478.005492:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758478.381042:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758478.765437:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211673984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.765449:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211674112:0@lo:400:kworker.0 00000100:00100000:0.0:1782758478.765546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758478.765556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758478.765655:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211673728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758478.765843:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211673856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758478.766050:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673984 00000100:00100000:0.0:1782758478.766071:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673984 00000100:00100000:0.0:1782758478.766150:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1782758478.766161:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211673984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.770895:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674112 00000100:00100000:1.0:1782758478.770912:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674112 00000100:00100000:1.0:1782758478.770985:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1782758478.770995:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211674112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.771087:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211674112:12345-0@lo:400:kworker.0 Request processed in 92us (5539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.771096:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:1.0:1782758478.771125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758478.771130:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758478.771165:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211674112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758478.772364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758478.772415:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211674240:0@lo:400:kworker.0 00000100:00100000:2.0:1782758478.772456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758478.772513:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674240 00000100:00100000:2.0:1782758478.772519:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674240 00000100:00100000:3.0:1782758478.775700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758478.775795:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211674368:0@lo:400:kworker.0 00000100:00100000:3.0:1782758478.775881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758478.775965:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674368 00000100:00100000:3.0:1782758478.775976:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674368 00000100:00100000:1.0:1782758478.776143:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673728 00000100:00100000:1.0:1782758478.776159:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673728 00000100:00100000:1.0:1782758478.776235:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1782758478.776246:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211673728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.776378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211673728:12345-0@lo:400:kworker.0 Request processed in 132us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.776386:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1782758478.776462:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211673856 00000100:00100000:1.0:1782758478.776467:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211673856 00000100:00100000:2.0:1782758478.776598:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211673728:0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.776666:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:1.0:1782758478.776674:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211673856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.776719:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211673856:12345-0@lo:400:kworker.0 Request processed in 46us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.776725:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1782758478.785713:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211673984:12345-0@lo:400:kworker.0 Request processed in 19003us (19618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758478.785736:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1782758478.785994:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211673984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.786542:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:1.0:1782758478.786560:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211674240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758478.786673:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211674240:12345-0@lo:400:kworker.0 Request processed in 121us (14215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758478.786679:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:1.0:1782758478.787132:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211674240:0@lo:400:kworker.0 00000100:00100000:0.0:1782758478.787636:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211673856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758478.787960:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1782758478.787974:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211674368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758478.788079:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211674368:12345-0@lo:400:kworker.0 Request processed in 108us (12197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758478.788088:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1782758478.788415:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211674368:0@lo:400:kworker.0 00000100:00080000:2.0:1782758478.796443:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758478.796456:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758479.276652:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758479.276765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758479.276982:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674496 00000100:00100000:0.0:1782758479.276990:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674496 00000100:00100000:0.0:1782758479.277051:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1782758479.277062:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211674496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758479.277100:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758479.277158:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211674496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758479.277165:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1782758479.277618:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211674496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758479.404903:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758479.873101:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00010000:00010000:3.0:1782758480.428997:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758481.453923:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758481.838083:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211674624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758481.838159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758481.839648:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674624 00000100:00100000:0.0:1782758481.839659:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674624 00000100:00100000:0.0:1782758481.839731:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:0.0:1782758481.839742:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211674624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758481.839786:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758481.839888:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211674624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758481.839896:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00080000:0.0:1782758481.839927:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758481.840157:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211674624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758482.476202:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758483.124773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758483.124881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758483.124922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758483.124958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758483.124972:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826752 00000100:00100000:2.0:1782758483.124983:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826752 00000100:00100000:1.0:1782758483.124986:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826880 00000100:00100000:1.0:1782758483.124991:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826880 00000100:00100000:2.0:1782758483.125051:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1415 00000100:00100000:0.0:1782758483.125054:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826624 00000100:00100000:0.0:1782758483.125059:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826624 00000100:00100000:2.0:1782758483.125063:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196826752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758483.125145:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196826752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758483.125153:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1415 00000100:00100000:1.0:1782758483.129754:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1416 00000100:00100000:1.0:1782758483.129773:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196826880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758483.129865:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196826880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758483.129874:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1416 00000100:00100000:3.0:1782758483.130754:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196826496 00000100:00100000:3.0:1782758483.130765:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196826496 00000100:00100000:3.0:1782758483.130811:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1396 00000100:00100000:3.0:1782758483.130820:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196826496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758483.130886:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196826496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (6122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758483.130893:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1396 00000100:00080000:2.0:1782758483.131314:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758483.131421:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758483.131425:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758483.131599:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:0.0:1782758483.131610:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196826624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758483.131669:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196826624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 62us (6746us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758483.131677:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1826 00010000:00010000:3.0:1782758483.505223:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758483.884513:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211675008:0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.884578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758483.884647:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758483.884653:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211675136:0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.884679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758483.884789:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675136 00000100:00100000:2.0:1782758483.884798:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675136 00000100:00100000:3.0:1782758483.884844:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211674752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758483.884866:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1782758483.884875:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211675136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758483.884877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758483.884901:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211675264:0@lo:400:kworker.0 00000100:00100000:3.0:1782758483.884921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758483.884933:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211675136:12345-0@lo:400:kworker.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758483.884936:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758483.884941:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211674880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758483.884941:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1782758483.884961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758483.884974:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211675392:0@lo:400:kworker.0 00000100:00100000:2.0:1782758483.884981:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211675136:0@lo:400:kworker.0 00000100:00100000:3.0:1782758483.884992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758483.885005:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675392 00000100:00100000:2.0:1782758483.885008:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675392 00000100:00100000:3.0:1782758483.885019:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674752 00000100:00100000:3.0:1782758483.885022:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674752 00000100:00100000:3.0:1782758483.885042:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1782758483.885042:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1782758483.885048:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211674752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758483.885048:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211675392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.885120:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675008 00000100:00100000:0.0:1782758483.885121:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675264 00000100:00100000:1.0:1782758483.885123:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675008 00000100:00100000:0.0:1782758483.885124:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675264 00000100:00100000:1.0:1782758483.885149:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211674880 00000100:00100000:1.0:1782758483.885151:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211674880 00000100:00100000:3.0:1782758483.885152:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211674752:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758483.885162:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1782758483.885664:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211675392:12345-0@lo:400:kworker.0 Request processed in 615us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758483.885672:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:2.0:1782758483.885737:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1782758483.885745:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211675008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758483.885782:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211675008:12345-0@lo:400:kworker.0 Request processed in 39us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758483.885788:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:3.0:1782758483.886697:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:3.0:1782758483.886929:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170826b8a80, transno 4294967365 00000100:00100000:3.0:1782758483.886948:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211675392:0@lo:400:kworker.0 00000100:00100000:3.0:1782758483.886965:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211674752:0@lo:400:kworker.0 00000100:00080000:3.0:1782758483.889995:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758483.890006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758483.890009:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758483.890068:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211675008:0@lo:400:kworker.0 00000100:00100000:0.0:1782758483.890548:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1782758483.890566:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211675264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.890578:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1782758483.890675:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211675264:12345-0@lo:400:kworker.0 Request processed in 114us (5750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758483.890682:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1782758483.890729:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211675264:0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.890776:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211674880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758483.890839:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211674880:12345-0@lo:400:kworker.0 Request processed in 254us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758483.890846:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1782758483.894514:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211674880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758484.400248:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211675520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758484.400322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758484.400538:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675520 00000100:00100000:0.0:1782758484.400554:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675520 00000100:00100000:0.0:1782758484.400624:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1782758484.400633:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211675520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758484.400671:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758484.400731:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211675520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758484.400739:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1782758484.401664:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211675520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758484.524041:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758485.548535:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758486.574473:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758486.956741:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211675648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758486.956862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758486.956927:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675648 00000100:00100000:0.0:1782758486.956943:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675648 00000100:00100000:0.0:1782758486.957033:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1782758486.957046:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211675648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758486.957103:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758486.957223:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211675648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758486.957232:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1782758486.957305:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211675648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758486.963248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758487.597869:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758488.245453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758488.245727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758488.245777:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758488.245812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758488.246277:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827136 00000100:00100000:0.0:1782758488.246291:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827136 00000100:00100000:0.0:1782758488.246376:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:0.0:1782758488.246387:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196827136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1782758488.246406:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758488.246480:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196827136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758488.246488:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:0.0:1782758488.246533:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827264 00000100:00100000:0.0:1782758488.246536:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827264 00000100:00100000:0.0:1782758488.246567:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827392 00000100:00100000:0.0:1782758488.246570:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827392 00000100:00100000:0.0:1782758488.246591:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1419 00000100:00100000:0.0:1782758488.246598:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196827264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758488.246627:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196827264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758488.246634:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1419 00000100:00100000:0.0:1782758488.246646:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1420 00000100:00100000:0.0:1782758488.246653:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196827392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758488.246677:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196827392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758488.246683:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1420 00000100:00080000:0.0:1782758488.246704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758488.246707:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758488.248264:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827008 00000100:00100000:2.0:1782758488.248276:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827008 00000100:00100000:2.0:1782758488.248333:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1398 00000100:00100000:2.0:1782758488.248342:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196827008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758488.248423:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196827008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758488.248431:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1398 00010000:00010000:2.0:1782758488.621595:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758489.004530:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211676160:0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.004597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758489.004654:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758489.004660:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211676032:0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.004683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758489.004717:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676032 00000100:00100000:2.0:1782758489.004725:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676032 00000100:00100000:2.0:1782758489.004774:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1782758489.004782:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211676032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.004861:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211676032:12345-0@lo:400:kworker.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758489.004869:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00080000:2.0:1782758489.004890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758489.004899:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676160 00000100:00100000:2.0:1782758489.004902:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676160 00000100:00100000:2.0:1782758489.004927:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1782758489.004932:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211676160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.004960:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211676160:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758489.004966:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00080000:2.0:1782758489.004982:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758489.005007:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211676032:0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.005017:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211676160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005219:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211675776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758489.005284:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211676288:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758489.005330:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758489.005336:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211675904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758489.005372:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211676416:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758489.005409:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676288 00000100:00100000:0.0:1782758489.005413:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676288 00000100:00100000:0.0:1782758489.005434:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675904 00000100:00100000:0.0:1782758489.005436:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675904 00000100:00100000:0.0:1782758489.005449:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1782758489.005454:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211676288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005486:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211676288:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758489.005492:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1782758489.005514:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1782758489.005520:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211675904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005547:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211675904:12345-0@lo:400:kworker.0 Request processed in 27us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758489.005552:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1782758489.005570:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676416 00000100:00100000:0.0:1782758489.005573:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676416 00000100:00100000:0.0:1782758489.005596:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1782758489.005601:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211676416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005629:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211676416:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758489.005638:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1782758489.005660:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211675904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005669:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211676416:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.005677:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211676288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.006938:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211675776 00000100:00100000:2.0:1782758489.006950:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211675776 00000100:00100000:2.0:1782758489.007007:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1782758489.007016:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211675776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758489.007088:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211675776:12345-0@lo:400:kworker.0 Request processed in 73us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758489.007095:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:2.0:1782758489.007128:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758489.007133:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758489.008264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211675776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758489.516725:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758489.516748:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211676544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758489.516814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758489.516904:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676544 00000100:00100000:1.0:1782758489.516912:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676544 00000100:00100000:1.0:1782758489.516960:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1782758489.516969:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211676544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758489.517007:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758489.517114:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211676544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758489.517122:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1782758489.517928:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211676544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758489.644577:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758490.676714:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758491.693332:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758492.076264:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758492.076288:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211676672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758492.076367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758492.076610:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676672 00000100:00100000:0.0:1782758492.076619:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676672 00000100:00100000:0.0:1782758492.076716:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1782758492.076726:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211676672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758492.076761:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758492.076815:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211676672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758492.076840:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1782758492.076919:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211676672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758492.076974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758492.720230:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758493.366471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758493.366513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758493.366557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758493.366595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758493.366631:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827904 00000100:00100000:1.0:1782758493.366639:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827904 00000100:00100000:1.0:1782758493.366692:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827776 00000100:00100000:1.0:1782758493.366695:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827776 00000100:00100000:1.0:1782758493.366720:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1423 00000100:00100000:1.0:1782758493.366730:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196827904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758493.366858:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196827904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 129us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758493.366866:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1423 00000100:00100000:1.0:1782758493.366890:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1424 00000100:00100000:1.0:1782758493.366896:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196827776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758493.366924:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196827776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758493.366931:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1424 00000100:00080000:1.0:1782758493.366947:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758493.366950:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758493.367070:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827648 00000100:00100000:2.0:1782758493.367074:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827648 00000100:00100000:2.0:1782758493.367123:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:2.0:1782758493.367131:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196827648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758493.367172:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196827648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758493.367178:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:3.0:1782758493.367629:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196827520 00000100:00100000:3.0:1782758493.367635:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196827520 00000100:00100000:3.0:1782758493.367708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1400 00000100:00100000:3.0:1782758493.367716:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196827520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758493.367807:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196827520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758493.367815:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1400 00000100:00080000:1.0:1782758493.368146:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758493.740193:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758494.126876:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211676928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.126959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758494.127017:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211677440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.127057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758494.127082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758494.127087:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211676800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.127114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758494.127134:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211677184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.127143:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211677312:0@lo:400:kworker.0 00000100:00100000:2.0:1782758494.127181:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758494.127182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758494.127264:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677440 00000100:00100000:1.0:1782758494.127273:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677440 00000100:00100000:1.0:1782758494.127325:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677184 00000100:00100000:1.0:1782758494.127328:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677184 00000100:00100000:1.0:1782758494.127352:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1782758494.127361:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211677440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758494.131648:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211677056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.135622:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676928 00000100:00100000:0.0:1782758494.135638:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676928 00000100:00100000:0.0:1782758494.135708:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677312 00000100:00100000:0.0:1782758494.135712:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677312 00000100:00100000:0.0:1782758494.135745:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1782758494.135755:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211676928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.135859:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211676928:12345-0@lo:400:kworker.0 Request processed in 105us (8900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758494.135867:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:2.0:1782758494.135884:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1782758494.135897:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211677312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.135905:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211676800 00000100:00100000:0.0:1782758494.135910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211676800 00000100:00100000:0.0:1782758494.135944:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1782758494.136116:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211677312:12345-0@lo:400:kworker.0 Request processed in 222us (8936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758494.136130:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1782758494.136156:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1782758494.136164:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211677184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758494.136202:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211677184:12345-0@lo:400:kworker.0 Request processed in 39us (9025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758494.136208:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1782758494.136254:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211677184:0@lo:400:kworker.0 00000100:00100000:1.0:1782758494.136264:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211677440:12345-0@lo:400:kworker.0 Request processed in 8901us (9203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758494.136273:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:1.0:1782758494.136302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758494.136307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758494.136310:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758494.136380:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211677312:0@lo:400:kworker.0 00000100:00100000:1.0:1782758494.136398:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211676928:0@lo:400:kworker.0 00000100:00100000:1.0:1782758494.136412:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211677440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.136578:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211676800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.136632:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211676800:12345-0@lo:400:kworker.0 Request processed in 681us (9516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758494.136639:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1782758494.136746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758494.136867:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211676800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.136945:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677056 00000100:00100000:0.0:1782758494.136950:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677056 00000100:00100000:0.0:1782758494.137095:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1782758494.137105:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758494.137147:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211677056:12345-0@lo:400:kworker.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758494.137157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:3.0:1782758494.137253:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211677056:0@lo:400:kworker.0 00000100:00080000:1.0:1782758494.137499:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758494.637717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758494.637745:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211677568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758494.637849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758494.638061:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677568 00000100:00100000:1.0:1782758494.638071:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677568 00000100:00100000:1.0:1782758494.638121:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1782758494.638130:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211677568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758494.638167:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758494.638221:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211677568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758494.638228:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1782758494.638950:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211677568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758494.764000:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758495.262935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758495.263245:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828032 00000100:00100000:2.0:1782758495.263256:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828032 00000100:00100000:2.0:1782758495.263357:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1104 00000100:00100000:2.0:1782758495.263370:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828032:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758495.263499:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828032:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 123us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758495.263508:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1104 00000100:00080000:1.0:1782758495.264866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758495.266771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758495.266993:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828160 00000100:00100000:2.0:1782758495.267003:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828160 00000100:00100000:2.0:1782758495.267097:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 612 00000100:00100000:2.0:1782758495.267109:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828160:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:1.0:1782758495.267438:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758495.267864:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828160:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 754us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758495.267873:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 612 00000100:00100000:0.0:1782758495.272599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758495.272777:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828288 00000100:00100000:1.0:1782758495.272786:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828288 00000100:00100000:1.0:1782758495.272924:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 613 00000100:00100000:1.0:1782758495.272935:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828288:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00080000:2.0:1782758495.273522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758495.273628:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828288:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 693us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758495.273637:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 613 00000100:00100000:3.0:1782758495.276694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758495.276864:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828416 00000100:00100000:1.0:1782758495.276873:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828416 00000100:00100000:1.0:1782758495.276934:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1105 00000100:00100000:1.0:1782758495.276945:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828416:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758495.278078:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828416:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1130us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758495.278091:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1105 00000100:00100000:1.0:1782758495.282252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758495.285251:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828544 00000100:00100000:0.0:1782758495.285269:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828544 00000100:00100000:0.0:1782758495.285583:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1106 00000100:00100000:0.0:1782758495.285595:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828544:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758495.285710:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828544:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 117us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758495.285729:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1106 00000100:00100000:1.0:1782758495.287975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758495.288218:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828672 00000100:00100000:3.0:1782758495.288227:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828672 00000100:00100000:3.0:1782758495.288280:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 614 00000100:00100000:3.0:1782758495.288290:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828672:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758495.288667:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828672:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 377us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758495.288674:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 614 00000100:00100000:3.0:1782758495.291377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758495.291532:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828800 00000100:00100000:1.0:1782758495.291541:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828800 00000100:00100000:1.0:1782758495.291600:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 615 00000100:00100000:1.0:1782758495.291611:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828800:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758495.291998:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:56103:x1869355196828800:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 387us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758495.292006:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 615 00000100:00100000:1.0:1782758495.297667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758495.299215:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196828928 00000100:00100000:3.0:1782758495.299231:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196828928 00000100:00100000:3.0:1782758495.299311:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1107 00000100:00100000:3.0:1782758495.299321:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758495.302318:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56103:x1869355196828928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2981us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758495.302344:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1107 00000100:00100000:1.0:1782758495.340277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758495.340613:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196829056 00000100:00100000:2.0:1782758495.340624:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196829056 00000100:00100000:2.0:1782758495.340690:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1108 00000100:00100000:2.0:1782758495.340700:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:56104:x1869355196829056:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758495.341216:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758495.341247:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db8d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d70 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.341321:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.341348:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.341361:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758495.341914:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1782758495.341919:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758495.342175:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.342207:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777db8d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d70 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.342231:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d70 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758495.342240:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782758495.342243:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758495.342246:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758495.342489:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:56104:x1869355196829056:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1788us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758495.342573:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1108 00000100:00100000:2.0:1782758495.360176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758495.360246:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196829312 00000100:00100000:3.0:1782758495.360256:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196829312 00000100:00100000:3.0:1782758495.360305:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00100000:3.0:1782758495.360314:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:56104:x1869355196829312:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758495.360334:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758495.360368:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758495.360642:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00010000:3.0:1782758495.361170:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d77 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.361187:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758495.361190:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782758495.361195:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d77 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.361212:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782758495.361445:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:56104:x1869355196829312:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1130us (1277us total) trans 4294967723 rc 301/301 00000100:00100000:3.0:1782758495.361453:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1109 00000100:00100000:3.0:1782758495.372494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758495.372791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196829440 00000100:00100000:3.0:1782758495.372805:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196829440 00000100:00100000:3.0:1782758495.372974:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00100000:3.0:1782758495.372989:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:56104:x1869355196829440:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:2.0:1782758495.386771:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:56104:x1869355196829440:12345-192.168.204.31@tcp:37:rm.0 Request processed in 13779us (14279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758495.386786:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00100000:3.0:1782758495.390718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758495.390974:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196829696 00000100:00100000:2.0:1782758495.390985:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196829696 00000100:00100000:2.0:1782758495.391052:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:2.0:1782758495.391065:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:56104:x1869355196829696:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:3.0:1782758495.393295:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:56104:x1869355196829696:12345-192.168.204.31@tcp:35:rm.0 Request processed in 2227us (2582us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1782758495.393310:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:2.0:1782758495.403532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758495.404102:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196829952 00000100:00100000:3.0:1782758495.404114:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196829952 00000100:00100000:3.0:1782758495.404166:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1110 00000100:00100000:3.0:1782758495.404176:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:56104:x1869355196829952:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758495.404238:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782758495.404268:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777db8d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d70 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404287:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777db87d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d5b expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404296:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777db4d3) 00010000:00010000:3.0:1782758495.404300:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782758495.404311:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758495.404336:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404349:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404359:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404370:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404376:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.404381:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.405334:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.405347:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.405356:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409026:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409046:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409054:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409059:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758495.409064:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409071:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409089:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff917191f75100) 00010000:00010000:3.0:1782758495.409092:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758495.409097:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409103:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777db8fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409130:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409137:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409143:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409148:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758495.409150:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409156:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409163:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758495.409165:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758495.409168:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409173:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777db8ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409185:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409192:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409198:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409203:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758495.409206:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409212:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409219:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff917191f75600) 00010000:00010000:3.0:1782758495.409221:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758495.409224:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758495.409229:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777db8f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758495.409334:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:56104:x1869355196829952:12345-192.168.204.31@tcp:36:rm.0 Request processed in 5155us (5809us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782758495.409344:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1110 00010000:00010000:0.0:1782758495.788197:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758496.821993:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758496.956598:0:95919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca9222ff0 20000000:00000080:2.0:1782758496.956616:0:95919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7839000 uarg=0000000000000000 00010000:00010000:2.0:1782758496.965516:0:95919:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758496.965541:0:95919:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758496.965591:0:95919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758496.965610:0:95919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758496.965626:0:95919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758496.965634:0:95919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758496.965673:0:95919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758496.965689:0:95919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 18 pid: 5796 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758496.965703:0:95919:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95919:1869355211677696:0@lo:104: 00000100:00100000:2.0:1782758496.965762:0:95919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758496.965902:0:95919:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758496.968593:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677696 00000100:00100000:0.0:1782758496.968608:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677696 00000100:00100000:0.0:1782758496.968720:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1782758496.968731:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95919:x1869355211677696:12345-0@lo:104: 00010000:00010000:0.0:1782758496.968748:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758496.969001:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758496.969008:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:95919:x1869355211677696:12345-0@lo:104: Request processed in 281us (3246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758496.969019:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:1.0:1782758496.969081:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758496.969088:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969096:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758496.969099:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969108:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758496.969115:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758496.969121:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758496.969160:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969166:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758496.969185:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969191:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777db853 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db85a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969207:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758496.969209:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758496.969210:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758496.969231:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211677824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758496.969271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758496.969316:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677824 00000100:00100000:1.0:1782758496.969320:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677824 00010000:00010000:1.0:1782758496.969352:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 19 pid: 5796 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758496.969376:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1782758496.969382:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211677824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758496.969393:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758496.969398:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 19 pid: 5796 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969408:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 19 pid: 5796 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969426:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969434:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969447:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969453:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969459:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969465:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969470:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758496.969474:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969481:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969489:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758496.969497:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758496.969526:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211677824:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758496.969533:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1782758496.969572:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211677824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758496.971503:0:95919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db85a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db853 expref: 18 pid: 5796 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758496.971522:0:95919:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95919:1869355211677696:0@lo:104: 00010000:00010000:3.0:1782758496.971546:0:95919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758496.971556:0:95919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758496.971562:0:95919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758496.971568:0:95919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777db902 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758497.197166:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758497.197191:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211677952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758497.197258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758497.197482:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211677952 00000100:00100000:0.0:1782758497.197490:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211677952 00000100:00100000:0.0:1782758497.197558:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1782758497.197568:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211677952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758497.197604:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758497.197653:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211677952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758497.197660:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1782758497.197706:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211677952:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758497.197761:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782758497.792646:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967724 is committed 00000020:00000080:3.0:1782758497.826755:0:95968:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5b700a10 20000000:00000080:3.0:1782758497.826774:0:95968:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30db000 uarg=0000000000000000 00010000:00010000:3.0:1782758497.827511:0:95968:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758497.827527:0:95968:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758497.827545:0:95968:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758497.827564:0:95968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827579:0:95968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827589:0:95968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827596:0:95968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827603:0:95968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827611:0:95968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827618:0:95968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758497.827623:0:95968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827632:0:95968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827644:0:95968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827651:0:95968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758497.827658:0:95968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db909 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758497.836105:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758498.484633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758498.484745:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830080 00000100:00100000:3.0:1782758498.484756:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830080 00000100:00100000:3.0:1782758498.484817:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1402 00000100:00100000:3.0:1782758498.484850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196830080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758498.484931:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196830080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758498.484939:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1402 00000100:00100000:2.0:1782758498.490759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758498.490801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758498.490872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758498.490903:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830464 00000100:00100000:2.0:1782758498.490925:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830464 00000100:00100000:2.0:1782758498.490992:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830336 00000100:00100000:2.0:1782758498.490995:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830336 00000100:00100000:2.0:1782758498.491022:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1427 00000100:00100000:2.0:1782758498.491032:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196830464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758498.491111:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196830464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758498.491119:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1427 00000100:00100000:2.0:1782758498.491136:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00100000:2.0:1782758498.491142:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196830336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758498.491167:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196830336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758498.491173:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00080000:2.0:1782758498.491189:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758498.491192:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758498.491684:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830208 00000100:00100000:3.0:1782758498.491690:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830208 00000100:00100000:3.0:1782758498.491743:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00100000:3.0:1782758498.491751:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758498.491790:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758498.491798:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00080000:2.0:1782758498.491859:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782758498.677557:0:96016:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddb03bee0 20000000:00000080:1.0:1782758498.677576:0:96016:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbf400 uarg=0000000000000000 00010000:00010000:1.0:1782758498.677808:0:96016:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758498.677900:0:96016:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758498.677921:0:96016:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758498.677942:0:96016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.677972:0:96016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.677981:0:96016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.677988:0:96016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.677995:0:96016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678002:0:96016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678008:0:96016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758498.678012:0:96016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678020:0:96016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678032:0:96016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678040:0:96016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.678047:0:96016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db910 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758498.863027:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758498.989256:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758498.989265:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758498.989271:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758498.989316:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758498.989328:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758498.989340:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758498.989367:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211678080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758498.989441:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758498.989498:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c2adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758498.989852:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678080 00000100:00100000:1.0:1782758498.989861:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678080 00000100:00100000:1.0:1782758498.989908:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1782758498.989916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211678080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758498.989931:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758498.989954:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db917 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.989979:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.989988:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758498.989996:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782758498.990038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211678080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758498.990045:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1782758498.990196:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211678080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758498.990212:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758498.990220:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758498.990239:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758498.990244:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758498.990250:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758499.255257:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211678592:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758499.255382:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758499.255389:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211678208:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758499.255431:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211678720:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758499.255484:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211678336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758499.255525:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758499.255531:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678464:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758499.255702:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678592 00000100:00100000:2.0:1782758499.255710:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678592 00000100:00100000:2.0:1782758499.255757:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678208 00000100:00100000:2.0:1782758499.255760:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678208 00000100:00100000:2.0:1782758499.255776:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678336 00000100:00100000:2.0:1782758499.255778:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678336 00000100:00100000:2.0:1782758499.255793:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1782758499.255800:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211678592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255872:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211678592:12345-0@lo:400:kworker.0 Request processed in 71us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758499.255880:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1782758499.255896:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1782758499.255902:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255928:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211678208:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758499.255944:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1782758499.255956:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1782758499.255962:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211678336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.255992:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211678336:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758499.255997:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1782758499.256015:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678720 00000100:00100000:2.0:1782758499.256018:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678720 00000100:00100000:2.0:1782758499.256042:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678464 00000100:00100000:2.0:1782758499.256044:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678464 00000100:00100000:2.0:1782758499.256062:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1782758499.256066:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211678720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256097:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211678720:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758499.256103:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1782758499.256114:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1782758499.256120:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256145:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678464:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758499.256150:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00080000:2.0:1782758499.256168:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758499.256171:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758499.256174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758499.256209:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678464:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256219:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211678336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256255:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211678208:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211678720:0@lo:400:kworker.0 00000100:00100000:2.0:1782758499.256272:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211678592:0@lo:400:kworker.0 00000100:00100000:3.0:1782758499.758215:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758499.758314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758499.758402:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678848 00000100:00100000:1.0:1782758499.758411:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678848 00000100:00100000:1.0:1782758499.758463:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1782758499.758473:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758499.758509:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758499.765377:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6896us (7056us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758499.765392:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:3.0:1782758499.765653:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758499.884099:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758500.913848:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758501.933135:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758502.322250:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758502.322279:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758502.322351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758502.322416:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211678976 00000100:00100000:1.0:1782758502.322425:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211678976 00000100:00100000:1.0:1782758502.322485:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1782758502.322494:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758502.322532:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758502.322581:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211678976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758502.322588:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00080000:1.0:1782758502.323986:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758502.324043:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211678976:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782758502.717064:0:96212:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea6249650 20000000:00000080:0.0:1782758502.717085:0:96212:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2da8800 uarg=0000000000000000 00010000:00010000:0.0:1782758502.717319:0:96212:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758502.717333:0:96212:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758502.717351:0:96212:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758502.717369:0:96212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.717386:0:96212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.717395:0:96212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.717431:0:96212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.717449:0:96212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 18 pid: 5796 timeout: 2671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758502.717463:0:96212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96212:1869355211679104:0@lo:104: 00000100:00100000:0.0:1782758502.717536:0:96212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758502.718097:0:96212:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758502.718285:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679104 00000100:00100000:3.0:1782758502.718293:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679104 00000100:00100000:3.0:1782758502.718384:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782758502.718394:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96212:x1869355211679104:12345-0@lo:104: 00010000:00010000:3.0:1782758502.718408:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758502.718482:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758502.718488:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96212:x1869355211679104:12345-0@lo:104: Request processed in 97us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758502.718495:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:1.0:1782758502.718540:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758502.718547:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.718554:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758502.718557:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.718565:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758502.718573:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758502.718578:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758502.718614:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.718622:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758502.718642:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.718649:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777db917 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db91e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.718665:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758502.718667:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758502.718668:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758502.718683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758502.718697:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211679232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758502.718745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758502.718783:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679232 00000100:00100000:1.0:1782758502.718786:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679232 00010000:00010000:1.0:1782758502.718805:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 19 pid: 5796 timeout: 2671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758502.719140:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1782758502.719148:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211679232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758502.719162:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758502.719168:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 19 pid: 5796 timeout: 2671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719179:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 19 pid: 5796 timeout: 2671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719196:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719206:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719220:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719227:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719234:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719241:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719246:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758502.719250:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719258:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719266:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758502.719275:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758502.719307:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211679232:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758502.719314:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1782758502.719358:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211679232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758502.719476:0:96212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777db91e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db917 expref: 18 pid: 5796 timeout: 2671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758502.719487:0:96212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96212:1869355211679104:0@lo:104: 00010000:00010000:0.0:1782758502.719501:0:96212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.719520:0:96212:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.719527:0:96212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.719533:0:96212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777db925 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758502.960807:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758503.607511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758503.607545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758503.607567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758503.607606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758503.608644:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830592 00000100:00100000:2.0:1782758503.608656:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830592 00000100:00100000:2.0:1782758503.608718:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00100000:2.0:1782758503.608727:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196830592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758503.608989:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196830592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 262us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758503.608998:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1404 00000100:00100000:2.0:1782758503.609036:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830848 00000100:00100000:2.0:1782758503.609040:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830848 00000100:00100000:2.0:1782758503.609084:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830976 00000100:00100000:2.0:1782758503.609088:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830976 00000100:00100000:2.0:1782758503.609111:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1431 00000100:00100000:2.0:1782758503.609118:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758503.609149:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758503.609155:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1431 00000100:00100000:2.0:1782758503.609292:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00100000:2.0:1782758503.609299:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758503.609326:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758503.609332:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00100000:2.0:1782758503.609351:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196830720 00000100:00100000:2.0:1782758503.609354:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196830720 00000100:00100000:2.0:1782758503.609381:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00100000:2.0:1782758503.609387:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758503.609413:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196830720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758503.609423:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00080000:1.0:1782758503.609709:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758503.609716:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758503.609718:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758503.981240:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758504.363934:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758504.363943:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758504.363949:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758504.364002:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758504.364015:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758504.364027:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758504.364052:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211679360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758504.364124:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758504.364188:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758504.364816:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679360 00000100:00100000:2.0:1782758504.364849:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679360 00000100:00100000:2.0:1782758504.364907:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1782758504.364917:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211679360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758504.364930:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758504.364945:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db92c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758504.364971:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758504.364982:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758504.364990:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758504.365317:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211679360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 400us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758504.365324:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1782758504.370222:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211679616:0@lo:400:kworker.0 00000100:00100000:1.0:1782758504.370297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758504.370337:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758504.370343:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211679744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758504.370369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758504.370462:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211679488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758504.370524:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211680000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758504.370568:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758504.370573:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211679872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758504.370622:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679744 00000100:00100000:0.0:1782758504.370630:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679744 00000100:00100000:0.0:1782758504.370681:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680000 00000100:00100000:0.0:1782758504.370685:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680000 00000100:00100000:0.0:1782758504.370708:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1782758504.370718:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211679744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370772:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211679744:12345-0@lo:400:kworker.0 Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758504.370779:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1782758504.370795:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782758504.370801:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370877:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211680000:12345-0@lo:400:kworker.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758504.370883:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782758504.370899:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679616 00000100:00100000:0.0:1782758504.370902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679616 00000100:00100000:0.0:1782758504.370926:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679488 00000100:00100000:0.0:1782758504.370928:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679488 00000100:00100000:0.0:1782758504.370943:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211679872 00000100:00100000:0.0:1782758504.370945:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211679872 00000100:00100000:0.0:1782758504.370959:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1782758504.370964:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211679616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.370993:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211679616:12345-0@lo:400:kworker.0 Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758504.370998:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1782758504.371009:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1782758504.371021:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211679488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371047:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211679488:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758504.371053:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1782758504.371065:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:0.0:1782758504.371070:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211679872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211679872:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758504.371101:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00080000:0.0:1782758504.371117:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758504.371122:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758504.371123:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758504.371195:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211679872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371205:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211679488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371214:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211680000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371246:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211679744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758504.371256:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211679616:0@lo:400:kworker.0 00000100:00100000:3.0:1782758504.371500:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211679360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758504.371524:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758504.371537:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758504.371554:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758504.371559:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758504.371567:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758504.876939:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758504.877024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758504.878287:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680128 00000100:00100000:1.0:1782758504.878299:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680128 00000100:00100000:1.0:1782758504.878357:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1782758504.878367:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758504.878408:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758504.878486:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758504.878494:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1782758504.878587:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758505.012758:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758506.028227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758507.051906:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758507.436034:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758507.436059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758507.436150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758507.436550:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680256 00000100:00100000:1.0:1782758507.436558:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680256 00000100:00100000:1.0:1782758507.436622:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1782758507.436631:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758507.436666:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758507.436717:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758507.436723:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1782758507.436766:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758507.436889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758508.076263:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758508.725568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758508.725669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758508.725714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758508.725765:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831104 00000100:00100000:2.0:1782758508.725777:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831104 00000100:00100000:2.0:1782758508.725854:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1406 00000100:00100000:2.0:1782758508.726399:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196831104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758508.726476:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196831104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 612us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758508.726485:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1406 00000100:00100000:3.0:1782758508.727844:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831488 00000100:00100000:3.0:1782758508.727856:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831488 00000100:00100000:3.0:1782758508.727922:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1435 00000100:00100000:3.0:1782758508.727933:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196831488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758508.728012:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196831488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758508.728019:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1435 00000100:00100000:3.0:1782758508.729166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758508.730992:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831232 00000100:00100000:0.0:1782758508.731007:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831232 00000100:00100000:0.0:1782758508.731026:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831360 00000100:00100000:0.0:1782758508.731029:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831360 00000100:00100000:0.0:1782758508.731533:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1436 00000100:00100000:0.0:1782758508.731547:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758508.731648:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 106us (3573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758508.731657:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1436 00000100:00080000:0.0:1782758508.739223:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758508.739233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758508.739329:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:0.0:1782758508.739344:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196831232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758508.739438:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196831232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (13881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758508.739446:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00080000:2.0:1782758508.740293:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758509.103036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758509.484206:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211680512:0@lo:400:kworker.0 00000100:00100000:1.0:1782758509.484297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758509.484380:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211681024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758509.484410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758509.484433:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758509.484438:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211680384:0@lo:400:kworker.0 00000100:00100000:1.0:1782758509.484464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758509.484483:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211680896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758509.484503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758509.484775:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680512 00000100:00100000:0.0:1782758509.484784:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680512 00000100:00100000:0.0:1782758509.484872:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680896 00000100:00100000:0.0:1782758509.484876:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680896 00000100:00100000:0.0:1782758509.484903:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1782758509.484912:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211680512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.484970:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211680512:12345-0@lo:400:kworker.0 Request processed in 59us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758509.484977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1782758509.484994:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:0.0:1782758509.485000:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211680896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.485028:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211680896:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758509.485033:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:0.0:1782758509.485052:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680384 00000100:00100000:0.0:1782758509.485056:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680384 00000100:00100000:0.0:1782758509.485078:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1782758509.485084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211680384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.485113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211680384:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758509.485119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1782758509.485185:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211680384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.485200:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211680896:0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.485221:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211680512:0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.485498:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211680640:0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.485531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758509.485567:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758509.485573:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.485611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758509.485640:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681024 00000100:00100000:3.0:1782758509.485644:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681024 00000100:00100000:3.0:1782758509.485678:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680768 00000100:00100000:3.0:1782758509.485681:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680768 00000100:00100000:3.0:1782758509.485701:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1782758509.485707:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211681024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.485759:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211681024:12345-0@lo:400:kworker.0 Request processed in 52us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758509.485765:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1782758509.485779:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1782758509.485784:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.485816:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211680768:12345-0@lo:400:kworker.0 Request processed in 32us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758509.485861:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1782758509.485888:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211680768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758509.486039:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211681024:0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.487337:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211680640 00000100:00100000:0.0:1782758509.487349:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211680640 00000100:00100000:0.0:1782758509.487428:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:0.0:1782758509.487437:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211680640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758509.487507:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211680640:12345-0@lo:400:kworker.0 Request processed in 71us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758509.487514:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00080000:2.0:1782758509.487748:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758509.487753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758509.487756:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758509.489291:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211680640:0@lo:400:kworker.0 00000100:00100000:2.0:1782758509.997257:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758509.997283:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211681152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758509.997357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758509.997498:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681152 00000100:00100000:0.0:1782758509.997511:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681152 00000100:00100000:0.0:1782758509.997560:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1782758509.997574:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211681152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758509.997613:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758509.997671:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211681152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758509.997678:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1782758509.997783:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211681152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758510.124006:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758511.148102:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758512.172206:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758512.556345:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211681280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758512.556454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758512.556604:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681280 00000100:00100000:1.0:1782758512.556616:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681280 00000100:00100000:1.0:1782758512.556707:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1782758512.556719:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211681280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758512.556772:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758512.556862:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211681280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758512.556871:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1782758512.556934:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211681280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758512.557211:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1782758512.902994:0:96556:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 14:41:50 (1782758510) 00010000:00010000:2.0:1782758513.196961:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758513.847556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758513.847644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758513.847682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758513.847702:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831872 00000100:00100000:0.0:1782758513.847711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758513.847712:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831872 00000100:00100000:0.0:1782758513.847732:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831744 00000100:00100000:0.0:1782758513.847735:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831744 00000100:00100000:3.0:1782758513.847766:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832000 00000100:00100000:3.0:1782758513.847768:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832000 00000100:00100000:0.0:1782758513.847770:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000100:00100000:0.0:1782758513.847780:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758513.847787:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1439 00000100:00100000:3.0:1782758513.847793:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758513.847894:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758513.847901:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000100:00100000:0.0:1782758513.847927:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1440 00000100:00100000:0.0:1782758513.847934:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196832000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758513.847959:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196832000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758513.847966:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1440 00000100:00100000:3.0:1782758513.848208:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196831872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 414us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758513.848215:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1439 00000100:00080000:3.0:1782758513.848922:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758513.848929:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758513.848931:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758513.849402:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196831616 00000100:00100000:2.0:1782758513.849411:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196831616 00000100:00100000:2.0:1782758513.849461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000100:00100000:2.0:1782758513.849469:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196831616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758513.849519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196831616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 50us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758513.849525:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1408 00000004:00000400:1.0:1782758514.171446:0:96604:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782758514.185045:0:96604:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1782758514.220412:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758514.604226:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211681664:0@lo:400:kworker.0 00000100:00100000:3.0:1782758514.604324:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758514.604392:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758514.604416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211681792:0@lo:400:kworker.0 00000100:00100000:3.0:1782758514.604446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758514.604481:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681664 00000100:00100000:3.0:1782758514.604489:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681664 00000100:00100000:3.0:1782758514.604543:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1782758514.604552:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211681664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758514.604602:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211681664:12345-0@lo:400:kworker.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758514.604608:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00080000:3.0:1782758514.604631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758514.604655:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211681408:0@lo:400:kworker.0 00000100:00100000:3.0:1782758514.604683:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211681664:0@lo:400:kworker.0 00000100:00100000:2.0:1782758514.604697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758514.604739:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211681920:0@lo:400:kworker.0 00000100:00100000:2.0:1782758514.604769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758514.604790:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211681536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758514.604810:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681408 00000100:00100000:2.0:1782758514.604815:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681408 00000100:00100000:0.0:1782758514.604848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758514.604872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1782758514.604873:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211682048:0@lo:400:kworker.0 00000100:00100000:2.0:1782758514.604884:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211681408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.604901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758514.604934:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211681408:12345-0@lo:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758514.604942:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1782758514.605094:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681792 00000100:00100000:0.0:1782758514.605098:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681792 00000100:00100000:0.0:1782758514.605131:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682048 00000100:00100000:0.0:1782758514.605134:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682048 00000100:00100000:0.0:1782758514.605154:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1782758514.605162:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211681792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.605203:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211681792:12345-0@lo:400:kworker.0 Request processed in 44us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758514.605210:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1782758514.605222:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1782758514.605227:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211682048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.605261:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211682048:12345-0@lo:400:kworker.0 Request processed in 33us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758514.605266:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1782758514.605283:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681920 00000100:00100000:0.0:1782758514.605287:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681920 00000100:00100000:0.0:1782758514.605307:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1782758514.605313:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211681920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.605341:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211681920:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758514.605346:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1782758514.605356:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211681536 00000100:00100000:0.0:1782758514.605358:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211681536 00000100:00100000:0.0:1782758514.605377:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:0.0:1782758514.605383:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211681536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.605408:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211681536:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758514.605417:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1782758514.605474:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211681408:0@lo:400:kworker.0 00000100:00100000:2.0:1782758514.605486:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211681920:0@lo:400:kworker.0 00000100:00080000:0.0:1782758514.606575:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758514.606583:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758514.606585:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758514.606622:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211681536:0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.606652:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211682048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758514.606700:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211681792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758515.119944:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211682176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758515.120033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758515.120124:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682176 00000100:00100000:0.0:1782758515.120132:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682176 00000100:00100000:0.0:1782758515.120193:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1782758515.120203:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211682176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758515.120255:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758515.120304:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211682176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758515.120311:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1782758515.120356:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211682176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758515.245133:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758515.305343:0:96652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc455337a0 20000000:00000080:3.0:1782758515.305942:0:96652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbc2b400 uarg=0000000000000000 10000000:01000000:3.0:1782758515.307933:0:96652:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758515.308497:0:96652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758515.308523:0:96652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758515.308534:0:96652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758515.308655:0:96652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758515.308674:0:96652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 18 pid: 5794 timeout: 2683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758515.308692:0:96652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083637b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96652:1869355211682304:0@lo:104: 00000100:00100000:3.0:1782758515.308781:0:96652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758515.309154:0:96652:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758515.321619:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682304 00000100:00100000:2.0:1782758515.321653:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682304 00000100:00100000:0.0:1782758515.321856:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782758515.321871:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96652:x1869355211682304:12345-0@lo:104: 00010000:00010000:0.0:1782758515.321897:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758515.322378:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758515.322388:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96652:x1869355211682304:12345-0@lo:104: Request processed in 520us (13606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758515.322397:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:2.0:1782758515.322518:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758515.322528:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.322538:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758515.322542:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.322554:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758515.322563:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758515.322575:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758515.322643:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.322650:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758515.322682:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.322690:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db92c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.322713:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758515.322715:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758515.322717:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758515.322873:0:96652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083637b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96652:1869355211682304:0@lo:104: 00010000:00010000:3.0:1782758515.322903:0:96652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758515.323185:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211682432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758515.323246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758515.323459:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682432 00000100:00100000:1.0:1782758515.323466:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682432 00010000:00010000:1.0:1782758515.323499:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 2683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758515.323537:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1782758515.323546:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211682432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758515.323561:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758515.323566:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 2683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323578:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 2683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323607:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777db933 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db92c expref: 19 pid: 5794 timeout: 2683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323633:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323642:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323660:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323669:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323677:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323684:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323690:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758515.323695:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323704:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323726:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758515.323738:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758515.323786:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211682432:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758515.323795:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:2.0:1782758515.324343:0:96652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.324364:0:96652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758515.324372:0:96652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777db93a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758515.327256:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211682432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758516.270483:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758516.341615:0:96701:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc048544f0 20000000:00000080:3.0:1782758516.341635:0:96701:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30d9800 uarg=0000000000000000 10000000:01000000:3.0:1782758516.341955:0:96701:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758516.341977:0:96701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.341993:0:96701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342003:0:96701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342009:0:96701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342016:0:96701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342022:0:96701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342027:0:96701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758516.342031:0:96701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342038:0:96701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342055:0:96701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342062:0:96701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758516.342068:0:96701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db941 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758516.397782:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758516.397791:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758516.397796:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758516.397859:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758516.397871:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758516.397884:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758516.397910:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211682560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758516.397979:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758516.398021:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917184d11d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758516.398041:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682560 00000100:00100000:1.0:1782758516.398048:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682560 00000100:00100000:1.0:1782758516.398101:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1782758516.398110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211682560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758516.398122:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758516.398134:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db948 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758516.398156:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758516.398166:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758516.398175:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758516.398219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211682560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758516.398227:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1782758516.398453:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211682560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758516.398470:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758516.398478:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758516.398505:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758516.398510:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758516.398517:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782758517.262692:0:96749:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff12aaf3b0 20000000:00000080:2.0:1782758517.262709:0:96749:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081116c00 uarg=0000000000000000 10000000:01000000:2.0:1782758517.262963:0:96749:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758517.262988:0:96749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.263009:0:96749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.263019:0:96749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.263063:0:96749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.263077:0:96749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 18 pid: 5796 timeout: 2685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758517.263093:0:96749:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96749:1869355211682688:0@lo:104: 00000100:00100000:2.0:1782758517.263160:0:96749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758517.263356:0:96749:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758517.263999:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682688 00000100:00100000:0.0:1782758517.264009:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682688 00000100:00100000:0.0:1782758517.264064:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782758517.264075:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96749:x1869355211682688:12345-0@lo:104: 00010000:00010000:0.0:1782758517.264092:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.264178:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758517.264184:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96749:x1869355211682688:12345-0@lo:104: Request processed in 110us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758517.264190:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:1.0:1782758517.264630:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758517.264638:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758517.264652:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758517.264656:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758517.264665:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758517.264672:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758517.264678:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758517.264726:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758517.264733:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758517.264765:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758517.264773:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777db948 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db94f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758517.264793:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758517.264795:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758517.264797:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758517.264805:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758517.264819:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211682816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758517.264890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758517.265197:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682816 00000100:00100000:0.0:1782758517.265203:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682816 00010000:00010000:0.0:1782758517.265228:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 19 pid: 5796 timeout: 2685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758517.265266:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1782758517.265273:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211682816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758517.265287:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758517.265292:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 19 pid: 5796 timeout: 2685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265302:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 19 pid: 5796 timeout: 2685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265321:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265330:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265345:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265353:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265359:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265366:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265371:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758517.265375:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265383:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265391:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758517.265404:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758517.265443:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211682816:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758517.265449:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1782758517.265460:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211682816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758517.265955:0:96749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777db94f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db948 expref: 18 pid: 5796 timeout: 2685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758517.265968:0:96749:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96749:1869355211682688:0@lo:104: 00010000:00010000:2.0:1782758517.265986:0:96749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.265995:0:96749:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.266001:0:96749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.266007:0:96749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777db956 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758517.291928:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758517.676530:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211682944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758517.676623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758517.677748:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211682944 00000100:00100000:1.0:1782758517.677764:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211682944 00000100:00100000:1.0:1782758517.677874:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00080000:3.0:1782758517.677880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758517.677888:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211682944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758517.677928:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758517.678031:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211682944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758517.678040:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1782758517.678604:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211682944:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782758518.097617:0:96797:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff38ccff60 20000000:00000080:2.0:1782758518.097635:0:96797:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081115c00 uarg=0000000000000000 10000000:01000000:2.0:1782758518.098120:0:96797:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758518.098146:0:96797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098163:0:96797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098172:0:96797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098179:0:96797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098186:0:96797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098193:0:96797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098199:0:96797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758518.098204:0:96797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098212:0:96797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098226:0:96797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098233:0:96797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758518.098239:0:96797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777db95d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758518.316172:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758518.966628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758518.966679:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758518.966711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758518.966745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758518.966784:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832128 00000100:00100000:2.0:1782758518.966798:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832128 00000100:00100000:2.0:1782758518.966894:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1411 00000100:00100000:2.0:1782758518.966908:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196832128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758518.967010:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196832128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758518.967019:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1411 00000100:00100000:1.0:1782758518.967142:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832256 00000100:00100000:1.0:1782758518.967148:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832256 00000100:00100000:1.0:1782758518.967199:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00100000:1.0:1782758518.967206:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196832256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758518.967245:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196832256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758518.967253:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00080000:2.0:1782758518.967384:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758518.972627:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832384 00000100:00100000:0.0:1782758518.972652:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832384 00000100:00100000:0.0:1782758518.972738:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832512 00000100:00100000:0.0:1782758518.972742:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832512 00000100:00100000:0.0:1782758518.972776:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 616 00000100:00100000:0.0:1782758518.972790:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196832384:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782758518.972854:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db55f 00000100:00080000:0.0:1782758518.972866:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917084d22800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758518.972922:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:0.0:1782758518.973292:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196832384:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 504us (6577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758518.973302:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 616 00000100:00100000:0.0:1782758518.973322:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 617 00000100:00100000:0.0:1782758518.973329:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196832512:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782758518.973343:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777db861 00000100:00080000:0.0:1782758518.973350:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758518.974046:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:0.0:1782758518.974282:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196832512:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 948us (7531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758518.974292:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 617 00000100:00080000:1.0:1782758518.974910:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758518.974918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758518.975181:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758518.975190:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758519.059197:0:96846:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1b764640 20000000:00000080:2.0:1782758519.059222:0:96846:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bc193000 uarg=0000000000000000 10000000:01000000:2.0:1782758519.062910:0:96846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758519.063113:0:96846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063138:0:96846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063151:0:96846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063158:0:96846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063165:0:96846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063172:0:96846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063179:0:96846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758519.063184:0:96846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063193:0:96846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063211:0:96846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063219:0:96846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.063225:0:96846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777db964 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758519.084544:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758519.084561:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758519.084567:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758519.084636:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.084650:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758519.084663:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758519.084698:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211683072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758519.084799:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758519.084905:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb9163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758519.085103:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683072 00000100:00100000:1.0:1782758519.085113:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683072 00000100:00100000:1.0:1782758519.085186:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1782758519.085198:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211683072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758519.085229:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758519.085250:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db96b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758519.085286:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758519.085302:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758519.085313:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758519.085387:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211683072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758519.085395:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1782758519.085576:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211683072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758519.085593:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758519.085603:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758519.085628:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758519.085634:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758519.085642:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758519.344327:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758519.725597:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211683200:0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.725708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758519.725786:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211683712:0@lo:400:kworker.0 00000100:00100000:2.0:1782758519.725792:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683200 00000100:00100000:2.0:1782758519.725803:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683200 00000100:00100000:1.0:1782758519.725818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758519.725878:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758519.725883:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211683328:0@lo:400:kworker.0 00000100:00100000:2.0:1782758519.725901:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1782758519.725907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758519.725913:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211683200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.725924:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211683840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.725956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758519.725977:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211683200:12345-0@lo:400:kworker.0 Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758519.725986:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1782758519.725996:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211683200:0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.726029:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683712 00000100:00100000:1.0:1782758519.726033:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683712 00000100:00100000:1.0:1782758519.726085:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683328 00000100:00100000:1.0:1782758519.726089:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683328 00000100:00100000:1.0:1782758519.726109:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:1.0:1782758519.726115:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211683712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.726160:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211683712:12345-0@lo:400:kworker.0 Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758519.726167:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:1.0:1782758519.726186:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1782758519.726192:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211683328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.726220:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211683328:12345-0@lo:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758519.726227:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1782758519.726255:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683840 00000100:00100000:1.0:1782758519.726259:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683840 00000100:00100000:1.0:1782758519.726294:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1782758519.726300:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211683840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.726340:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211683840:12345-0@lo:400:kworker.0 Request processed in 40us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758519.726347:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1782758519.726388:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211683328:0@lo:400:kworker.0 00000100:00080000:2.0:1782758519.726392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758519.726398:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758519.726398:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211683840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.726406:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211683712:0@lo:400:kworker.0 00000100:00100000:3.0:1782758519.726813:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211683456:0@lo:400:kworker.0 00000100:00100000:3.0:1782758519.726888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758519.726916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758519.726923:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211683584:0@lo:400:kworker.0 00000100:00100000:3.0:1782758519.726948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758519.727065:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683584 00000100:00100000:2.0:1782758519.727071:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683584 00000100:00100000:2.0:1782758519.727125:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1782758519.727133:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211683584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758519.727173:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211683584:12345-0@lo:400:kworker.0 Request processed in 41us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758519.727181:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1782758519.727556:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683456 00000100:00100000:1.0:1782758519.727561:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683456 00000100:00100000:1.0:1782758519.727604:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1782758519.727611:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211683456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758519.727649:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211683456:12345-0@lo:400:kworker.0 Request processed in 38us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758519.727656:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:3.0:1782758519.728489:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211683584:0@lo:400:kworker.0 00000100:00100000:3.0:1782758519.728503:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211683456:0@lo:400:kworker.0 00000100:00080000:3.0:1782758519.728562:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758519.728569:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782758520.027986:0:96894:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed2b7f460 20000000:00000080:2.0:1782758520.028010:0:96894:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812ea400 uarg=0000000000000000 10000000:01000000:2.0:1782758520.028265:0:96894:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758520.028292:0:96894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.028313:0:96894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.029090:0:96894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.029144:0:96894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.029160:0:96894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 18 pid: 5796 timeout: 2688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758520.029179:0:96894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96894:1869355211683968:0@lo:104: 00000100:00100000:2.0:1782758520.029266:0:96894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758520.029487:0:96894:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719192cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758520.029555:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211683968 00000100:00100000:0.0:1782758520.029565:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211683968 00000100:00100000:0.0:1782758520.029677:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1782758520.029688:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96894:x1869355211683968:12345-0@lo:104: 00010000:00010000:0.0:1782758520.029705:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758520.029793:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758520.029800:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:96894:x1869355211683968:12345-0@lo:104: Request processed in 114us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758520.029806:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:3.0:1782758520.029896:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758520.029905:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758520.029913:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758520.029918:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758520.029929:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758520.029937:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758520.029943:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758520.029982:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758520.029989:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758520.030011:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758520.030019:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695c00/0xdd99f5c4777db96b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db972 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758520.030043:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758520.030045:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758520.030047:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758520.030061:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211684096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758520.030099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758520.030242:0:96894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96894:1869355211683968:0@lo:104: 00010000:00010000:2.0:1782758520.030273:0:96894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758520.030543:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684096 00000100:00100000:1.0:1782758520.030551:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684096 00010000:00010000:1.0:1782758520.030581:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 2688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758520.030618:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1782758520.030627:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211684096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758520.030642:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758520.030648:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 2688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030660:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 2688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030679:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777db972 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db96b expref: 19 pid: 5796 timeout: 2688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030696:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030705:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030721:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030728:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030735:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030741:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030747:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758520.030751:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030759:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030778:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758520.030788:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758520.030857:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211684096:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758520.030865:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1782758520.030904:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211684096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758520.031222:0:96894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.031231:0:96894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758520.031239:0:96894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777db979 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758520.236379:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211684224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758520.236554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758520.236804:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684224 00000100:00100000:3.0:1782758520.236815:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684224 00000100:00100000:3.0:1782758520.237033:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:3.0:1782758520.237046:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211684224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758520.237102:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758520.237580:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211684224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 535us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758520.237591:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1782758520.237708:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211684224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758520.364357:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782758520.808218:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758520.808231:0:6622:0:(genops.c:906:class_export_put()) final put ffff917084d25000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758520.808387:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d25000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:2.0:1782758520.808441:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d22800 for lustre-OST0000 00000001:00100000:3.0:1782758520.819343:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758520.819356:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082a78000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758520.819448:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff917082a78000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:2.0:1782758520.819582:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082a7a800 for lustre-OST0001 00010000:00010000:3.0:1782758521.388168:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758521.451897:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758521.451906:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758521.451912:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758521.451960:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758521.451973:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758521.451983:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758521.452008:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211684352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758521.452078:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758521.452153:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171833430c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758521.452304:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684352 00000100:00100000:1.0:1782758521.452312:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684352 00000100:00100000:1.0:1782758521.452360:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1782758521.452370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211684352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758521.452396:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758521.452412:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db980 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758521.452442:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758521.452455:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758521.452465:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758521.452526:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211684352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758521.452532:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1782758521.452736:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211684352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758521.452763:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758521.452772:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758521.452796:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758521.452801:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758521.452808:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758522.413641:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758522.796258:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758522.796284:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211684480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758522.796357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758522.796531:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684480 00000100:00100000:0.0:1782758522.796541:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684480 00000100:00100000:0.0:1782758522.796600:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1782758522.796612:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211684480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758522.796652:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758522.796706:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211684480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758522.796713:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00080000:3.0:1782758522.796961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758522.797017:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211684480:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782758523.013409:0:97044:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8e186400 20000000:00000080:0.0:1782758523.013428:0:97044:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbc800 uarg=0000000000000000 10000000:01000000:0.0:1782758523.021184:0:97044:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758523.021211:0:97044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758523.021231:0:97044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758523.021240:0:97044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758523.021281:0:97044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758523.021310:0:97044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 18 pid: 5794 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758523.021326:0:97044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97044:1869355211684608:0@lo:104: 00000100:00100000:0.0:1782758523.021392:0:97044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758523.021444:0:97044:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182c480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758523.021469:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782758523.021495:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684608 00000100:00100000:3.0:1782758523.021504:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684608 00000100:00100000:3.0:1782758523.021563:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1782758523.021573:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b347e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97044:x1869355211684608:12345-0@lo:104: 00010000:00010000:3.0:1782758523.021587:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021654:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758523.021660:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b347e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97044:x1869355211684608:12345-0@lo:104: Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758523.021667:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1782758523.021712:0:97044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97044:1869355211684608:0@lo:104: 00010000:00010000:3.0:1782758523.021728:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758523.021736:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758523.021742:0:97044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021745:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758523.021752:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021767:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758523.021775:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758523.021781:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758523.021813:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021848:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758523.021872:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021880:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51800/0xdd99f5c4777db980 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db987 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.021896:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758523.021898:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758523.021900:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758523.022124:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211684736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758523.022160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758523.022559:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684736 00000100:00100000:0.0:1782758523.022566:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684736 00010000:00010000:0.0:1782758523.022589:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758523.022844:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1782758523.022853:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211684736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758523.022866:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758523.022872:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022885:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022905:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777db987 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db980 expref: 19 pid: 5794 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022919:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022927:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022941:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022947:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022953:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022959:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022964:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758523.022968:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022975:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.022999:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758523.023015:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758523.023186:0:97044:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758523.023193:0:97044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758523.023200:0:97044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777db98e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758523.024438:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211684736:12345-0@lo:103:ldlm_bl.0 Request processed in 1579us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758523.024450:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1782758523.025028:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211684736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758523.447103:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758523.935236:0:97093:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffec893530 20000000:00000080:3.0:1782758523.935256:0:97093:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be2000 uarg=0000000000000000 10000000:01000000:3.0:1782758523.937294:0:97093:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758523.937332:0:97093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937353:0:97093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937366:0:97093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937373:0:97093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937379:0:97093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937386:0:97093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937391:0:97093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758523.937395:0:97093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937401:0:97093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937414:0:97093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937421:0:97093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758523.937427:0:97093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db995 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758524.086419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758524.086485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758524.086587:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832640 00000100:00100000:1.0:1782758524.086599:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832640 00000100:00100000:1.0:1782758524.086660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1415 00000100:00100000:1.0:1782758524.086672:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196832640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758524.086766:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196832640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758524.086796:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1415 00000100:00100000:0.0:1782758524.091178:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832768 00000100:00100000:0.0:1782758524.091194:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832768 00000100:00080000:2.0:1782758524.099933:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758524.099934:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:1.0:1782758524.099948:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196832768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758524.100040:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196832768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (13554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758524.100049:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1858 10000000:01000000:0.0:1782758524.395942:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758524.395952:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758524.395957:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758524.396008:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758524.396021:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758524.396032:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758524.396058:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211684864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758524.396137:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758524.396188:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182c540 going to sleep for 11 seconds 00000100:00100000:3.0:1782758524.398083:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684864 00000100:00100000:3.0:1782758524.398104:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684864 00000100:00100000:3.0:1782758524.398165:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1782758524.398175:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211684864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758524.398194:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758524.398214:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db99c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758524.398243:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758524.398255:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758524.398265:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758524.398335:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211684864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758524.398341:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1782758524.398537:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211684864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758524.398562:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758524.398572:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758524.398603:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758524.398608:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758524.398614:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758524.463014:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758524.847810:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211684992:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848247:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211685504:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848299:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758524.848305:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211685120:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848340:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211685632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848385:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211685248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758524.848424:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211685376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758524.848485:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685504 00000100:00100000:3.0:1782758524.848491:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685504 00000100:00100000:3.0:1782758524.848537:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685120 00000100:00100000:3.0:1782758524.848540:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685120 00000100:00100000:3.0:1782758524.848555:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685248 00000100:00100000:3.0:1782758524.848557:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685248 00000100:00100000:3.0:1782758524.848572:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1782758524.848580:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211685504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848634:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211685504:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758524.848641:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1782758524.848662:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1782758524.848668:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211685120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848696:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211685120:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758524.848702:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1782758524.848714:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1782758524.848719:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848747:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211685248:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758524.848753:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1782758524.848773:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685632 00000100:00100000:3.0:1782758524.848777:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685632 00000100:00100000:3.0:1782758524.848802:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685376 00000100:00100000:3.0:1782758524.848804:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685376 00000100:00100000:3.0:1782758524.848850:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1782758524.848856:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211685632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848887:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211685632:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758524.848907:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1782758524.848918:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1782758524.848924:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211685376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.848954:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211685376:12345-0@lo:400:kworker.0 Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758524.849064:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211684992 00000100:00100000:2.0:1782758524.849069:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211684992 00000100:00100000:2.0:1782758524.849099:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1782758524.849106:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211684992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758524.849140:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211684992:12345-0@lo:400:kworker.0 Request processed in 35us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758524.849146:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00080000:2.0:1782758524.849930:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758524.849936:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758524.849939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758524.852263:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1782758524.852352:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211685376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.852368:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211685248:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.852411:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211685120:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.852422:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211685632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.852433:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211684992:0@lo:400:kworker.0 00000100:00100000:3.0:1782758524.852456:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211685504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758525.362271:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758525.362294:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211685760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758525.362367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758525.362446:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685760 00000100:00100000:2.0:1782758525.362455:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685760 00000100:00100000:2.0:1782758525.362507:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1782758525.362516:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211685760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758525.362557:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758525.362604:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211685760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758525.362611:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1782758525.362657:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211685760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758525.487845:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758526.508657:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758527.500058:0:97288:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffce90c990 20000000:00000080:2.0:1782758527.500075:0:97288:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812e9800 uarg=0000000000000000 00010000:00010000:2.0:1782758527.500323:0:97288:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758527.500337:0:97288:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758527.500349:0:97288:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758527.500368:0:97288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.500393:0:97288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.500402:0:97288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.500440:0:97288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.500453:0:97288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 18 pid: 5793 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758527.500468:0:97288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97288:1869355211685888:0@lo:104: 00000100:00100000:2.0:1782758527.500530:0:97288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758527.500586:0:97288:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083696600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758527.500777:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211685888 00000100:00100000:0.0:1782758527.500796:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211685888 00000100:00100000:0.0:1782758527.500867:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782758527.500878:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97288:x1869355211685888:12345-0@lo:104: 00010000:00010000:0.0:1782758527.500892:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.501097:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758527.501104:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97288:x1869355211685888:12345-0@lo:104: Request processed in 228us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758527.501112:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:1.0:1782758527.501140:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758527.501148:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.501156:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758527.501161:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.501170:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758527.501177:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758527.501184:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758527.501219:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.501226:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758527.501251:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.501258:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777db99c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.501272:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758527.501275:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758527.501277:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758527.501290:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211686016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758527.501327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758527.501432:0:97288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97288:1869355211685888:0@lo:104: 00010000:00010000:2.0:1782758527.501455:0:97288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758527.503038:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686016 00000100:00100000:0.0:1782758527.503050:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686016 00010000:00010000:0.0:1782758527.503091:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758527.503147:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1782758527.503156:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211686016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758527.503172:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758527.503177:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503192:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503209:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690600/0xdd99f5c4777db9a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db99c expref: 19 pid: 5793 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503222:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503232:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503249:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503256:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503263:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503270:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503276:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758527.503280:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503288:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503312:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758527.503322:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758527.503396:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211686016:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758527.503403:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1782758527.503438:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211686016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758527.503512:0:97288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.503528:0:97288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758527.503535:0:97288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777db9aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758527.533651:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758527.917954:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211686144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758527.918042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758527.918123:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686144 00000100:00100000:3.0:1782758527.918130:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686144 00000100:00100000:3.0:1782758527.918185:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1782758527.918193:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211686144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758527.918228:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758527.918274:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211686144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758527.918282:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00080000:3.0:1782758527.918303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758527.918339:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211686144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758528.556708:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758529.204565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758529.204640:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833024 00000100:00100000:3.0:1782758529.204651:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833024 00000100:00100000:3.0:1782758529.204726:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:3.0:1782758529.204737:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196833024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758529.204814:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196833024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758529.204851:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00080000:2.0:1782758529.204976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758529.217039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758529.219063:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196832896 00000100:00100000:3.0:1782758529.219079:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196832896 00000100:00100000:3.0:1782758529.219139:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1418 00000100:00100000:3.0:1782758529.219150:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196832896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758529.219325:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196832896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 175us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758529.219332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1418 10000000:01000000:1.0:1782758529.460593:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758529.460605:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758529.460611:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758529.461470:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758529.461487:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758529.461503:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758529.461538:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211686272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758529.461629:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758529.462277:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182c840 going to sleep for 11 seconds 00000100:00100000:2.0:1782758529.462457:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686272 00000100:00100000:2.0:1782758529.462466:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686272 00000100:00100000:2.0:1782758529.462526:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:2.0:1782758529.462535:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211686272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758529.462551:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758529.462569:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db9b1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758529.462600:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758529.462612:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758529.462621:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782758529.462735:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211686272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758529.462742:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1782758529.462864:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211686272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758529.462880:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758529.462889:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758529.462911:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758529.462916:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758529.462924:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758529.579994:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758529.965032:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211686784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965173:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758529.965179:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211686400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965232:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211686912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965354:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211686528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965396:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211687040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758529.965449:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211686656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758529.965506:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686784 00000100:00100000:3.0:1782758529.965514:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686784 00000100:00100000:3.0:1782758529.965566:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687040 00000100:00100000:3.0:1782758529.965569:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687040 00000100:00100000:3.0:1782758529.965606:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1782758529.965616:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211686784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.965673:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211686784:12345-0@lo:400:kworker.0 Request processed in 59us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758529.965690:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782758529.965856:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686912 00000100:00100000:2.0:1782758529.965860:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686912 00000100:00100000:2.0:1782758529.965889:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686528 00000100:00100000:2.0:1782758529.965892:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686528 00000100:00100000:2.0:1782758529.965911:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686656 00000100:00100000:2.0:1782758529.965914:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686656 00000100:00100000:2.0:1782758529.965929:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1782758529.965935:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211686912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758529.965973:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211686912:12345-0@lo:400:kworker.0 Request processed in 38us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758529.965980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1782758529.965994:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1782758529.966000:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211686528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758529.966032:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211686528:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758529.966038:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1782758529.966050:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1782758529.966056:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211686656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758529.966082:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211686656:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758529.966087:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1782758529.966104:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1782758529.966110:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211687040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758529.966136:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211687040:12345-0@lo:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758529.966142:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00080000:3.0:1782758529.966416:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758529.966421:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758529.966423:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758529.966460:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211686656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.966473:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211686528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.966485:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211687040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.966517:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211686912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.966526:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211686784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.966565:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211686400 00000100:00100000:3.0:1782758529.966570:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211686400 00000100:00100000:3.0:1782758529.967427:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1782758529.967436:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211686400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758529.967507:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211686400:12345-0@lo:400:kworker.0 Request processed in 72us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758529.967514:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:2.0:1782758529.971182:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211686400:0@lo:400:kworker.0 00000100:00100000:1.0:1782758530.478524:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211687168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758530.478608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758530.478731:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687168 00000100:00100000:0.0:1782758530.478739:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687168 00000100:00100000:0.0:1782758530.478799:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1782758530.478809:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211687168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758530.478880:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758530.482883:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211687168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4064us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758530.482901:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:1.0:1782758530.483938:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211687168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758530.605146:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758531.396364:0:97488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2d291230 20000000:00000080:2.0:1782758531.396382:0:97488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812ebc00 uarg=0000000000000000 00010000:00010000:2.0:1782758531.397668:0:97488:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758531.397686:0:97488:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758531.397700:0:97488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758531.397718:0:97488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.397736:0:97488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.397744:0:97488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.398182:0:97488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.398198:0:97488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 18 pid: 5793 timeout: 2699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758531.398214:0:97488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97488:1869355211687296:0@lo:104: 00000100:00100000:2.0:1782758531.398280:0:97488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758531.398655:0:97488:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758531.400517:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687296 00000100:00100000:3.0:1782758531.400532:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687296 00000100:00100000:3.0:1782758531.400611:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1782758531.400622:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97488:x1869355211687296:12345-0@lo:104: 00010000:00010000:3.0:1782758531.400640:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758531.400741:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758531.400747:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97488:x1869355211687296:12345-0@lo:104: Request processed in 128us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758531.400755:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:0.0:1782758531.400934:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758531.400941:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.400950:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758531.400954:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.400963:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758531.400971:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758531.400982:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758531.401018:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401025:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758531.401046:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401053:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777db9b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9b8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401072:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758531.401073:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758531.401075:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758531.401089:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211687424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758531.401161:0:97488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97488:1869355211687296:0@lo:104: 00000100:00100000:0.0:1782758531.401185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782758531.401189:0:97488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758531.401242:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687424 00000100:00100000:0.0:1782758531.401247:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687424 00010000:00010000:0.0:1782758531.401269:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 2699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758531.401301:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1782758531.401320:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211687424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758531.401331:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758531.401337:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 2699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401347:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 2699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401361:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777db9b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db9b1 expref: 19 pid: 5793 timeout: 2699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401375:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401384:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401398:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401406:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401413:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401420:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401426:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758531.401430:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401437:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401448:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.401461:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758531.401492:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211687424:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758531.401499:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1782758531.401525:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211687424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758531.401918:0:97488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.401934:0:97488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758531.401940:0:97488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777db9bf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758531.628152:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758532.174383:0:97536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd18fb1520 20000000:00000080:1.0:1782758532.174399:0:97536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbc2a400 uarg=0000000000000000 00010000:00010000:1.0:1782758532.176196:0:97536:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758532.176223:0:97536:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758532.176239:0:97536:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758532.176261:0:97536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176278:0:97536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176289:0:97536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176310:0:97536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176318:0:97536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176326:0:97536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176333:0:97536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758532.176337:0:97536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176346:0:97536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176361:0:97536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176369:0:97536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.176376:0:97536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777db9c6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758532.653336:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758532.715927:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758532.715934:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758532.715938:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758532.715985:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.716002:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758532.716013:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758532.716040:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211687552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758532.716110:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758532.716173:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170836966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758532.716225:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687552 00000100:00100000:2.0:1782758532.716232:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687552 00000100:00100000:2.0:1782758532.716299:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1782758532.716309:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211687552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758532.716326:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758532.716342:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db9cd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758532.716373:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758532.716383:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758532.716392:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758532.716445:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211687552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758532.716452:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1782758532.716557:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211687552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758532.716574:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758532.716582:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758532.716612:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758532.716618:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758532.716624:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758533.040769:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211687680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758533.040880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758533.041058:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687680 00000100:00100000:0.0:1782758533.041068:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687680 00000100:00100000:0.0:1782758533.041139:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1782758533.041150:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211687680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758533.041189:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758533.041241:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211687680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758533.041249:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1782758533.041306:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211687680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758533.041355:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758533.675975:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758534.324705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758534.324752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758534.325016:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833280 00000100:00100000:3.0:1782758534.325027:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833280 00000100:00100000:3.0:1782758534.325090:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1866 00000100:00100000:3.0:1782758534.325100:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196833280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758534.325175:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196833280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758534.325183:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1866 00000100:00100000:3.0:1782758534.325214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833152 00000100:00100000:3.0:1782758534.325218:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833152 00000100:00100000:3.0:1782758534.325241:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1422 00000100:00100000:3.0:1782758534.325248:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196833152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758534.325288:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196833152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758534.325294:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1422 00000100:00080000:3.0:1782758534.325320:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758534.703575:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758535.084278:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211688064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.084356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758535.084433:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688064 00000100:00100000:3.0:1782758535.084440:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688064 00000100:00100000:3.0:1782758535.084487:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1782758535.084496:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211688064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.084545:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211688064:12345-0@lo:400:kworker.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758535.084552:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00080000:3.0:1782758535.084576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758535.084606:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211688064:0@lo:400:kworker.0 00000100:00100000:2.0:1782758535.084856:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211687936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758535.084888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758535.084916:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758535.084922:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211687808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758535.084948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758535.084985:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211688192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758535.085011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758535.085291:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688192 00000100:00100000:2.0:1782758535.085297:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688192 00000100:00100000:2.0:1782758535.085338:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1782758535.085345:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211688192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758535.085396:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211688192:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758535.085403:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1782758535.085427:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211688192:0@lo:400:kworker.0 00000100:00080000:2.0:1782758535.085446:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758535.085533:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758535.085541:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211688320:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.085575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758535.085598:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687936 00000100:00100000:3.0:1782758535.085602:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687936 00000100:00100000:3.0:1782758535.085620:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688320 00000100:00100000:3.0:1782758535.085622:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688320 00000100:00100000:1.0:1782758535.085748:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1782758535.085759:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758535.085796:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211687936:12345-0@lo:400:kworker.0 Request processed in 40us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758535.085803:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1782758535.085844:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211687808 00000100:00100000:1.0:1782758535.085847:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211687808 00000100:00100000:1.0:1782758535.085869:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1782758535.085875:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211687808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758535.085903:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211687808:12345-0@lo:400:kworker.0 Request processed in 28us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758535.085909:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00080000:1.0:1782758535.085951:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758535.086118:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1782758535.086125:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211688320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086156:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211688320:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758535.086162:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1782758535.086200:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211688320:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086210:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211687808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086218:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211687936:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086261:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211688448:0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758535.086354:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688448 00000100:00100000:3.0:1782758535.086357:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688448 00000100:00100000:3.0:1782758535.086381:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1782758535.086386:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211688448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758535.086415:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211688448:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758535.086421:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00080000:3.0:1782758535.086433:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758535.086447:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211688448:0@lo:400:kworker.0 00000100:00100000:1.0:1782758535.596053:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758535.596082:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211688576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758535.596164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758535.596279:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688576 00000100:00100000:3.0:1782758535.596287:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688576 00000100:00100000:3.0:1782758535.596346:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1782758535.596356:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211688576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758535.596400:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758535.596456:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211688576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758535.596463:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1782758535.596785:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211688576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758535.728713:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758536.748096:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758537.358786:0:97829:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd57b11fa0 20000000:00000080:1.0:1782758537.358814:0:97829:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc3800 uarg=0000000000000000 00010000:00010000:1.0:1782758537.362095:0:97829:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758537.362135:0:97829:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758537.362163:0:97829:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758537.362426:0:97829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.362451:0:97829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.362462:0:97829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.362518:0:97829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.362539:0:97829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 18 pid: 5796 timeout: 2705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758537.362559:0:97829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97829:1869355211688704:0@lo:104: 00000100:00100000:1.0:1782758537.362657:0:97829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758537.363094:0:97829:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718bec5240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758537.363206:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688704 00000100:00100000:0.0:1782758537.363217:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688704 00000100:00100000:0.0:1782758537.363288:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1782758537.363301:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97829:x1869355211688704:12345-0@lo:104: 00010000:00010000:0.0:1782758537.363319:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758537.363412:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758537.363419:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:97829:x1869355211688704:12345-0@lo:104: Request processed in 121us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758537.363427:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1782758537.363587:0:97829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97829:1869355211688704:0@lo:104: 00010000:00010000:1.0:1782758537.363611:0:97829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364331:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758537.364342:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364352:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758537.364357:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364367:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758537.364375:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758537.364382:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758537.364446:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364454:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758537.364483:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364491:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5800/0xdd99f5c4777db9cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9d4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364512:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758537.364514:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758537.364516:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758537.364525:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758537.364542:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211688832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758537.364596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758537.364648:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688832 00000100:00100000:2.0:1782758537.364654:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688832 00010000:00010000:2.0:1782758537.364681:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 2705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758537.364709:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1782758537.364718:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211688832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758537.364732:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758537.364738:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 2705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364753:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 2705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364769:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777db9d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db9cd expref: 19 pid: 5796 timeout: 2705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364785:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364795:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364813:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364838:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364846:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364853:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364858:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758537.364863:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364885:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364902:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758537.364911:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758537.364944:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211688832:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758537.364951:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1782758537.364995:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211688832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758537.365266:0:97829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.365281:0:97829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.365288:0:97829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777db9db lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758537.772079:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758538.156846:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758538.156952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758538.157051:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211688960 00000100:00100000:1.0:1782758538.157062:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211688960 00000100:00100000:1.0:1782758538.157153:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1782758538.157165:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211688960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758538.157224:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758538.157281:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211688960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758538.157290:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00080000:1.0:1782758538.157320:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758538.157367:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211688960:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782758538.329716:0:97877:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1fa61ad0 20000000:00000080:2.0:1782758538.329747:0:97877:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812e9400 uarg=0000000000000000 00010000:00010000:2.0:1782758538.330660:0:97877:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758538.330683:0:97877:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758538.330711:0:97877:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758538.330741:0:97877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330761:0:97877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330773:0:97877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330780:0:97877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330787:0:97877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330794:0:97877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330803:0:97877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758538.330808:0:97877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.330816:0:97877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.331100:0:97877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.331109:0:97877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758538.331116:0:97877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777db9e2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758538.800687:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758538.987900:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758538.987908:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758538.987913:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758538.987961:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758538.987973:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758538.987984:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758538.988012:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083575180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211689088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758538.988081:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758538.988133:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758538.988309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689088 00000100:00100000:3.0:1782758538.988317:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689088 00000100:00100000:3.0:1782758538.988375:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1782758538.988385:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211689088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758538.988403:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758538.988419:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777db9e9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758538.988443:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758538.988453:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758538.988461:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758538.988517:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211689088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758538.988524:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1782758538.988572:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083575180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211689088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758538.988590:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758538.988598:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758538.988622:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758538.988626:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758538.988632:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758539.447348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758539.447386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758539.447414:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833536 00000100:00100000:3.0:1782758539.447425:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833536 00000100:00100000:3.0:1782758539.447489:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1870 00000100:00100000:3.0:1782758539.447499:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196833536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758539.447576:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196833536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758539.447584:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1870 00000100:00100000:0.0:1782758539.448854:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833408 00000100:00100000:0.0:1782758539.448866:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833408 00000100:00100000:0.0:1782758539.448941:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1425 00000100:00100000:0.0:1782758539.448950:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196833408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758539.449013:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196833408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758539.449020:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1425 00000100:00080000:1.0:1782758539.449453:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758539.820778:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758540.215035:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758540.215056:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211689344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758540.215120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758540.215194:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689344 00000100:00100000:1.0:1782758540.215202:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689344 00000100:00100000:1.0:1782758540.215295:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:1.0:1782758540.215303:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211689344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758540.215352:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211689344:12345-0@lo:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758540.215360:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:1.0:1782758540.215396:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211689344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758540.215426:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211689472:0@lo:400:kworker.0 00000100:00100000:1.0:1782758540.215446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.215557:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211689216:0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.216381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.216440:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689472 00000100:00100000:3.0:1782758540.216446:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689472 00000100:00100000:3.0:1782758540.216498:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1782758540.216507:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211689472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.216550:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211689472:12345-0@lo:400:kworker.0 Request processed in 45us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758540.216557:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00080000:3.0:1782758540.216578:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758540.217863:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689216 00000100:00100000:2.0:1782758540.217872:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689216 00000100:00100000:2.0:1782758540.217933:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1782758540.217943:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211689216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758540.218009:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211689216:12345-0@lo:400:kworker.0 Request processed in 67us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758540.218017:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1782758540.218474:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211689216:0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.218987:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211689728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.219033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.219069:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758540.219075:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211689600:0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.219101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.219129:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689600 00000100:00100000:3.0:1782758540.219143:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689600 00000100:00100000:3.0:1782758540.219183:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1782758540.219190:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211689600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.219244:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211689600:12345-0@lo:400:kworker.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758540.219251:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00080000:3.0:1782758540.219275:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758540.219296:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211689600:0@lo:400:kworker.0 00000100:00100000:2.0:1782758540.219414:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211689856:0@lo:400:kworker.0 00000100:00100000:2.0:1782758540.219442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.219746:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689856 00000100:00100000:3.0:1782758540.219751:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689856 00000100:00100000:3.0:1782758540.219789:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1782758540.219795:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211689856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.219849:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211689856:12345-0@lo:400:kworker.0 Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758540.219854:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1782758540.219964:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211689856:0@lo:400:kworker.0 00000100:00080000:2.0:1782758540.220056:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758540.220114:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689728 00000100:00100000:0.0:1782758540.220118:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689728 00000100:00100000:0.0:1782758540.220172:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:0.0:1782758540.220178:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758540.220216:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211689728:12345-0@lo:400:kworker.0 Request processed in 38us (1182us total) trans 0 rc 0/0 00000100:00080000:2.0:1782758540.220278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758540.220305:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1782758540.220368:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211689728:0@lo:400:kworker.0 00000100:00100000:1.0:1782758540.220515:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211689472:0@lo:400:kworker.0 00000100:00100000:3.0:1782758540.716089:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211689984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758540.716171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758540.716239:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211689984 00000100:00100000:3.0:1782758540.716246:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211689984 00000100:00100000:3.0:1782758540.717259:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1782758540.717345:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211689984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758540.717384:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758540.717945:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211689984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758540.717954:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1782758540.718119:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211689984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758540.845032:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758541.662660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758541.665543:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833664 00000100:00100000:0.0:1782758541.665573:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833664 00000100:00100000:0.0:1782758541.665694:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1111 00000100:00100000:0.0:1782758541.665708:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57335:x1869355196833664:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758541.665731:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758541.665816:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d7e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782758541.666278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758541.666408:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.666425:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.666438:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758541.666670:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782758541.666675:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758541.666759:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.666788:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777db9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d7e expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.666808:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d7e expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.666865:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdf00) 00010000:00010000:1.0:1782758541.666869:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758541.666873:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758541.667139:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57335:x1869355196833664:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1433us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758541.667148:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1111 00000100:00100000:3.0:1782758541.671676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758541.672147:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833792 00000100:00100000:0.0:1782758541.672158:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833792 00000100:00100000:0.0:1782758541.672223:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:0.0:1782758541.672234:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57335:x1869355196833792:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758541.672254:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758541.672276:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dba05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d85 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672343:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672357:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672368:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672413:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672422:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.672429:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677202:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677220:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677227:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677234:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758541.677239:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677247:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677267:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdf00) 00010000:00010000:1.0:1782758541.677270:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758541.677274:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677281:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dba0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677300:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677306:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677312:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677318:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758541.677321:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677327:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677334:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfd000) 00010000:00010000:1.0:1782758541.677336:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758541.677339:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677345:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dba13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677391:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dba05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d85 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677401:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdf00) 00010000:00010000:1.0:1782758541.677404:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758541.677408:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dba05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d85 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758541.677417:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:1.0:1782758541.678979:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57335:x1869355196833792:12345-192.168.204.31@tcp:101:rm.0 Request processed in 6740us (7308us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758541.678993:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1112 00000100:00100000:0.0:1782758541.727548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758541.727670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758541.734685:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196833920 00000100:00100000:1.0:1782758541.734700:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196833920 00000100:00100000:3.0:1782758541.734813:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834176 00000100:00100000:3.0:1782758541.734835:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834176 00000100:00100000:3.0:1782758541.734896:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1113 00000100:00100000:3.0:1782758541.734914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57339:x1869355196834176:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782758541.734971:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758541.734999:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777db9fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d7e expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.735017:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdf00) 00010000:00010000:3.0:1782758541.735027:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758541.735300:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.735318:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758541.735654:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1114 00000100:00100000:2.0:1782758541.735664:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196833920:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782758541.735695:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00010000:00010000:3.0:1782758541.735727:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.735746:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.735754:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.735763:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758541.735797:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196833920:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 132us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758541.735805:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1114 00000004:00200000:3.0:1782758541.739247:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00010000:00010000:3.0:1782758541.739269:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739280:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739291:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739297:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758541.739302:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739309:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739334:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782758541.739337:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758541.739342:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.739348:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758541.739371:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000585ea00e reply state 00000000088e5dc1 transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758541.739380:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758541.740887:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57339:x1869355196834176:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 5963us (13205us total) trans 4294967725 rc 0/0 00000100:00100000:3.0:1782758541.741095:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1113 00010000:00010000:2.0:1782758541.744900:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744919:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744927:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744934:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758541.744939:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744946:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744964:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75800) 00010000:00010000:2.0:1782758541.744967:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758541.744971:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.744978:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dba21 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758541.801966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758541.802158:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834304 00000100:00100000:2.0:1782758541.802169:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834304 00000100:00100000:2.0:1782758541.802227:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1115 00000100:00100000:2.0:1782758541.802237:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57343:x1869355196834304:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:2.0:1782758541.802263:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758541.802288:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dba28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d8c expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802349:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802361:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802372:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758541.802441:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758541.802445:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758541.802470:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802491:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dba28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d8c expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802508:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d8c expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.802516:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782758541.802520:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758541.802523:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758541.802591:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57343:x1869355196834304:12345-192.168.204.31@tcp:101:chown.0 Request processed in 355us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758541.802598:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1115 00000100:00100000:1.0:1782758541.805446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758541.805927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834432 00000100:00100000:2.0:1782758541.805938:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834432 00000100:00100000:3.0:1782758541.806139:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1116 00000100:00100000:3.0:1782758541.806153:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57343:x1869355196834432:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782758541.806173:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758541.806194:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d93 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806258:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806271:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806281:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806300:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806308:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806314:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806418:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806442:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806449:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758541.806488:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00000004:00200000:3.0:1782758541.806492:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758541.806511:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806523:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806530:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806537:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806546:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758541.806559:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806567:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806580:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1000) 00010000:00010000:3.0:1782758541.806583:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758541.806587:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806593:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806725:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806732:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806740:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806745:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758541.806749:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806756:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806767:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75b00) 00010000:00010000:3.0:1782758541.806770:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758541.806772:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806778:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806809:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dba36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d93 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806850:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d93 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758541.806858:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782758541.806860:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758541.806862:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758541.807131:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57343:x1869355196834432:12345-192.168.204.31@tcp:101:chown.0 Request processed in 981us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758541.807140:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1116 00000100:00100000:3.0:1782758541.815760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758541.816127:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834688 00000100:00100000:0.0:1782758541.816138:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834688 00000100:00100000:0.0:1782758541.816231:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1117 00000100:00100000:0.0:1782758541.816242:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57343:x1869355196834688:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:0.0:1782758541.816302:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758541.816331:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dba4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d93 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.816351:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:0.0:1782758541.816365:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758541.816390:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.816402:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.816410:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758541.816647:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ebde99a reply state 00000000028da611 transno 4294967726 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758541.816657:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758541.816672:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00000100:00100000:0.0:1782758541.816768:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57343:x1869355196834688:12345-192.168.204.31@tcp:36:chown.0 Request processed in 527us (1016us total) trans 4294967726 rc 0/0 00000100:00100000:0.0:1782758541.816777:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1117 00010000:00010000:2.0:1782758541.825224:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825244:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825253:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825259:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758541.825264:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825273:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825292:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:2.0:1782758541.825295:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758541.825300:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758541.825307:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dba52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758541.868024:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758542.782695:0:98075:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc890772e0 20000000:00000080:3.0:1782758542.782715:0:98075:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb2000 uarg=0000000000000000 00010000:00010000:2.0:1782758542.788686:0:98075:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758542.788729:0:98075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1000) 00010000:00010000:2.0:1782758542.788732:0:98075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758542.788743:0:98075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dba2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d8c expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.788766:0:98075:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782758542.788783:0:98075:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758542.788797:0:98075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.788809:0:98075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.788817:0:98075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.789276:0:98075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.789290:0:98075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 18 pid: 5796 timeout: 2711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758542.789305:0:98075:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98075:1869355211690112:0@lo:104: 00000100:00100000:2.0:1782758542.789384:0:98075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758542.789493:0:98075:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758542.789767:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690112 00000100:00100000:1.0:1782758542.789775:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690112 00000100:00100000:1.0:1782758542.790271:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782758542.790282:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:98075:x1869355211690112:12345-0@lo:104: 00010000:00010000:1.0:1782758542.790297:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758542.790368:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758542.790373:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:98075:x1869355211690112:12345-0@lo:104: Request processed in 94us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758542.790379:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:3.0:1782758542.790444:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758542.790452:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758542.790469:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758542.790473:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758542.790483:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758542.790489:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758542.790495:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758542.790530:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758542.790537:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758542.790558:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758542.790565:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50600/0xdd99f5c4777db9e9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777db9f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758542.790582:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758542.790584:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758542.790586:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758542.790607:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211690240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758542.790641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758542.790815:0:98075:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98075:1869355211690112:0@lo:104: 00010000:00010000:2.0:1782758542.790855:0:98075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758542.790989:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690240 00000100:00100000:0.0:1782758542.790995:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690240 00010000:00010000:0.0:1782758542.791018:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 2711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758542.791045:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1782758542.791051:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211690240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758542.791060:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758542.791065:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 2711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791173:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 2711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791186:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777db9f0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777db9e9 expref: 19 pid: 5796 timeout: 2711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791199:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791206:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791220:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791227:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791233:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791239:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791248:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758542.791252:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791257:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791277:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758542.791286:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758542.791364:0:98075:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.791373:0:98075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758542.791378:0:98075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777dba59 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758542.793836:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211690240:12345-0@lo:103:ldlm_bl.0 Request processed in 2760us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758542.793851:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1782758542.796900:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211690240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758542.900619:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758543.276557:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758543.276584:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211690368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758543.276654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758543.276756:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690368 00000100:00100000:2.0:1782758543.276764:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690368 00000100:00080000:1.0:1782758543.276848:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758543.276897:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1782758543.276908:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211690368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758543.276949:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758543.277025:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211690368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758543.277035:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1782758543.277109:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211690368:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782758543.598292:0:98123:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc88ae1650 20000000:00000080:1.0:1782758543.598309:0:98123:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc3400 uarg=0000000000000000 00010000:00010000:1.0:1782758543.598543:0:98123:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758543.598561:0:98123:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758543.598575:0:98123:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758543.598595:0:98123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598612:0:98123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598623:0:98123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598631:0:98123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598639:0:98123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598647:0:98123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598654:0:98123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758543.598659:0:98123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598667:0:98123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598680:0:98123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598689:0:98123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758543.598696:0:98123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dba60 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758543.878665:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967726 is committed 00010000:00010000:3.0:1782758543.916660:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782758544.555985:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758544.555992:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758544.555997:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758544.556042:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758544.556064:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758544.556076:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758544.556102:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211690496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758544.556173:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758544.556388:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083696180 going to sleep for 11 seconds 00000100:00100000:0.0:1782758544.559684:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690496 00000100:00100000:0.0:1782758544.559699:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690496 00000100:00100000:0.0:1782758544.559756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1782758544.559766:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211690496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758544.559787:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758544.559808:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dba67 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758544.559857:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758544.559869:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758544.559880:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:0.0:1782758544.559963:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211690496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (3790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758544.560425:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211690496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758544.560446:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758544.560456:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758544.560479:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758544.560485:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758544.560493:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758544.561522:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1782758544.579760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758544.579810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758544.580352:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834816 00000100:00100000:2.0:1782758544.580365:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834816 00000100:00100000:2.0:1782758544.580420:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00100000:2.0:1782758544.580430:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196834816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758544.580506:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196834816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758544.580515:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1428 00000100:00100000:0.0:1782758544.580611:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196834944 00000100:00100000:0.0:1782758544.580616:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196834944 00000100:00100000:0.0:1782758544.580671:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1874 00000100:00100000:0.0:1782758544.580678:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196834944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758544.580715:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196834944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758544.580722:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1874 00000100:00080000:2.0:1782758544.580890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758544.940057:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758545.329242:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211690624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329414:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211691136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329479:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758545.329484:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211690752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329522:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211691264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329605:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211691008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329650:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758545.329654:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211690880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758545.329714:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691136 00000100:00100000:2.0:1782758545.329724:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691136 00000100:00100000:2.0:1782758545.329789:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690752 00000100:00100000:2.0:1782758545.329793:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690752 00000100:00100000:2.0:1782758545.329812:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690880 00000100:00100000:2.0:1782758545.329815:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690880 00000100:00100000:2.0:1782758545.329865:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:2.0:1782758545.329876:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211691136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.329943:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211691136:12345-0@lo:400:kworker.0 Request processed in 67us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758545.329952:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:2.0:1782758545.329974:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1782758545.329981:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211690752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330015:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211690752:12345-0@lo:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758545.330022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1782758545.330066:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:2.0:1782758545.330076:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211690880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758545.330121:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211690624 00000100:00100000:2.0:1782758545.330122:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211690880:12345-0@lo:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758545.330137:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1782758545.330140:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211690624 00000100:00100000:2.0:1782758545.330175:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691264 00000100:00100000:2.0:1782758545.330182:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691264 00000100:00100000:2.0:1782758545.330225:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691008 00000100:00100000:2.0:1782758545.330229:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691008 00000100:00100000:1.0:1782758545.330265:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1782758545.330283:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211691264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330285:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1782758545.330304:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211691008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758545.330337:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1782758545.330350:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330362:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211691008:12345-0@lo:400:kworker.0 Request processed in 63us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758545.330372:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00080000:2.0:1782758545.330409:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758545.330411:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211691264:12345-0@lo:400:kworker.0 Request processed in 131us (839us total) trans 0 rc 0/0 00000100:00080000:2.0:1782758545.330416:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758545.330424:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758545.330430:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1782758545.330474:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211690880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330492:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211691008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330568:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211690752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330585:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211691264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758545.330596:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211691136:0@lo:400:kworker.0 00000100:00100000:0.0:1782758545.330942:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211690624:12345-0@lo:400:kworker.0 Request processed in 594us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758545.330952:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1782758545.331078:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211690624:0@lo:400:kworker.0 00000100:00100000:1.0:1782758545.838092:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211691392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758545.838200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758545.838415:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691392 00000100:00100000:0.0:1782758545.838423:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691392 00000100:00100000:0.0:1782758545.838475:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1782758545.838485:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211691392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758545.838521:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758545.838580:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211691392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758545.838586:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1782758545.838661:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211691392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758545.964797:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758546.518500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758546.520276:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835072 00000100:00100000:3.0:1782758546.520290:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835072 00000100:00100000:3.0:1782758546.520568:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1782758546.520579:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196835072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758546.520597:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758546.520600:0:5787:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dba2f) 00010000:00010000:3.0:1782758546.520602:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758546.520661:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196835072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (2168us total) trans 0 rc 116/116 00000100:00100000:3.0:1782758546.520668:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00080000:2.0:1782758546.525647:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758546.998205:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758547.704242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758547.704753:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835200 00000100:00100000:3.0:1782758547.704765:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835200 00000100:00100000:3.0:1782758547.704979:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1118 00000100:00100000:3.0:1782758547.705006:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57448:x1869355196835200:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758547.705030:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758547.705054:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64d9a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.705119:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.705133:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.705147:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758547.705362:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758547.705367:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758547.705959:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.706006:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d9a expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.706023:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d9a expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.706032:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758547.706034:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758547.706037:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758547.706106:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57448:x1869355196835200:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1116us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758547.706114:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1118 00000100:00100000:1.0:1782758547.729940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758547.730483:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835328 00000100:00100000:3.0:1782758547.730496:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835328 00000100:00100000:3.0:1782758547.730570:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1119 00000100:00100000:3.0:1782758547.730581:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57448:x1869355196835328:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758547.730603:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758547.730625:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64da1 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730684:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730697:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730708:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730724:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730732:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.730739:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731171:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731181:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731188:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758547.731288:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1782758547.731292:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758547.731384:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731398:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731405:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731412:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731421:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758547.731425:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731432:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731443:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758547.731446:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758547.731450:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731456:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dba8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731465:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731472:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731478:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731483:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758547.731485:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731490:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731499:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75400) 00010000:00010000:3.0:1782758547.731502:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758547.731505:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731511:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dba91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731540:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dba83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da1 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731555:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.731561:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782758547.731564:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758547.731566:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758547.731636:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57448:x1869355196835328:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1057us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758547.731645:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1119 00000100:00100000:2.0:1782758547.743535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758547.743636:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835584 00000100:00100000:3.0:1782758547.743647:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835584 00000100:00100000:3.0:1782758547.743738:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1120 00000100:00100000:3.0:1782758547.743751:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57448:x1869355196835584:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758547.743805:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758547.743856:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dba98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.743879:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782758547.743891:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758547.743916:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.743929:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.743938:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758547.824647:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967727 is committed 00000004:00010000:1.0:1782758547.825784:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000161f944a reply state 00000000b5036ef9 transno 4294967727 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758547.825802:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758547.826031:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00080000:1.0:1782758547.826130:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758547.826150:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57448:x1869355196835584:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 82398us (82621us total) trans 4294967727 rc 0/0 00000100:00100000:1.0:1782758547.826163:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1120 00010000:00010000:1.0:1782758547.826200:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826208:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826216:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826222:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758547.826226:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826234:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826250:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782758547.826253:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758547.826256:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.826262:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dba9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758547.891537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758547.891892:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835712 00000100:00100000:3.0:1782758547.891903:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835712 00000100:00100000:0.0:1782758547.891997:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1121 00000100:00100000:0.0:1782758547.892010:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57452:x1869355196835712:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758547.892032:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758547.892056:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbaa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64da8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892113:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892126:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892136:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892148:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892154:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892160:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892606:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892616:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892624:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758547.892706:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1782758547.892710:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758547.892789:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892803:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892816:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892848:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892855:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758547.892860:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892869:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892883:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:0.0:1782758547.892886:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758547.892890:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892896:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dbaad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892907:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892913:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892923:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892928:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758547.892931:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892936:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892942:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfd300) 00010000:00010000:0.0:1782758547.892944:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758547.892946:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892952:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbab4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.892979:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbaa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da8 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.893004:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da8 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.893012:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758547.893014:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758547.893016:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758547.893091:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57452:x1869355196835712:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1085us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758547.893104:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1121 00000100:00100000:1.0:1782758547.904709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758547.904932:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196835968 00000100:00100000:3.0:1782758547.904943:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196835968 00000100:00100000:3.0:1782758547.905038:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1122 00000100:00100000:3.0:1782758547.905049:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57452:x1869355196835968:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758547.905073:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758547.905096:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbac2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64daf expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905700:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905727:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905741:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905795:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905804:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.905811:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758547.919860:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:2.0:1782758547.920272:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920294:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920310:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920361:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920368:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920375:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920381:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758547.920386:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920394:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920407:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782758547.920410:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758547.920415:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920422:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbac9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758547.920437:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004897219e reply state 00000000d159a43f transno 4294967728 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758547.920446:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758547.920929:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbac2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64daf expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920948:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64daf expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.920956:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782758547.920959:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758547.920961:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758547.921554:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57452:x1869355196835968:12345-192.168.204.31@tcp:101:touch.0 Request processed in 16504us (16853us total) trans 4294967728 rc 0/0 00000100:00100000:2.0:1782758547.921565:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1122 00010000:00010000:1.0:1782758547.933364:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933385:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933399:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933405:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758547.933410:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933419:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933438:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917191f75400) 00010000:00010000:1.0:1782758547.933441:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758547.933446:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758547.933452:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758547.934866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758547.934929:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836224 00000100:00100000:0.0:1782758547.934939:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836224 00000100:00100000:0.0:1782758547.935014:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1123 00000100:00100000:0.0:1782758547.935025:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57452:x1869355196836224:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782758547.935085:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758547.935110:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64daf expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.935127:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff917182dd1900) 00010000:00010000:0.0:1782758547.935136:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758547.935183:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.935197:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758547.935208:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758547.935361:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eb324df reply state 0000000041dfa9b4 transno 4294967729 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758547.935370:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758547.936190:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57452:x1869355196836224:12345-192.168.204.31@tcp:36:touch.0 Request processed in 1162us (1377us total) trans 4294967729 rc 0/0 00000100:00100000:0.0:1782758547.936198:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1123 00010000:00010000:3.0:1782758547.944622:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944641:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944648:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944655:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758547.944659:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944668:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944685:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:3.0:1782758547.944689:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758547.944694:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758547.944700:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758547.948723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758547.948772:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836352 00000100:00100000:2.0:1782758547.948783:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836352 00000100:00100000:2.0:1782758547.948874:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1124 00000100:00100000:2.0:1782758547.948885:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57452:x1869355196836352:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782758547.948909:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758547.948932:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbaec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64db6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.949013:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbaec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64db6 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.949028:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbaec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64db6 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758547.949050:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:2.0:1782758547.949054:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782758547.949057:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758547.949115:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57452:x1869355196836352:12345-192.168.204.31@tcp:101:touch.0 Request processed in 231us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758547.949122:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1124 00000100:00100000:0.0:1782758547.956428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758547.956626:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836480 00000100:00100000:2.0:1782758547.956637:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836480 00000100:00100000:2.0:1782758547.956688:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:2.0:1782758547.956697:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196836480:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:2.0:1782758547.956731:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2616 last 0 00000020:00000080:2.0:1782758547.956768:0:9120:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777dbaf3 00002000:00100000:2.0:1782758547.956786:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917082b41000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782758547.956810:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782758547.957697:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782758547.957730:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917082b42000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782758547.957813:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196836480:12345-192.168.204.31@tcp:8:touch.0 Request processed in 1115us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758547.957863:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:0.0:1782758547.962975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758547.963121:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836608 00000100:00100000:1.0:1782758547.963132:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836608 00000100:00100000:1.0:1782758547.963211:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 619 00000100:00100000:1.0:1782758547.963223:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196836608:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:2.0:1782758547.963632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782758548.012387:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00100000:1.0:1782758548.012423:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:1.0:1782758548.012551:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196836608:12345-192.168.204.31@tcp:2:touch.0 Request processed in 49325us (49596us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1782758548.012564:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 619 00010000:00010000:3.0:1782758548.013581:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758548.017805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758548.017926:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836864 00000100:00100000:1.0:1782758548.017937:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836864 00000100:00100000:1.0:1782758548.018014:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:1.0:1782758548.018025:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57452:x1869355196836864:12345-192.168.204.31@tcp:35:touch.0 00000100:00080000:2.0:1782758548.018086:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758548.018399:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57452:x1869355196836864:12345-192.168.204.31@tcp:35:touch.0 Request processed in 374us (602us total) trans 4294967730 rc 0/0 00000100:00100000:1.0:1782758548.018407:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:1.0:1782758548.103248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758548.103583:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196836992 00000100:00100000:2.0:1782758548.103594:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196836992 00000100:00100000:2.0:1782758548.103662:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1125 00000100:00100000:2.0:1782758548.103674:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57456:x1869355196836992:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758548.103702:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758548.103736:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbafa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dbd expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103799:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103814:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103873:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103890:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103899:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.103906:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107370:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107393:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107405:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758548.107449:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 0 00000004:00200000:3.0:1782758548.107453:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758548.107474:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107487:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107496:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107502:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107509:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107515:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758548.107520:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107528:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107541:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782758548.107544:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758548.107549:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107555:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbb01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107568:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107574:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107580:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107585:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758548.107587:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107593:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107600:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917182dd1100) 00010000:00010000:3.0:1782758548.107603:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758548.107606:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107612:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dbb08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107657:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbafa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dbd expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107670:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dbd expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.107676:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:3.0:1782758548.107679:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758548.107681:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758548.108183:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57456:x1869355196836992:12345-192.168.204.31@tcp:101:rm.0 Request processed in 4508us (4943us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758548.108194:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1125 00000100:00100000:1.0:1782758548.113280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758548.113677:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196837120 00000100:00100000:3.0:1782758548.113687:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196837120 00000100:00100000:3.0:1782758548.113874:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 620 00000100:00100000:3.0:1782758548.113886:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196837120:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758548.113903:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758548.113924:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dc4 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758548.113952:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x6a42bc93, atime: 0x6a42bc93, ctime: 0x6a42bc93, blocks: 0x1 00010000:00010000:3.0:1782758548.113975:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=2616s v=(0 0) 00010000:00010000:3.0:1782758548.113987:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758548.113997:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.114022:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.114036:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758548.114094:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196837120:12345-192.168.204.31@tcp:101:rm.0 Request processed in 211us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758548.114102:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 620 00000100:00100000:1.0:1782758548.117526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758548.117620:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196837376 00000100:00100000:0.0:1782758548.117629:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196837376 00000100:00100000:0.0:1782758548.117706:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1126 00000100:00100000:0.0:1782758548.117727:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57456:x1869355196837376:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758548.117777:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758548.117803:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbb0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dbd expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117854:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbaec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64db6 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117876:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:0.0:1782758548.117888:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758548.117910:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117925:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117934:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117950:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117957:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.117964:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118091:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118099:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118106:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758548.118610:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:0.0:1782758548.118620:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2616521796644ns, next at 2617521794621ns, rc = 0 00010000:00010000:0.0:1782758548.118672:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118682:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118690:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118698:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118705:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118711:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118734:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758548.118752:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118758:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118765:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118770:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758548.118775:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118782:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118789:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758548.118792:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758548.118795:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118801:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118814:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118820:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118851:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118857:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758548.118859:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118865:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118872:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758548.118874:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758548.118877:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758548.118883:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbb1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758548.118892:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a524a3e reply state 000000006a9d138f transno 4294967731 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758548.118900:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758548.118976:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57456:x1869355196837376:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1261us (1461us total) trans 4294967731 rc 0/0 00000100:00100000:0.0:1782758548.118993:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1126 00010000:00010000:1.0:1782758548.119542:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758548.119549:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.119556:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758548.119560:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.119567:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.119577:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:1.0:1782758548.119580:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758548.119583:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.119588:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbb32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.119602:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758548.119603:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758548.119606:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758548.120613:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120625:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120633:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120639:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758548.120642:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120649:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120659:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff91718bcfde00) 00010000:00010000:3.0:1782758548.120662:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758548.120665:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.120675:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbb24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758548.396031:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758548.396054:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211691520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758548.396122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758548.396268:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691520 00000100:00100000:0.0:1782758548.396276:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691520 00000100:00100000:0.0:1782758548.396362:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1782758548.396374:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211691520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758548.396401:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758548.396451:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211691520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758548.396459:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1782758548.396505:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211691520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758548.396893:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758548.912276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758548.913625:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196837504 00000100:00100000:3.0:1782758548.913639:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196837504 00000100:00100000:3.0:1782758548.913707:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1127 00000100:00100000:3.0:1782758548.913719:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57471:x1869355196837504:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758548.913745:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758548.913765:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.913861:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.913876:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.913889:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758548.913949:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1782758548.913953:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758548.913989:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.914014:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dcb expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.914032:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dcb expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.914041:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782758548.914045:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758548.914049:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758548.914113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57471:x1869355196837504:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 396us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758548.914121:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1127 00000100:00100000:0.0:1782758548.917727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758548.918032:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196837760 00000100:00100000:3.0:1782758548.918043:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196837760 00000100:00100000:3.0:1782758548.918102:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1128 00000100:00100000:3.0:1782758548.918112:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57471:x1869355196837760:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758548.918165:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758548.918194:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dcb expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.918215:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbabb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64da8 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.918225:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782758548.918235:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758548.918261:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.918273:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.918296:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758548.976329:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000947650ed reply state 00000000cb29441c transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758548.976352:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782758548.976492:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:3.0:1782758548.976587:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57471:x1869355196837760:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 58472us (58865us total) trans 4294967732 rc 0/0 00000100:00100000:3.0:1782758548.976596:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1128 00000001:00080000:2.0:1782758548.976660:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967731 is committed 00000004:00080000:2.0:1782758548.976668:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000001:00080000:2.0:1782758548.976702:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967732 is committed 00010000:00010000:2.0:1782758548.976722:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976732:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976740:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976746:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758548.976751:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976759:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976775:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75600) 00010000:00010000:2.0:1782758548.976778:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758548.976783:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.976788:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbb47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758548.977073:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211691648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782758548.977128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758548.977190:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691648 00000100:00100000:2.0:1782758548.977197:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691648 00000100:00100000:2.0:1782758548.977240:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1782758548.977248:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211691648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782758548.977275:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:35 count 1 00010000:00010000:2.0:1782758548.977307:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.977325:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.977334:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782758548.977338:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758548.977343:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.977368:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758548.977382:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 5 pid: 6597 timeout: 2717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758548.977394:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211691776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758548.977433:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782758548.979846:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211691776:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758548.979874:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758548.980586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758548.980669:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196837888 00000100:00100000:3.0:1782758548.980676:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196837888 00010000:00010000:3.0:1782758548.980714:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 2717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758548.980753:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 448 00000100:00100000:3.0:1782758548.980762:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196837888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758548.980775:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758548.980781:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 2717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.980793:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 2717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.980818:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb79e372/0xdd99f5c4777dbb16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dc4 expref: 6 pid: 6597 timeout: 2717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.980860:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758548.980865:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758548.980870:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.980879:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.980905:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758548.980951:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196837888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758548.980958:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 448 00010000:00010000:1.0:1782758548.981031:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.981041:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.981051:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.981059:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758548.981080:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758548.981659:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211691648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4410us (4529us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1782758548.981667:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000004:00080000:1.0:1782758548.981715:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084c6c000/2, rc 0, transno 4294967367 00000100:00100000:1.0:1782758548.981721:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211691648:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782758548.982187:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758548.982195:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.982207:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758548.982212:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.982222:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.982238:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.982250:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ccf7a2b/0xdd99f5c4777dbb4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758548.982271:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758548.982273:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758548.982275:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758549.040550:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758549.040650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758549.040784:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838016 00000100:00100000:0.0:1782758549.040794:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838016 00000100:00100000:0.0:1782758549.040888:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1129 00000100:00100000:0.0:1782758549.040899:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57475:x1869355196838016:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758549.040925:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758549.040946:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbb55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dd2 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041023:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041039:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041050:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041066:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041073:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041080:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041513:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041522:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041530:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758549.041626:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1782758549.041631:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758549.041710:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041723:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041729:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041736:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041741:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758549.041746:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041754:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041768:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:0.0:1782758549.041771:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758549.041775:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041781:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dbb5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041793:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041799:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041805:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041809:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758549.041812:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041817:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041858:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758549.041861:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758549.041864:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041870:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbb63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041906:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbb55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd2 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041920:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd2 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758549.041928:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782758549.041930:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758549.041932:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782758549.042188:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57475:x1869355196838016:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1109us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758549.042199:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1129 00000100:00100000:0.0:1782758549.046998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758549.047093:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838272 00000100:00100000:3.0:1782758549.047102:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838272 00000100:00100000:3.0:1782758549.047159:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1130 00000100:00100000:3.0:1782758549.047168:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57475:x1869355196838272:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758549.047187:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758549.047206:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbb71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dd9 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048052:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048069:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048081:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048096:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048103:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.048112:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782758549.049406:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:3.0:1782758549.050044:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbb86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050060:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050071:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050108:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050115:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050122:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050128:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758549.050133:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050140:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050152:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:3.0:1782758549.050155:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758549.050160:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050165:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbb78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758549.050176:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000595fe358 reply state 000000007b01380f transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758549.050185:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758549.050217:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbb71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd9 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050230:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbb86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd9 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.050236:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff917191f75f00) 00010000:00010000:3.0:1782758549.050238:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758549.050240:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690c00, rc 0) 00000100:00100000:3.0:1782758549.050502:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57475:x1869355196838272:12345-192.168.204.31@tcp:101:touch.0 Request processed in 3334us (3514us total) trans 4294967733 rc 0/0 00000100:00100000:3.0:1782758549.050511:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1130 00010000:00010000:2.0:1782758549.054586:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.054605:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.054613:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.054976:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758549.054981:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.054989:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.055006:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917191f75d00) 00010000:00010000:2.0:1782758549.055009:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758549.055014:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.055020:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbb7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758549.055162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758549.055212:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838528 00000100:00100000:1.0:1782758549.055222:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838528 00000100:00100000:1.0:1782758549.055287:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1131 00000100:00100000:1.0:1782758549.055298:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57475:x1869355196838528:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782758549.055365:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758549.055386:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbb86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd9 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.055403:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff917191f75f00) 00010000:00010000:1.0:1782758549.055410:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758549.055448:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.055461:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.055471:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758549.055596:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fe17bd7 reply state 000000001fe28aed transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758549.055607:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758549.055754:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57475:x1869355196838528:12345-192.168.204.31@tcp:36:touch.0 Request processed in 457us (594us total) trans 4294967734 rc 0/0 00000100:00100000:1.0:1782758549.055762:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1131 00010000:00010000:3.0:1782758549.059394:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059412:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059420:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059430:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758549.059435:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059455:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059480:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3ad00) 00010000:00010000:3.0:1782758549.059483:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758549.059488:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.059494:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbb94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758549.060032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758549.060899:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838656 00000100:00100000:1.0:1782758549.060910:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838656 00000100:00100000:1.0:1782758549.061050:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1132 00000100:00100000:1.0:1782758549.061062:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57475:x1869355196838656:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758549.061088:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758549.061109:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbb9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64de0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.061170:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbb9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de0 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.061203:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbb9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de0 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.061224:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758549.061228:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758549.061230:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782758549.063167:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57475:x1869355196838656:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2094us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758549.063180:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1132 00000100:00100000:2.0:1782758549.068982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758549.070163:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838784 00000100:00100000:3.0:1782758549.070175:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838784 00000100:00100000:3.0:1782758549.070224:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 622 00000100:00100000:3.0:1782758549.070232:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196838784:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:3.0:1782758549.070264:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp t0 exp 0000000000000000 cur 2617 last 0 00000020:00000080:3.0:1782758549.070293:0:9120:0:(genops.c:1406:class_connect()) connect: client 7285eadf-a700-4e2b-8948-9c4e88301f08, cookie 0xdd99f5c4777dbba2 00002000:00100000:3.0:1782758549.070304:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7285eadf-a700-4e2b-8948-9c4e88301f08/ffff917186a5c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758549.070326:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758549.070558:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782758549.070591:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917186a5e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758549.070670:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196838784:12345-192.168.204.31@tcp:8:touch.0 Request processed in 436us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758549.070681:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 622 00000100:00100000:0.0:1782758549.076639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758549.077015:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196838912 00000100:00100000:1.0:1782758549.077025:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196838912 00000100:00100000:1.0:1782758549.077107:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 623 00000100:00100000:1.0:1782758549.077119:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:0:x1869355196838912:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:2.0:1782758549.077208:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782758549.120181:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000001:00100000:1.0:1782758549.120200:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000100:00100000:3.0:1782758549.120457:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:0:x1869355196838912:12345-192.168.204.31@tcp:2:touch.0 Request processed in 43334us (43820us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1782758549.120470:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 623 00000100:00100000:0.0:1782758549.126988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758549.127212:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839168 00000100:00100000:3.0:1782758549.127221:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839168 00000100:00100000:3.0:1782758549.127290:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:3.0:1782758549.127300:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57475:x1869355196839168:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782758549.127609:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57475:x1869355196839168:12345-192.168.204.31@tcp:35:touch.0 Request processed in 309us (629us total) trans 4294967735 rc 0/0 00000100:00100000:3.0:1782758549.127617:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:0.0:1782758549.175680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758549.176027:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839296 00000100:00100000:3.0:1782758549.176036:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839296 00000100:00100000:3.0:1782758549.176101:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1133 00000100:00100000:3.0:1782758549.176112:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57479:x1869355196839296:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758549.176136:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758549.176156:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64de7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176215:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176229:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176240:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176258:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176266:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176282:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176380:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176389:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.176396:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758549.176427:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5d:0x0]: returning size 0 00000004:00200000:3.0:1782758549.176431:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758549.177208:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177223:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177234:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177242:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177249:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177255:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758549.177259:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177266:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177342:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:2.0:1782758549.177345:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758549.177351:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177358:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbbb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177371:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177378:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177383:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177389:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758549.177392:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177399:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177405:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917191f75100) 00010000:00010000:2.0:1782758549.177407:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758549.177410:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177415:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbbb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177569:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de7 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177584:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de7 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.177591:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:2.0:1782758549.177593:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758549.177595:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:2.0:1782758549.177706:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57479:x1869355196839296:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1595us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758549.177714:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1133 00000100:00100000:0.0:1782758549.188216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758549.188315:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839424 00000100:00100000:3.0:1782758549.188325:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839424 00000100:00100000:3.0:1782758549.188431:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 624 00000100:00100000:3.0:1782758549.188441:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196839424:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758549.188460:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758549.188479:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dee expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758549.188505:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x6a42bc94, atime: 0x6a42bc94, ctime: 0x6a42bc94, blocks: 0x1 00010000:00010000:3.0:1782758549.188524:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2617s v=(0 0) 00010000:00010000:3.0:1782758549.188528:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758549.188537:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.188555:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.188568:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782758549.188632:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196839424:12345-192.168.204.31@tcp:101:rm.0 Request processed in 191us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758549.188639:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 624 00000100:00100000:0.0:1782758549.192489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758549.192597:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839680 00000100:00100000:1.0:1782758549.192609:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839680 00000100:00100000:1.0:1782758549.192671:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1134 00000100:00100000:1.0:1782758549.192681:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57479:x1869355196839680:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:1.0:1782758549.192737:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758549.192773:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbbbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de7 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.192804:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbb9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64de0 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.192873:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758549.192893:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758549.192915:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193049:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193060:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193083:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193092:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193097:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193205:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193441:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.193449:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782758549.194807:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:1.0:1782758549.195102:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2617598278013ns, next at 2618598274423ns, rc = 0 00010000:00010000:1.0:1782758549.195173:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195186:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195196:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195205:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195213:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195218:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195248:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758549.195288:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195295:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195300:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195306:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758549.195310:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195317:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195329:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:1.0:1782758549.195332:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758549.195336:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195343:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbbda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195360:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195367:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195373:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195378:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758549.195381:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195386:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195393:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:1.0:1782758549.195396:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758549.195399:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758549.195404:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbbcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758549.195419:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000bc9dac8 reply state 00000000b3ebe9a9 transno 4294967736 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758549.195428:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758549.195516:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57479:x1869355196839680:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2832us (3032us total) trans 4294967736 rc 0/0 00000100:00100000:1.0:1782758549.195525:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1134 00010000:00010000:3.0:1782758549.197372:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758549.197384:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.197395:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758549.197399:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.197409:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.197505:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9171a0e3a700) 00010000:00010000:3.0:1782758549.197509:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758549.197513:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.197520:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbbe1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758549.197548:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758549.197550:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758549.197552:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758549.198621:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198635:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198644:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198649:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758549.198654:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198662:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198674:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9171a0e3a900) 00010000:00010000:2.0:1782758549.198676:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758549.198679:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758549.198684:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbbd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758549.684870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758549.684969:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839808 00000100:00100000:2.0:1782758549.684978:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839808 00000100:00100000:2.0:1782758549.685038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1430 00000100:00100000:2.0:1782758549.685049:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196839808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758549.685134:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196839808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758549.685142:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1430 00010000:00010000:0.0:1782758550.060278:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758550.113179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758550.119181:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196839936 00000100:00100000:1.0:1782758550.119197:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196839936 00000100:00100000:0.0:1782758550.119370:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1135 00000100:00100000:0.0:1782758550.119382:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57492:x1869355196839936:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758550.119406:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758550.119426:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbbe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64df5 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119489:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119514:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119524:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758550.119596:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1782758550.119600:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758550.119628:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119662:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbbe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64df5 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119690:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64df5 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.119700:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782758550.119703:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758550.119707:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758550.119777:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57492:x1869355196839936:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 398us (6610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.119793:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1135 00000100:00080000:1.0:1782758550.120996:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758550.135394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.135474:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840192 00000100:00100000:2.0:1782758550.135485:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840192 00000100:00100000:2.0:1782758550.135558:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1136 00000100:00100000:2.0:1782758550.135570:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57492:x1869355196840192:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758550.136006:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758550.136036:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dbbef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64df5 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.136056:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbb6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dd2 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.136067:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:2.0:1782758550.136078:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758550.136104:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.136117:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.136125:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758550.136367:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001782c6eb reply state 000000005a9f140a transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758550.136378:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758550.136390:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:2.0:1782758550.136474:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57492:x1869355196840192:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 906us (1089us total) trans 4294967737 rc 0/0 00000100:00100000:2.0:1782758550.136483:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1136 00010000:00010000:3.0:1782758550.145610:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.145638:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.145647:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.145653:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758550.145658:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.145666:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.146096:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782758550.146100:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758550.146106:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.146113:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbbf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758550.363923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.364057:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840320 00000100:00100000:3.0:1782758550.364069:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840320 00000100:00100000:3.0:1782758550.364147:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1137 00000100:00100000:3.0:1782758550.364160:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840320:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758550.364293:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840320:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.364302:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1137 00000100:00100000:0.0:1782758550.368372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.368690:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840448 00000100:00100000:3.0:1782758550.368701:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840448 00000100:00100000:3.0:1782758550.368780:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 625 00000100:00100000:3.0:1782758550.368793:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57506:x1869355196840448:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782758550.368954:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758550.369710:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57506:x1869355196840448:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 916us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.369719:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 625 00000100:00100000:2.0:1782758550.384630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.385642:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840576 00000100:00100000:3.0:1782758550.385654:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840576 00000100:00100000:3.0:1782758550.385759:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:3.0:1782758550.385771:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57506:x1869355196840576:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758550.386213:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57506:x1869355196840576:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 443us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.386221:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:1.0:1782758550.390538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758550.390759:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840704 00000100:00100000:0.0:1782758550.390770:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840704 00000100:00100000:0.0:1782758550.390948:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1138 00000100:00100000:0.0:1782758550.390960:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840704:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758550.392127:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840704:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 1163us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.392138:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1138 00000100:00100000:0.0:1782758550.399011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.399124:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840832 00000100:00100000:2.0:1782758550.399135:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840832 00000100:00100000:2.0:1782758550.399195:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1139 00000100:00100000:2.0:1782758550.399206:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840832:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758550.399322:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196840832:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758550.399330:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1139 00000100:00100000:3.0:1782758550.401933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758550.402174:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196840960 00000100:00100000:0.0:1782758550.402183:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196840960 00000100:00100000:0.0:1782758550.402493:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 627 00000100:00100000:0.0:1782758550.402506:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57506:x1869355196840960:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758550.402946:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57506:x1869355196840960:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 431us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.402954:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 627 00000100:00100000:0.0:1782758550.406280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.406743:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841088 00000100:00100000:2.0:1782758550.406754:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841088 00000100:00100000:2.0:1782758550.406983:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 628 00000100:00100000:2.0:1782758550.406995:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57506:x1869355196841088:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758550.407728:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57506:x1869355196841088:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 733us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758550.407737:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 628 00000100:00100000:1.0:1782758550.413665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.413762:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841216 00000100:00100000:3.0:1782758550.413773:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841216 00000100:00100000:0.0:1782758550.413966:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1140 00000100:00100000:0.0:1782758550.413982:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196841216:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758550.414753:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57506:x1869355196841216:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 772us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.414763:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1140 00000100:00100000:1.0:1782758550.450544:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211692160:0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.450631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758550.450692:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782758550.450698:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211692032:0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.450721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758550.450738:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211692544:0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.450761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758550.450789:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692160 00000100:00100000:1.0:1782758550.450797:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692160 00000100:00100000:1.0:1782758550.450887:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692032 00000100:00100000:1.0:1782758550.450890:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692032 00000100:00100000:1.0:1782758550.450910:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:1.0:1782758550.450919:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211692160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.450983:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211692160:12345-0@lo:400:kworker.0 Request processed in 64us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758550.450990:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:1.0:1782758550.451020:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:1.0:1782758550.451026:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211692032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.451051:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211692032:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758550.451057:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00080000:1.0:1782758550.451074:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758550.451104:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211692032:0@lo:400:kworker.0 00000100:00100000:1.0:1782758550.451113:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211692160:0@lo:400:kworker.0 00000100:00100000:2.0:1782758550.452079:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211691904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758550.452134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758550.452165:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211692416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758550.452345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758550.452372:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758550.452379:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211692288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758550.452404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758550.452433:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692416 00000100:00100000:2.0:1782758550.452438:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692416 00000100:00100000:2.0:1782758550.452478:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1782758550.452497:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211692416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758550.452549:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211692416:12345-0@lo:400:kworker.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758550.452555:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1782758550.452603:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211692416:0@lo:400:kworker.0 00000100:00100000:3.0:1782758550.452974:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692544 00000100:00100000:3.0:1782758550.452979:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692544 00000100:00100000:3.0:1782758550.453018:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692288 00000100:00100000:3.0:1782758550.453021:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692288 00000100:00100000:3.0:1782758550.453042:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1782758550.453048:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758550.453093:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211692544:12345-0@lo:400:kworker.0 Request processed in 45us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.453099:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1782758550.453111:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1782758550.453117:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211692288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758550.453146:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211692288:12345-0@lo:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.453152:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1782758550.453176:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211692288:0@lo:400:kworker.0 00000100:00100000:3.0:1782758550.453201:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211692544:0@lo:400:kworker.0 00000100:00100000:0.0:1782758550.453611:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211691904 00000100:00100000:0.0:1782758550.453617:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211691904 00000100:00100000:0.0:1782758550.453656:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1782758550.453663:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211691904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758550.453710:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211691904:12345-0@lo:400:kworker.0 Request processed in 47us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.453717:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1782758550.453901:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211691904:0@lo:400:kworker.0 00000100:00080000:1.0:1782758550.455065:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758550.455073:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758550.455077:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758550.511375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758550.511666:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841344 00000100:00100000:1.0:1782758550.511676:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841344 00000100:00100000:1.0:1782758550.511740:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1141 00000100:00100000:1.0:1782758550.511750:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57510:x1869355196841344:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758550.511771:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758550.511790:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbbfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64dfc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512159:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512174:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512188:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512203:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512210:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.512216:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.514767:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.514789:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.514801:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758550.515713:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:1.0:1782758550.515720:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758550.515766:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.515781:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.515788:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.515799:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.515805:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758550.515809:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.515817:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.516787:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:1.0:1782758550.516791:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758550.516798:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.516805:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbc04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517505:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517516:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517523:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517529:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758550.517533:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517545:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517556:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758550.517559:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758550.517563:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517569:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbc0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517640:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbbfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dfc expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517655:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dfc expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.517663:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758550.517665:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758550.517668:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758550.517758:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57510:x1869355196841344:12345-192.168.204.31@tcp:101:dd.0 Request processed in 6009us (6391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758550.517768:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1141 00000100:00100000:1.0:1782758550.523644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.523775:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841600 00000100:00100000:2.0:1782758550.523786:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841600 00000100:00100000:2.0:1782758550.523884:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1142 00000100:00100000:2.0:1782758550.523895:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57510:x1869355196841600:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1782758550.523916:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758550.523945:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbc19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e03 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524075:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524090:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524101:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524116:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524124:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.524131:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758550.527164:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:2.0:1782758550.530176:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbc2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530198:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530209:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530907:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530918:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530926:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530943:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758550.530947:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530956:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530971:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:2.0:1782758550.530974:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758550.530979:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.530985:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758550.531006:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090bf7e39 reply state 00000000a50ca85f transno 4294967738 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758550.531014:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758550.531051:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbc19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e03 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.531066:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbc2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e03 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.531073:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:2.0:1782758550.531075:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758550.531078:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758550.531160:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+15:57510:x1869355196841600:12345-192.168.204.31@tcp:101:dd.0 Request processed in 7267us (7524us total) trans 4294967738 rc 0/0 00000100:00100000:2.0:1782758550.531169:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1142 00010000:00010000:3.0:1782758550.534235:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534329:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534337:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534343:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758550.534349:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534357:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534378:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917182dd1c00) 00010000:00010000:3.0:1782758550.534382:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758550.534387:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.534393:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbc27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758550.545076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.545170:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841728 00000100:00100000:3.0:1782758550.545179:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841728 00000100:00100000:3.0:1782758550.545282:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:3.0:1782758550.545292:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57510:x1869355196841728:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782758550.545310:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758550.545332:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e0a expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758550.545359:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782758550.545382:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=2618s v=(0 0) 00010000:00010000:3.0:1782758550.545387:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758550.545397:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.545416:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.545429:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758550.545493:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57510:x1869355196841728:12345-192.168.204.31@tcp:101:dd.0 Request processed in 202us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758550.545501:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:2.0:1782758550.612818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758550.619688:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841856 00000100:00100000:1.0:1782758550.619703:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841856 00002000:00100000:1.0:1782758550.620221:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff91708182ad80 x1869355196841856/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:466/0 lens 488/0 e 0 to 0 dl 1782758561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782758550.620234:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91708182ad80 with x1869355196841856 ext(0->1048575) 00002000:00010000:1.0:1782758550.620347:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91708182ad80 00000100:00100000:1.0:1782758550.620435:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:1.0:1782758550.620447:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196841856:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:1.0:1782758550.651691:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196841856:12345-192.168.204.31@tcp:4:dd.0 Request processed in 31235us (38870us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1782758550.651706:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00002000:00100000:1.0:1782758550.651720:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff91708182ad80 x1869355196841856/t4294967368(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:466/0 lens 488/448 e 0 to 0 dl 1782758561 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782758550.651731:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91708182ad80 with x1869355196841856 ext(0->1048575) 00002000:00010000:1.0:1782758550.652141:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91708182ad80 00000100:00100000:0.0:1782758550.655724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758550.656000:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196841984 00000100:00100000:1.0:1782758550.656010:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196841984 00000100:00100000:1.0:1782758550.656070:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1143 00000100:00100000:1.0:1782758550.656080:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+14:57510:x1869355196841984:12345-192.168.204.31@tcp:44:dd.0 00000001:00080000:2.0:1782758550.721201:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967736 is committed 00000004:00080000:2.0:1782758550.721215:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000001:00080000:2.0:1782758550.721233:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967738 is committed 00000100:00100000:0.0:1782758550.721434:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57510:x1869355196841984:12345-192.168.204.31@tcp:44:dd.0 Request processed in 65348us (65714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758550.721445:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1143 00000100:00100000:2.0:1782758550.723087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211692672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758550.723152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758550.724067:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692672 00000100:00100000:3.0:1782758550.724077:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692672 00000100:00100000:3.0:1782758550.724130:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1782758550.724140:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211692672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782758550.724174:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:3.0:1782758550.724197:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.724221:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.724231:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782758550.724236:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758550.724241:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.724285:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 5 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758550.724354:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 5 pid: 9120 timeout: 2719 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758550.724368:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211692800:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758550.724442:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758550.729163:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.729444:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9120:1869355211692800:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758550.729476:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758550.729674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758550.729801:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842240 00000100:00100000:2.0:1782758550.729808:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842240 00010000:00010000:2.0:1782758550.729942:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 2719 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758550.729972:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 449 00000100:00100000:2.0:1782758550.729982:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196842240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758550.729999:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758550.730004:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 2719 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.730016:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 2719 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.730045:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000001d8008/0xdd99f5c4777dbbc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dee expref: 6 pid: 9120 timeout: 2719 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.730062:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758550.730067:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758550.730072:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.730083:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758550.730121:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758550.730173:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196842240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 192us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758550.730181:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 449 00010000:00010000:1.0:1782758550.730455:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.730465:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.730476:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.730498:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758550.730523:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758550.731360:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211692672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7219us (8205us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1782758550.731370:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1782758550.731392:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842112 00000100:00100000:1.0:1782758550.731398:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842112 00000100:00100000:1.0:1782758550.731429:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 631 00000100:00100000:1.0:1782758550.731437:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196842112:12345-192.168.204.31@tcp:16:dd.0 00000004:00080000:1.0:1782758550.731647:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084c6e300/2, rc 0, transno 4294967367 00000100:00100000:1.0:1782758550.731655:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211692672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782758550.731984:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758550.731991:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.732003:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758550.732007:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.732019:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.732036:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.732044:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c318e6ea/0xdd99f5c4777dbc43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758550.732069:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758550.732071:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758550.732073:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758550.771612:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000001:00080000:0.0:1782758550.771634:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000100:00100000:1.0:1782758550.771872:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196842112:12345-192.168.204.31@tcp:16:dd.0 Request processed in 40430us (42713us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758550.771885:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 631 00000100:00100000:0.0:1782758550.774883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758550.775019:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842496 00000100:00100000:3.0:1782758550.775031:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842496 00000100:00100000:3.0:1782758550.775093:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:3.0:1782758550.775104:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57510:x1869355196842496:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:0.0:1782758550.778457:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57510:x1869355196842496:12345-192.168.204.31@tcp:35:dd.0 Request processed in 3280us (3509us total) trans 4294967739 rc 0/0 00000100:00100000:0.0:1782758550.778596:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:1.0:1782758550.962938:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211692928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758550.963011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758550.963210:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211692928 00000100:00100000:2.0:1782758550.963220:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211692928 00000100:00100000:2.0:1782758550.963282:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1782758550.963294:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211692928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758550.963331:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758550.963387:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211692928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758550.963394:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1782758550.963553:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211692928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758551.084199:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758552.110291:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758552.151848:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967739 is committed 00010000:00010000:0.0:1782758553.132000:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758553.517527:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758553.517551:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758553.517621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758553.517705:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693056 00000100:00100000:0.0:1782758553.517713:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693056 00000100:00100000:0.0:1782758553.517767:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1782758553.517777:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758553.517814:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758553.517888:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758553.517896:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:0.0:1782758553.517918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758553.517946:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1782758553.517952:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084c6c000, transno 4294967367 00000100:00100000:0.0:1782758553.517969:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693056:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782758553.624430:0:98516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2622027604061ns, next at 2617521794621ns, rc = 0 00000004:00080000:0.0:1782758553.624669:0:98516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2622027845821ns, next at 2618598274423ns, rc = 0 00000004:00080000:3.0:1782758553.653860:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000004:00080000:3.0:1782758553.653890:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00010000:00010000:3.0:1782758554.165523:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782758554.669556:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000100:00100000:2.0:1782758554.808738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758554.808848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758554.808890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758554.808913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758554.808942:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843008 00000100:00100000:2.0:1782758554.808950:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843008 00000100:00100000:2.0:1782758554.809008:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842880 00000100:00100000:2.0:1782758554.809011:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842880 00000100:00100000:2.0:1782758554.809036:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1457 00000100:00100000:2.0:1782758554.809047:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196843008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758554.809120:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196843008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758554.809132:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1457 00000100:00100000:2.0:1782758554.809149:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1458 00000100:00100000:2.0:1782758554.809155:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196842880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758554.809369:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196842880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 213us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758554.809376:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1458 00000100:00080000:2.0:1782758554.809395:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758554.809398:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758554.812765:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842624 00000100:00100000:2.0:1782758554.812780:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842624 00000100:00100000:2.0:1782758554.812886:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00100000:2.0:1782758554.812897:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196842624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758554.812972:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196842624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758554.812979:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1432 00000100:00100000:3.0:1782758554.816860:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196842752 00000100:00100000:3.0:1782758554.816876:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196842752 00000100:00100000:3.0:1782758554.816948:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1881 00000100:00100000:3.0:1782758554.816958:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196842752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758554.817041:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196842752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (8315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758554.817049:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1881 00000100:00080000:0.0:1782758554.818371:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758555.181552:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758555.318145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758555.318257:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843136 00000100:00100000:1.0:1782758555.318266:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843136 00000100:00100000:1.0:1782758555.318328:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1144 00000100:00100000:1.0:1782758555.318339:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196843136:12345-192.168.204.31@tcp:17:kworker.0 00000100:00100000:1.0:1782758555.318441:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196843136:12345-192.168.204.31@tcp:17:kworker.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.318448:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1144 00000100:00100000:1.0:1782758555.564451:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211693440:0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.564527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758555.564581:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758555.564587:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693568:0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.564613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758555.564650:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693440 00000100:00100000:1.0:1782758555.564658:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693440 00000100:00100000:1.0:1782758555.564720:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1782758555.564730:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211693440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.564784:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211693440:12345-0@lo:400:kworker.0 Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.564804:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1782758555.564865:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693568 00000100:00100000:1.0:1782758555.564870:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693568 00000100:00100000:1.0:1782758555.564903:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1782758555.564909:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.564938:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693568:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.564944:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00080000:1.0:1782758555.564960:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758555.564966:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758555.564999:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693568:0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.565010:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211693440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565102:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211693184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758555.565188:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211693696:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758555.565235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758555.565241:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211693312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758555.565281:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211693824:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758555.565333:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693696 00000100:00100000:0.0:1782758555.565337:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693696 00000100:00100000:0.0:1782758555.565366:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693312 00000100:00100000:0.0:1782758555.565369:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693312 00000100:00100000:0.0:1782758555.565387:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1782758555.565393:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211693696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565428:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211693696:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758555.565434:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1782758555.565448:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:0.0:1782758555.565454:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211693312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565481:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211693312:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758555.565489:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:0.0:1782758555.565508:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693824 00000100:00100000:0.0:1782758555.565512:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693824 00000100:00100000:0.0:1782758555.565536:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:0.0:1782758555.565542:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211693824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565572:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211693824:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758555.565578:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:0.0:1782758555.565602:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211693312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565611:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1782758555.565616:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084c6e300, transno 4294967367 00000100:00100000:0.0:1782758555.565624:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211693824:0@lo:400:kworker.0 00000100:00100000:0.0:1782758555.565634:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211693696:0@lo:400:kworker.0 00000100:00080000:0.0:1782758555.565657:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758555.565660:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758555.565911:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693184 00000100:00100000:1.0:1782758555.565916:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693184 00000100:00100000:1.0:1782758555.565949:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1782758555.565955:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211693184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758555.565996:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211693184:12345-0@lo:400:kworker.0 Request processed in 41us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.566003:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1782758555.566041:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211693184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758555.737025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758555.737142:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843264 00000100:00100000:1.0:1782758555.737153:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843264 00000100:00100000:1.0:1782758555.737881:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1145 00000100:00100000:1.0:1782758555.737893:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843264:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758555.737986:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843264:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 95us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.737994:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1145 00000100:00100000:3.0:1782758555.746333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758555.746367:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843392 00000100:00100000:3.0:1782758555.746377:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843392 00000100:00100000:3.0:1782758555.746424:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 632 00000100:00100000:3.0:1782758555.746432:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57702:x1869355196843392:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758555.746810:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57702:x1869355196843392:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 376us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758555.746851:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 632 00000100:00100000:3.0:1782758555.754278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758555.754675:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843520 00000100:00100000:2.0:1782758555.754686:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843520 00000100:00100000:2.0:1782758555.754780:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:2.0:1782758555.754791:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57702:x1869355196843520:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758555.755383:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57702:x1869355196843520:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 591us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758555.755393:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:3.0:1782758555.758139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758555.758310:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843648 00000100:00100000:1.0:1782758555.758323:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843648 00000100:00100000:1.0:1782758555.758384:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1146 00000100:00100000:1.0:1782758555.758395:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843648:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758555.758882:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843648:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 486us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.758891:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1146 00000100:00100000:1.0:1782758555.762470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758555.763138:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843776 00000100:00100000:3.0:1782758555.763269:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843776 00000100:00100000:3.0:1782758555.763335:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00100000:3.0:1782758555.763347:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843776:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758555.763483:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196843776:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 139us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758555.763492:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1147 00000100:00100000:3.0:1782758555.767084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758555.767186:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196843904 00000100:00100000:1.0:1782758555.767198:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196843904 00000100:00100000:1.0:1782758555.767256:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 634 00000100:00100000:1.0:1782758555.767267:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57702:x1869355196843904:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758555.767634:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57702:x1869355196843904:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 367us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.767642:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 634 00000100:00100000:1.0:1782758555.769606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758555.769679:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844032 00000100:00100000:0.0:1782758555.769687:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844032 00000100:00100000:0.0:1782758555.769740:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 635 00000100:00100000:0.0:1782758555.769749:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57702:x1869355196844032:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758555.770129:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57702:x1869355196844032:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 379us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758555.770137:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 635 00000100:00100000:0.0:1782758555.776075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758555.776167:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844160 00000100:00100000:1.0:1782758555.776177:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844160 00000100:00100000:1.0:1782758555.776235:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1148 00000100:00100000:1.0:1782758555.776245:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196844160:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758555.776702:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57702:x1869355196844160:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 457us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758555.776711:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1148 00000100:00100000:3.0:1782758555.887700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758555.887732:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844416 00000100:00100000:3.0:1782758555.887741:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844416 00000100:00100000:3.0:1782758555.887789:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1149 00000100:00100000:3.0:1782758555.887797:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57706:x1869355196844416:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758555.887872:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758555.887900:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbc2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e03 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895099:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:3.0:1782758555.895120:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758555.895222:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895242:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895255:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895272:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895279:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895286:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895628:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895638:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.895645:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758555.903710:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:3.0:1782758555.903726:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2624306902059ns, next at 2625306899033ns, rc = 0 00010000:00010000:3.0:1782758555.903879:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.903897:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.903908:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.903921:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.903927:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.903933:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905381:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758555.905423:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905435:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905442:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905448:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758555.905453:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905461:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905477:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782758555.905480:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758555.905485:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905496:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905515:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905522:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905527:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905532:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758555.905534:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905540:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905548:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758555.905550:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758555.905553:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758555.905559:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758555.905569:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000345f6fd0 reply state 00000000de082a5b transno 4294967740 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758555.905579:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758555.905680:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57706:x1869355196844416:12345-192.168.204.31@tcp:36:rm.0 Request processed in 17879us (17985us total) trans 4294967740 rc 0/0 00000100:00100000:3.0:1782758555.905689:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1149 00010000:00010000:0.0:1782758555.906275:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758555.906282:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.906290:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758555.906294:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.906302:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.906312:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff917191f75400) 00010000:00010000:0.0:1782758555.906314:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782758555.906318:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.906324:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dbc5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.906346:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758555.906348:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758555.906350:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758555.913065:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913087:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913095:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913100:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758555.913105:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913116:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913134:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917191f75600) 00010000:00010000:0.0:1782758555.913137:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758555.913142:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758555.913158:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbc51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758556.076694:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758556.076776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758556.076938:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211693952 00000100:00100000:0.0:1782758556.076947:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211693952 00000100:00100000:0.0:1782758556.077010:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1782758556.077020:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758556.077070:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758556.081584:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211693952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4555us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758556.081600:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1782758556.089783:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211693952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758556.205676:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758557.229266:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758558.254080:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758558.536484:0:98662:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2626939658035ns, next at 2625306899033ns, rc = 0 00000004:00080000:2.0:1782758558.637385:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2627040559327ns, next at 2628040557083ns, rc = 0 00000100:00100000:2.0:1782758558.637406:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758558.637428:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211694080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758558.637500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758558.638150:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694080 00000100:00100000:0.0:1782758558.638160:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694080 00000100:00100000:0.0:1782758558.638233:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1782758558.638244:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211694080:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758558.638335:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782758558.638805:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758558.639577:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211694080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1332us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758558.639590:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1782758558.640793:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211694080:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782758558.673656:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000001:00080000:3.0:1782758558.673690:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967740 is committed 00000004:00080000:3.0:1782758558.673695:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000100:00100000:3.0:1782758558.674212:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758558.674235:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211694208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758558.674309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758558.674670:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694208 00000100:00100000:0.0:1782758558.674679:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694208 00000100:00100000:0.0:1782758558.674733:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1782758558.674742:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211694208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782758558.674786:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:36 count 1 00010000:00010000:0.0:1782758558.674812:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758558.674872:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 5 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758558.674881:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x24:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1782758558.674885:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758558.674890:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758558.674934:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 5 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758558.674947:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 5 pid: 6599 timeout: 2727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758558.674959:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1869355211694336:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758558.675020:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758558.681050:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1869355211694336:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758558.681087:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758558.682604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758558.682767:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844544 00000100:00100000:0.0:1782758558.682787:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844544 00010000:00010000:0.0:1782758558.682879:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 2727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782758558.682972:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758558.685097:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 450 00000100:00100000:1.0:1782758558.685123:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196844544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758558.685143:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758558.685153:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 2727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758558.685170:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 2727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758558.685195:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c70fd3c/0xdd99f5c4777dbc3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e0a expref: 6 pid: 6599 timeout: 2727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758558.685212:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758558.685216:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758558.685223:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758558.685232:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758558.685277:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758558.685347:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196844544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 235us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758558.685356:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 450 00010000:00010000:2.0:1782758558.685485:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758558.685494:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758558.685505:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758558.685512:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758558.685533:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782758558.686259:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211694208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11514us (11947us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1782758558.686267:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000004:00080000:3.0:1782758558.690567:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082d63480/2, rc 0, transno 4294967369 00000100:00100000:3.0:1782758558.690600:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211694208:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782758558.690630:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758558.690639:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758558.690652:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758558.690656:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758558.690668:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758558.690689:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758558.690701:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc02469/0xdd99f5c4777dbc66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758558.690889:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758558.690892:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758558.690894:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758558.691354:0:98662:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2627094529984ns, next at 2618598274423ns, rc = 0 00000004:00080000:1.0:1782758558.712518:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000004:00080000:1.0:1782758558.712540:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00010000:00010000:0.0:1782758559.276387:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758559.926026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758559.926083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758559.926107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758559.926126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758559.926149:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844928 00000100:00100000:1.0:1782758559.926157:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844928 00000100:00100000:1.0:1782758559.926200:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845056 00000100:00100000:1.0:1782758559.926203:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845056 00000100:00100000:1.0:1782758559.926236:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1461 00000100:00100000:1.0:1782758559.926245:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196844928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758559.926313:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196844928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758559.926324:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1461 00000100:00100000:1.0:1782758559.926345:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1462 00000100:00100000:1.0:1782758559.926351:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758559.926374:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758559.926380:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1462 00000100:00100000:1.0:1782758559.926398:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844800 00000100:00100000:1.0:1782758559.926401:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844800 00000100:00100000:1.0:1782758559.926427:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1885 00000100:00100000:1.0:1782758559.926433:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196844800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758559.926462:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196844800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758559.926469:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1885 00000100:00080000:1.0:1782758559.926504:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758559.926509:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758559.928216:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196844672 00000100:00100000:3.0:1782758559.928227:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196844672 00000100:00100000:3.0:1782758559.928367:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1434 00000100:00100000:3.0:1782758559.928377:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196844672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758559.928445:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196844672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758559.928453:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1434 00010000:00010000:3.0:1782758560.300525:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758560.684220:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211694592:0@lo:400:kworker.0 00000100:00100000:1.0:1782758560.684243:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211694848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758560.684306:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211694464:0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.686006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758560.686066:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694592 00000100:00100000:2.0:1782758560.686075:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694592 00000100:00100000:2.0:1782758560.686123:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1782758560.686133:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211694592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.686189:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211694592:12345-0@lo:400:kworker.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758560.686196:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1782758560.686255:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211694592:0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.686265:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211695104:0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.686294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758560.686325:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758560.686331:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211694720:0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.688147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758560.688264:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694720 00000100:00100000:2.0:1782758560.688272:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694720 00000100:00100000:2.0:1782758560.688327:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:2.0:1782758560.688336:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211694720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.688395:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211694720:12345-0@lo:400:kworker.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758560.688402:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00080000:2.0:1782758560.688420:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758560.688445:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211694720:0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.688491:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695104 00000100:00100000:2.0:1782758560.688495:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695104 00000100:00100000:2.0:1782758560.688527:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1782758560.688533:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211695104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.688570:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211695104:12345-0@lo:400:kworker.0 Request processed in 37us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758560.688576:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00080000:2.0:1782758560.688592:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758560.688608:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211695104:0@lo:400:kworker.0 00000100:00100000:1.0:1782758560.691963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758560.692374:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694848 00000100:00100000:2.0:1782758560.692384:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694848 00000100:00100000:2.0:1782758560.692443:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1782758560.692453:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211694848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758560.692529:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211694848:12345-0@lo:400:kworker.0 Request processed in 78us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758560.692536:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00080000:2.0:1782758560.692577:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758560.693894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758560.693950:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211694976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758560.693990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758560.694034:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694464 00000100:00100000:3.0:1782758560.694041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694464 00000100:00100000:3.0:1782758560.694079:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1782758560.694087:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211694464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758560.694132:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211694464:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758560.694143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1782758560.694365:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211694976 00000100:00100000:3.0:1782758560.694370:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211694976 00000100:00100000:3.0:1782758560.694404:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1782758560.694410:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211694976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758560.694443:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211694976:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758560.694449:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00080000:3.0:1782758560.694624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758560.694655:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211694464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758560.694668:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211694976:0@lo:400:kworker.0 00000100:00100000:0.0:1782758560.697855:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211694848:0@lo:400:kworker.0 00000001:00080000:0.0:1782758560.791407:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000100:00100000:2.0:1782758561.197996:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211695232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758561.198085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758561.198116:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695232 00000100:00100000:0.0:1782758561.198125:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695232 00000100:00100000:0.0:1782758561.198182:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1782758561.198193:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211695232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758561.198245:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758561.198311:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211695232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758561.198317:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1782758561.198581:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211695232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758561.328563:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758562.349860:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758563.372107:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758563.758669:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211695360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758563.758755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758563.759009:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695360 00000100:00100000:2.0:1782758563.759017:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695360 00000100:00100000:2.0:1782758563.759079:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1782758563.759090:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211695360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758563.759125:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758563.759178:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211695360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758563.759185:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1782758563.759234:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:2.0:1782758563.759239:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082d63480, transno 4294967369 00000100:00100000:2.0:1782758563.759257:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211695360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758563.759905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758564.407120:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758565.052914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758565.052957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758565.053003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758565.053035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758565.053121:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845440 00000100:00100000:2.0:1782758565.053135:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845440 00000100:00100000:2.0:1782758565.053225:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845568 00000100:00100000:2.0:1782758565.053229:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845568 00000100:00100000:2.0:1782758565.053257:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1465 00000100:00100000:2.0:1782758565.053269:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758565.053379:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 112us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758565.053388:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1465 00000100:00100000:2.0:1782758565.053417:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1466 00000100:00100000:2.0:1782758565.053423:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758565.053446:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758565.053452:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1466 00000100:00100000:2.0:1782758565.053469:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845312 00000100:00100000:2.0:1782758565.053472:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845312 00000100:00100000:2.0:1782758565.053502:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1889 00000100:00100000:2.0:1782758565.053509:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196845312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758565.053537:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196845312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758565.053543:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1889 00000100:00080000:1.0:1782758565.054353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758565.054360:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758565.054363:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758565.054686:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845184 00000100:00100000:3.0:1782758565.054694:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845184 00000100:00100000:3.0:1782758565.054754:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1436 00000100:00100000:3.0:1782758565.054764:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196845184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758565.054858:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196845184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758565.054866:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1436 00010000:00010000:0.0:1782758565.420198:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758565.807091:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211695872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.807173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758565.807260:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758565.807266:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211695488:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.807301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758565.807328:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211696000:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.807355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758565.807391:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211695744:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.807422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758565.807444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782758565.807450:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211695616:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.807721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758565.808035:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695488 00000100:00100000:2.0:1782758565.808043:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695488 00000100:00100000:2.0:1782758565.808097:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1782758565.808108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211695488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758565.808185:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211695488:12345-0@lo:400:kworker.0 Request processed in 72us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758565.808192:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1782758565.808256:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211695488:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.818728:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211696128:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.818810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758565.818876:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695872 00000100:00100000:3.0:1782758565.818883:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695872 00000100:00100000:3.0:1782758565.818936:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696128 00000100:00100000:3.0:1782758565.818939:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696128 00000100:00100000:3.0:1782758565.818959:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1782758565.818967:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211695872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.819021:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211695872:12345-0@lo:400:kworker.0 Request processed in 53us (11849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758565.819029:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1782758565.819046:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:3.0:1782758565.819052:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211696128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.819099:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211696128:12345-0@lo:400:kworker.0 Request processed in 47us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758565.819105:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00080000:3.0:1782758565.819120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758565.819124:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758565.819367:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211695872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758565.819393:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211696128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758565.819609:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696000 00000100:00100000:0.0:1782758565.819614:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696000 00000100:00100000:0.0:1782758565.819666:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695744 00000100:00100000:0.0:1782758565.819670:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695744 00000100:00100000:0.0:1782758565.819689:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211695616 00000100:00100000:0.0:1782758565.819691:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211695616 00000100:00100000:0.0:1782758565.819704:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1782758565.819710:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211696000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758565.819761:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211696000:12345-0@lo:400:kworker.0 Request processed in 51us (12406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758565.819770:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1782758565.819803:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1782758565.819809:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211695744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758565.819875:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211695744:12345-0@lo:400:kworker.0 Request processed in 65us (12451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758565.819883:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1782758565.819907:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1782758565.819915:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198929c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211695616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758565.819958:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198929c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211695616:12345-0@lo:400:kworker.0 Request processed in 44us (12236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758565.819964:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00080000:1.0:1782758565.820098:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758565.820171:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211696000:0@lo:400:kworker.0 00000100:00100000:1.0:1782758565.820248:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211695616:0@lo:400:kworker.0 00000100:00100000:1.0:1782758565.820278:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211695744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758566.317335:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211696256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758566.317408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758566.317534:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696256 00000100:00100000:0.0:1782758566.317543:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696256 00000100:00100000:0.0:1782758566.317591:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1782758566.317601:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211696256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758566.317658:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758566.317725:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211696256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758566.317732:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1782758566.317883:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211696256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758566.451533:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758567.475646:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758568.492156:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758568.877493:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211696384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758568.877563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758568.877654:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696384 00000100:00100000:0.0:1782758568.877663:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696384 00000100:00100000:0.0:1782758568.877739:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1782758568.877751:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211696384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758568.877784:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758568.877872:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211696384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758568.877881:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1782758568.877932:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211696384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758568.878000:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758569.521340:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758570.165486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758570.165547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758570.165602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758570.165747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845824 00000100:00100000:2.0:1782758570.165761:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845824 00000100:00100000:2.0:1782758570.165899:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1893 00000100:00100000:2.0:1782758570.165914:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196845824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758570.166030:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196845824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 119us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758570.166039:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1893 00000100:00100000:0.0:1782758570.166489:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845696 00000100:00100000:0.0:1782758570.166495:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845696 00000100:00100000:0.0:1782758570.166537:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1438 00000100:00100000:0.0:1782758570.166546:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196845696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758570.166595:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196845696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 50us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758570.166602:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1438 00000100:00100000:3.0:1782758570.167193:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846080 00000100:00100000:3.0:1782758570.167200:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846080 00000100:00100000:3.0:1782758570.167422:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1469 00000100:00100000:3.0:1782758570.167433:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196846080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758570.168093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758570.168126:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196845952 00000100:00100000:0.0:1782758570.168131:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196845952 00000100:00100000:0.0:1782758570.168170:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1470 00000100:00100000:0.0:1782758570.168178:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758570.168239:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196845952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758570.168247:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1470 00000100:00080000:1.0:1782758570.168395:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758570.168400:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758570.168404:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758570.169925:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196846080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2486us (4313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758570.169938:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1469 00010000:00010000:0.0:1782758570.541799:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758570.924733:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211696640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.924864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.924933:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211697152:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.924965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.924992:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758570.924998:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211696768:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.925056:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696640 00000100:00100000:0.0:1782758570.925065:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696640 00000100:00100000:0.0:1782758570.925140:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696768 00000100:00100000:0.0:1782758570.925144:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696768 00000100:00100000:0.0:1782758570.925177:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1782758570.925188:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925254:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211696640:12345-0@lo:400:kworker.0 Request processed in 67us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758570.925263:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1782758570.925283:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1782758570.925290:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211696768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925320:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211696768:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758570.925327:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1782758570.925347:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697152 00000100:00100000:0.0:1782758570.925351:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697152 00000100:00100000:0.0:1782758570.925381:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1782758570.925388:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211697152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925420:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211697152:12345-0@lo:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758570.925427:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1782758570.925450:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211696896:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.925513:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758570.925519:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211696512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.925592:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211697024:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758570.925668:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211696768:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925682:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211696640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.925690:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211697152:0@lo:400:kworker.0 00000100:00100000:1.0:1782758570.925930:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697024 00000100:00100000:1.0:1782758570.925936:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697024 00000100:00100000:1.0:1782758570.925976:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1782758570.925983:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211697024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758570.926032:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211697024:12345-0@lo:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758570.926039:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00080000:1.0:1782758570.926064:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758570.926069:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758570.926718:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211697024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758570.928336:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696896 00000100:00100000:2.0:1782758570.928351:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696896 00000100:00100000:2.0:1782758570.928448:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1782758570.928460:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211696896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758570.928582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758570.928606:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211696896:12345-0@lo:400:kworker.0 Request processed in 147us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758570.928614:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1782758570.928623:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211696512 00000100:00100000:1.0:1782758570.928627:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211696512 00000100:00100000:1.0:1782758570.928658:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1782758570.928666:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211696512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758570.928706:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211696512:12345-0@lo:400:kworker.0 Request processed in 41us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758570.928712:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1782758570.929213:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211696512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758570.929235:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211696896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758571.439071:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211697280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758571.439156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758571.439385:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697280 00000100:00100000:2.0:1782758571.439393:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697280 00000100:00100000:2.0:1782758571.439454:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1782758571.439463:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211697280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758571.439500:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758571.460315:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211697280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 20842us (21158us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758571.460331:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:1.0:1782758571.461019:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211697280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758571.568136:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758572.588524:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758573.612154:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758573.996241:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758573.996266:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211697408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758573.996352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758573.996466:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697408 00000100:00100000:3.0:1782758573.996487:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697408 00000100:00100000:3.0:1782758573.996546:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1782758573.996557:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211697408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758573.996592:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758573.996639:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211697408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758573.996647:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00080000:1.0:1782758573.997029:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758573.997067:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211697408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758574.636107:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758575.183440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758575.183589:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846208 00000100:00100000:1.0:1782758575.183601:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846208 00000100:00100000:1.0:1782758575.183744:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1150 00000100:00100000:1.0:1782758575.183756:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846208:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758575.183902:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846208:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 148us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758575.183909:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1150 00000100:00080000:2.0:1782758575.189630:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758575.190771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758575.191346:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846336 00000100:00100000:2.0:1782758575.191358:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846336 00000100:00100000:2.0:1782758575.191496:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 637 00000100:00100000:2.0:1782758575.191507:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846336:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758575.191932:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846336:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 425us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758575.191940:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 637 00000100:00080000:1.0:1782758575.193237:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758575.195958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758575.198040:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846464 00000100:00100000:0.0:1782758575.198058:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846464 00000100:00080000:0.0:1782758575.198216:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758575.198476:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 638 00000100:00100000:1.0:1782758575.198490:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846464:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758575.199164:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846464:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 677us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758575.199176:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 638 00000100:00100000:3.0:1782758575.209505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758575.209616:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846592 00000100:00100000:2.0:1782758575.209626:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846592 00000100:00100000:2.0:1782758575.209691:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00100000:2.0:1782758575.209701:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846592:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758575.210186:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846592:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 485us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758575.210204:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1151 00000100:00100000:1.0:1782758575.215486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758575.215686:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846720 00000100:00100000:2.0:1782758575.215696:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846720 00000100:00100000:2.0:1782758575.215756:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1152 00000100:00100000:2.0:1782758575.215768:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846720:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758575.216059:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196846720:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 292us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758575.216412:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1152 00000100:00100000:3.0:1782758575.226180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758575.226664:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846848 00000100:00100000:1.0:1782758575.226676:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846848 00000100:00100000:1.0:1782758575.226745:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 639 00000100:00100000:1.0:1782758575.226755:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846848:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758575.227654:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846848:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 897us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758575.227663:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 639 00000100:00100000:3.0:1782758575.238219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758575.238329:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196846976 00000100:00100000:0.0:1782758575.238342:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196846976 00000100:00100000:0.0:1782758575.238413:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 640 00000100:00100000:0.0:1782758575.238424:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846976:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758575.238932:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57925:x1869355196846976:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 509us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758575.238941:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 640 00000100:00100000:3.0:1782758575.244478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758575.244743:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196847104 00000100:00100000:0.0:1782758575.244753:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196847104 00000100:00100000:0.0:1782758575.244865:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1153 00000100:00100000:0.0:1782758575.244877:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196847104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782758575.245324:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57925:x1869355196847104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 449us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758575.245332:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1153 00000100:00100000:3.0:1782758575.295378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758575.295512:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196847232 00000100:00100000:2.0:1782758575.295522:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196847232 00000100:00100000:2.0:1782758575.295584:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1440 00000100:00100000:2.0:1782758575.295594:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196847232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758575.295671:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196847232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758575.295679:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1440 00010000:00010000:0.0:1782758575.662216:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758576.045195:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211697792:0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758576.045326:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758576.045333:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211697664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758576.045374:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211698176:0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758576.045424:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697792 00000100:00100000:1.0:1782758576.045430:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697792 00000100:00100000:1.0:1782758576.045490:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697664 00000100:00100000:1.0:1782758576.045493:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697664 00000100:00100000:1.0:1782758576.045512:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1782758576.045521:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211697792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045572:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211697792:12345-0@lo:400:kworker.0 Request processed in 52us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758576.045580:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1782758576.045599:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:1.0:1782758576.045605:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211697664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045629:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211697664:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758576.045635:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:1.0:1782758576.045668:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211697664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758576.045679:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211697792:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.045921:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211697536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.045957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758576.045986:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211698048:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758576.046027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758576.046033:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211697920:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758576.046083:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698176 00000100:00100000:2.0:1782758576.046086:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698176 00000100:00100000:2.0:1782758576.046113:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697920 00000100:00100000:2.0:1782758576.046116:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697920 00000100:00100000:2.0:1782758576.046137:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1782758576.046144:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211698176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046179:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211698176:12345-0@lo:400:kworker.0 Request processed in 36us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758576.046185:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1782758576.046206:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1782758576.046212:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211697920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046259:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211697920:12345-0@lo:400:kworker.0 Request processed in 46us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758576.046269:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1782758576.046285:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698048 00000100:00100000:2.0:1782758576.046289:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698048 00000100:00100000:2.0:1782758576.046313:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1782758576.046319:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211698048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046348:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211698048:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758576.046353:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1782758576.046373:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211697536 00000100:00100000:2.0:1782758576.046376:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211697536 00000100:00100000:2.0:1782758576.046399:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1782758576.046405:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211697536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046431:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211697536:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758576.046449:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1782758576.046502:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211697920:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046510:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211697536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046517:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211698048:0@lo:400:kworker.0 00000100:00100000:2.0:1782758576.046544:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211698176:0@lo:400:kworker.0 00000100:00080000:0.0:1782758576.048357:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758576.048364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758576.048368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758576.557067:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211698304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758576.557146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758576.557216:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698304 00000100:00100000:1.0:1782758576.557225:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698304 00000100:00100000:1.0:1782758576.557282:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1782758576.557291:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211698304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758576.557326:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758576.557371:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211698304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758576.557378:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1782758576.557421:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211698304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758576.688124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758576.935398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758576.935460:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196847360 00000100:00100000:0.0:1782758576.935470:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196847360 00000100:00100000:0.0:1782758576.935531:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1154 00000100:00100000:0.0:1782758576.935543:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57939:x1869355196847360:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758576.935565:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758576.935584:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbc6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e11 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.935648:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.935663:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.935677:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758576.935902:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1782758576.935908:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758576.935985:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.936010:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbc6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e11 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.936025:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e11 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758576.936034:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:0.0:1782758576.936037:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758576.936040:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782758576.936101:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57939:x1869355196847360:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 560us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758576.936109:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1154 00000100:00100000:0.0:1782758576.947815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758576.947918:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196847616 00000100:00100000:2.0:1782758576.947928:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196847616 00000100:00100000:2.0:1782758576.947987:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1155 00000100:00100000:2.0:1782758576.947999:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57939:x1869355196847616:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758576.948053:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758576.948080:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbc74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e11 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758576.948099:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbc12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64dfc expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758576.948111:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:2.0:1782758576.948129:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758576.948156:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758576.948169:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758576.948178:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782758577.059200:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967741 is committed 00000004:00010000:0.0:1782758577.059359:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004176ce44 reply state 00000000860c71b0 transno 4294967741 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.059374:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758577.059549:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00080000:0.0:1782758577.059655:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782758577.059679:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57939:x1869355196847616:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 111678us (111870us total) trans 4294967741 rc 0/0 00000100:00100000:0.0:1782758577.059691:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1155 00010000:00010000:1.0:1782758577.059949:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.059958:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.059965:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.059972:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.059977:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.059983:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.060001:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:1.0:1782758577.060004:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758577.060010:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.060016:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbc7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.144034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758577.147035:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196847744 00000100:00100000:2.0:1782758577.147057:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196847744 00000100:00100000:3.0:1782758577.147282:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1156 00000100:00100000:3.0:1782758577.147295:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57943:x1869355196847744:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758577.147323:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758577.147345:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e18 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147405:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147432:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147444:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147457:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147465:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147470:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147986:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.147996:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148005:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758577.148088:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1782758577.148092:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758577.148167:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148180:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148188:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148195:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148201:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758577.148205:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148213:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148225:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758577.148229:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758577.148233:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148240:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbc89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148252:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148264:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148270:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148275:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758577.148278:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148285:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148291:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75800) 00010000:00010000:3.0:1782758577.148294:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758577.148297:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148302:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbc90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148331:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbc82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e18 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148344:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e18 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.148352:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:3.0:1782758577.148355:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758577.148358:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782758577.148439:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57943:x1869355196847744:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1146us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758577.148448:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1156 00000100:00080000:0.0:1782758577.152072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758577.157126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758577.157235:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848000 00000100:00100000:1.0:1782758577.157246:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848000 00000100:00100000:1.0:1782758577.157307:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1157 00000100:00100000:1.0:1782758577.157317:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57943:x1869355196848000:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:1.0:1782758577.157340:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758577.157362:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbc9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e1f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157693:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157708:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157719:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157735:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157743:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.157750:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758577.160344:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:1.0:1782758577.160631:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbcb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160647:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160659:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160696:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160704:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160710:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160717:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.160721:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160734:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160747:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:1.0:1782758577.160750:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758577.160754:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.160761:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbca5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758577.160774:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4bb628a reply state 000000006bcc5c78 transno 4294967742 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758577.160784:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758577.161215:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbc9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e1f expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.161236:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e1f expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.161244:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758577.161247:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758577.161250:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782758577.161371:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57943:x1869355196848000:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 4053us (4256us total) trans 4294967742 rc 0/0 00000100:00100000:1.0:1782758577.161381:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1157 00000100:00100000:2.0:1782758577.181340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782758577.181424:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.181437:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.181445:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.181451:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758577.181457:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.181463:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848256 00010000:00010000:3.0:1782758577.181464:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.181472:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848256 00010000:00010000:3.0:1782758577.181480:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9171a0e3a600) 00010000:00010000:3.0:1782758577.181483:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758577.181488:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.181493:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.181531:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1158 00000100:00100000:0.0:1782758577.181542:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57943:x1869355196848256:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:0.0:1782758577.181596:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758577.181614:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbcb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e1f expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.181626:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:0.0:1782758577.181632:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758577.181676:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.181691:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.181700:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758577.181960:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e48c6839 reply state 00000000af3f5ee6 transno 4294967743 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.181969:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758577.182066:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57943:x1869355196848256:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 524us (733us total) trans 4294967743 rc 0/0 00000100:00100000:0.0:1782758577.182076:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1158 00000100:00100000:2.0:1782758577.190694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758577.190848:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848384 00000100:00100000:0.0:1782758577.190858:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848384 00000100:00100000:0.0:1782758577.190910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1159 00000100:00100000:0.0:1782758577.190920:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57943:x1869355196848384:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782758577.190943:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758577.190964:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbcc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e26 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.191009:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.191018:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.191065:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.191482:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e26 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.191500:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e26 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758577.191524:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758577.191528:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782758577.191531:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758577.191590:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57943:x1869355196848384:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 671us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758577.191597:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1159 00000100:00100000:0.0:1782758577.196000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758577.196105:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848512 00000100:00100000:2.0:1782758577.196116:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848512 00000100:00100000:2.0:1782758577.196195:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00100000:2.0:1782758577.196208:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196848512:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:2.0:1782758577.196550:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196848512:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 345us (559us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1782758577.196559:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00080000:0.0:1782758577.196741:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758577.198479:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.198491:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.198513:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.198542:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782758577.198545:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758577.198550:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.198561:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbcc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758577.205064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758577.205155:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848768 00000100:00100000:2.0:1782758577.205166:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848768 00000100:00100000:2.0:1782758577.205227:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:2.0:1782758577.205237:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57943:x1869355196848768:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:2.0:1782758577.205618:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57943:x1869355196848768:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 381us (562us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1782758577.205627:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:2.0:1782758577.272487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758577.272555:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196848896 00000100:00100000:1.0:1782758577.272567:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196848896 00000100:00100000:1.0:1782758577.272633:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1160 00000100:00100000:1.0:1782758577.272644:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57946:x1869355196848896:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:1.0:1782758577.272669:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758577.272690:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e2d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272775:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272791:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272803:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272819:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272872:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272879:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272977:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272987:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.272994:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758577.273028:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5f:0x0]: returning size 0 00000004:00200000:1.0:1782758577.273032:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758577.273054:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273066:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273079:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273086:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273092:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273098:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.273103:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273110:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273123:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:1.0:1782758577.273126:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758577.273131:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273137:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dbcd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273150:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273156:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273162:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273167:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.273169:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273174:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273181:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9171a0e3ad00) 00010000:00010000:1.0:1782758577.273183:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758577.273186:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273192:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbcdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273221:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e2d expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273234:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e2d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.273241:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782758577.273244:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758577.273247:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782758577.273295:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57946:x1869355196848896:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 654us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758577.273302:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1160 00000100:00100000:0.0:1782758577.279132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758577.279233:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849024 00000100:00100000:2.0:1782758577.279243:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849024 00000100:00100000:2.0:1782758577.279307:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 642 00000100:00100000:2.0:1782758577.279319:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196849024:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:2.0:1782758577.279339:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758577.279361:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e34 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758577.279387:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x6a42bcb0, atime: 0x6a42bcb0, ctime: 0x6a42bcb0, blocks: 0x1 00010000:00010000:2.0:1782758577.279405:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=2645s v=(0 0) 00010000:00010000:2.0:1782758577.279419:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758577.279429:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.279450:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.279464:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758577.279524:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196849024:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758577.279532:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 642 00000100:00100000:0.0:1782758577.285328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758577.285440:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849280 00000100:00100000:2.0:1782758577.285450:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849280 00000100:00100000:2.0:1782758577.285506:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1161 00000100:00100000:2.0:1782758577.285517:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57946:x1869355196849280:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782758577.285569:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758577.285596:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e2d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285620:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbcc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e26 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285632:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:2.0:1782758577.285644:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758577.285667:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285679:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285689:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285702:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285710:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285731:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285921:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285930:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.285937:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758577.286490:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:2.0:1782758577.286501:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2645689678177ns, next at 2646689675582ns, rc = 0 00010000:00010000:2.0:1782758577.286557:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286567:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286576:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286584:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286592:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286599:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286632:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758577.286653:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286660:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286668:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286674:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758577.286679:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286687:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286698:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782758577.286701:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758577.286705:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286711:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286728:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286734:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286743:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286748:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758577.286750:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286756:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758577.286763:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:2.0:1782758577.286766:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758577.286768:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286772:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758577.286773:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbcf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286779:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758577.286783:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000089f1a71 reply state 00000000b26d3914 transno 4294967745 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286785:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758577.286788:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758577.286792:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758577.286794:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286802:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:1.0:1782758577.286804:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758577.286807:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286811:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.286846:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758577.286848:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758577.286850:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758577.286900:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57946:x1869355196849280:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 1381us (1577us total) trans 4294967745 rc 0/0 00000100:00100000:2.0:1782758577.286908:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1161 00010000:00010000:1.0:1782758577.289453:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289470:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289478:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289485:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758577.289489:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289498:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289515:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917182dd1f00) 00010000:00010000:1.0:1782758577.289518:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758577.289522:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758577.289529:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbcf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758577.713802:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758578.180390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758578.181112:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849408 00000100:00100000:2.0:1782758578.181122:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849408 00000100:00100000:2.0:1782758578.181180:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1162 00000100:00100000:2.0:1782758578.181191:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57962:x1869355196849408:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758578.181220:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758578.181244:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbd0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181320:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181336:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181348:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758578.181420:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:2.0:1782758578.181424:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758578.181451:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181477:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dbd0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e3b expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181495:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e3b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.181505:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:2.0:1782758578.181509:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758578.181513:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758578.181578:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57962:x1869355196849408:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 389us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758578.181586:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1162 00000100:00100000:2.0:1782758578.187099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758578.187515:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849664 00000100:00100000:0.0:1782758578.187525:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849664 00000100:00100000:0.0:1782758578.187579:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000100:00100000:0.0:1782758578.187590:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57962:x1869355196849664:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758578.187656:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758578.187691:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbd15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e3b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758578.187714:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbc97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e18 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758578.187726:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75c00) 00010000:00010000:0.0:1782758578.187737:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758578.187766:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758578.187779:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758578.187789:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758578.231137:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000590060b2 reply state 0000000094f4c246 transno 4294967746 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758578.231157:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758578.231320:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:0.0:1782758578.231460:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:57962:x1869355196849664:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 43865us (44366us total) trans 4294967746 rc 0/0 00000100:00100000:0.0:1782758578.231471:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1163 00000001:00080000:0.0:1782758578.231631:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967746 is committed 00000004:00080000:0.0:1782758578.231652:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00010000:00010000:3.0:1782758578.231720:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231730:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231738:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231744:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758578.231749:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231757:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231774:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:3.0:1782758578.231777:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758578.231781:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.231788:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dbd1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758578.233770:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758578.252005:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211698432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758578.252093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758578.254028:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698432 00000100:00100000:3.0:1782758578.254049:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698432 00000100:00100000:2.0:1782758578.256495:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1782758578.256511:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211698432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782758578.256547:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:36 count 1 00010000:00010000:2.0:1782758578.256572:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.256594:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.256605:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782758578.256609:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758578.256614:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.256646:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758578.256660:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 6 pid: 9120 timeout: 2746 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758578.256674:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211698560:192.168.204.31@tcp:104: 00000100:00080000:3.0:1782758578.256855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758578.256949:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170836966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758578.263075:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211698560:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782758578.263115:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758578.263377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758578.264047:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849792 00000100:00100000:3.0:1782758578.264056:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849792 00010000:00010000:3.0:1782758578.264096:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 2746 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758578.264137:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 451 00000100:00100000:3.0:1782758578.264146:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196849792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758578.264160:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758578.264166:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 2746 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.264180:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 2746 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.264203:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dbceb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e34 expref: 7 pid: 9120 timeout: 2746 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.264220:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758578.264224:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758578.264229:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.264238:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.264267:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758578.264319:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196849792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 173us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758578.264328:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 451 00010000:00010000:1.0:1782758578.264501:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758578.264513:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758578.264523:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758578.264532:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758578.264555:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758578.265264:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211698432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8756us (13169us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1782758578.265277:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000004:00080000:1.0:1782758578.265344:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b77d9500/2, rc 0, transno 4294967369 00000100:00100000:1.0:1782758578.265351:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211698432:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782758578.268930:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758578.268946:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.268960:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758578.268966:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.268978:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.269003:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.269011:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022265a26/0xdd99f5c4777dbd23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.269033:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758578.269035:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758578.269037:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758578.331632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758578.331703:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196849920 00000100:00100000:0.0:1782758578.331715:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196849920 00000100:00100000:0.0:1782758578.331783:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1164 00000100:00100000:0.0:1782758578.331795:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57966:x1869355196849920:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:0.0:1782758578.331845:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758578.331868:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbd2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e42 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334087:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334113:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334126:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334147:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334154:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334161:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334627:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334637:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334644:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758578.334727:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1782758578.334732:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758578.334847:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334861:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334871:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334877:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334884:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758578.334888:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334895:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334908:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758578.334911:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758578.334916:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334922:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334932:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334938:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334944:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334949:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758578.334952:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334958:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334965:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75800) 00010000:00010000:3.0:1782758578.334968:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758578.334970:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.334975:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbd38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.335009:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbd2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e42 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.335024:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e42 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758578.335031:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758578.335033:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758578.335035:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758578.335109:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57966:x1869355196849920:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 3315us (3489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758578.335118:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1164 00010000:00010000:1.0:1782758578.732293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758579.136333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758579.136354:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211698688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758579.136432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758579.136530:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698688 00000100:00100000:0.0:1782758579.136537:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698688 00000100:00100000:0.0:1782758579.136599:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1782758579.136610:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211698688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758579.136643:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758579.136884:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211698688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758579.136892:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1782758579.136950:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211698688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758579.137020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758579.343178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758579.343279:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850048 00000100:00100000:2.0:1782758579.343288:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850048 00000100:00100000:2.0:1782758579.343351:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1165 00000100:00100000:2.0:1782758579.343362:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57981:x1869355196850048:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758579.343392:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758579.343413:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e49 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343473:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343487:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343498:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758579.343708:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:2.0:1782758579.343726:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758579.343851:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343879:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e49 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343895:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e49 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.343905:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782758579.343908:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758579.343914:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758579.344666:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57981:x1869355196850048:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1302us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758579.344676:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1165 00000100:00080000:3.0:1782758579.344931:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758579.356311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.356481:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850304 00000100:00100000:0.0:1782758579.356490:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850304 00000100:00100000:0.0:1782758579.356557:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1166 00000100:00100000:0.0:1782758579.356567:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57981:x1869355196850304:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758579.356621:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758579.356648:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e49 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.356673:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbd3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e42 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.356684:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782758579.356693:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758579.356716:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.356728:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.356737:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758579.357222:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071def27d reply state 000000001500f41a transno 4294967747 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758579.357232:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758579.357303:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:0.0:1782758579.357410:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57981:x1869355196850304:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 843us (1108us total) trans 4294967747 rc 0/0 00000100:00100000:0.0:1782758579.357418:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1166 00010000:00010000:2.0:1782758579.364357:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364386:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364395:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364401:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758579.364406:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364414:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364430:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd300) 00010000:00010000:2.0:1782758579.364433:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758579.364438:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.364443:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbd54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758579.504729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758579.504768:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850432 00000100:00100000:3.0:1782758579.504777:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850432 00000100:00100000:3.0:1782758579.504851:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1167 00000100:00100000:3.0:1782758579.504862:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850432:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758579.506231:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850432:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 1365us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758579.506243:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1167 00000100:00100000:1.0:1782758579.524849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758579.525080:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850560 00000100:00100000:3.0:1782758579.525089:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850560 00000100:00100000:3.0:1782758579.525168:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 644 00000100:00100000:3.0:1782758579.525178:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57993:x1869355196850560:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758579.525548:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57993:x1869355196850560:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 370us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758579.525557:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 644 00000100:00080000:1.0:1782758579.526028:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758579.530935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758579.530974:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850688 00000100:00100000:2.0:1782758579.530983:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850688 00000100:00100000:2.0:1782758579.531038:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 645 00000100:00100000:2.0:1782758579.531048:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57993:x1869355196850688:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758579.531414:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57993:x1869355196850688:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 366us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758579.531423:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 645 00000100:00080000:1.0:1782758579.531801:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758579.548042:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.548210:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850816 00000100:00100000:0.0:1782758579.548220:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850816 00000100:00100000:0.0:1782758579.548286:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1168 00000100:00100000:0.0:1782758579.548347:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850816:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758579.548949:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850816:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 604us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758579.548962:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1168 00000100:00100000:1.0:1782758579.557908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.558069:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196850944 00000100:00100000:0.0:1782758579.558081:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196850944 00000100:00100000:0.0:1782758579.558189:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1169 00000100:00100000:0.0:1782758579.558202:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850944:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758579.558348:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196850944:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 148us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758579.558357:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1169 00000100:00100000:1.0:1782758579.563589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758579.563800:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851072 00000100:00100000:3.0:1782758579.563965:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851072 00000100:00100000:3.0:1782758579.564265:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:3.0:1782758579.564276:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57993:x1869355196851072:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758579.564670:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57993:x1869355196851072:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 394us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758579.564685:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:0.0:1782758579.567927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758579.568090:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851200 00000100:00100000:1.0:1782758579.568101:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851200 00000100:00100000:1.0:1782758579.568165:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 647 00000100:00100000:1.0:1782758579.568176:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57993:x1869355196851200:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758579.568557:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57993:x1869355196851200:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 382us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758579.568565:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 647 00000100:00100000:1.0:1782758579.572471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758579.572586:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851328 00000100:00100000:3.0:1782758579.572596:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851328 00000100:00100000:3.0:1782758579.572690:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1170 00000100:00100000:3.0:1782758579.572700:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196851328:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758579.573202:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57993:x1869355196851328:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 503us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758579.573210:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1170 00000100:00100000:3.0:1782758579.622812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758579.623010:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851456 00000100:00100000:2.0:1782758579.623021:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851456 00000100:00100000:2.0:1782758579.623075:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1171 00000100:00100000:2.0:1782758579.623084:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:57997:x1869355196851456:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758579.623103:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758579.623122:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e50 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623176:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623189:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623200:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623213:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623220:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623227:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623700:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.623709:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624005:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758579.624084:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:2.0:1782758579.624088:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758579.624150:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624163:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624169:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624176:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624182:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758579.624186:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624193:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624205:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782758579.624208:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758579.624213:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624219:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbd62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624230:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624236:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624241:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624246:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758579.624249:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624254:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624260:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917182dd1500) 00010000:00010000:2.0:1782758579.624262:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758579.624264:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624270:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbd69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624300:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbd5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e50 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624313:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e50 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758579.624321:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782758579.624323:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758579.624325:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758579.625067:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57997:x1869355196851456:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1979us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758579.625076:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1171 00000100:00100000:2.0:1782758579.628814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.628976:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851712 00000100:00100000:0.0:1782758579.628990:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851712 00000100:00100000:0.0:1782758579.629057:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1172 00000100:00100000:0.0:1782758579.629068:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57997:x1869355196851712:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782758579.629089:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758579.629109:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbd77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e57 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629457:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629474:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629484:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629497:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629504:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.629515:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782758579.630433:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:0.0:1782758579.630668:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbd8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630680:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630689:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630737:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630745:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630752:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630757:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758579.630761:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630768:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630780:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782758579.630783:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758579.630788:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630794:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbd7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758579.630809:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092f67e7b reply state 0000000024160336 transno 4294967748 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758579.630818:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782758579.630876:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbd77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e57 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630892:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbd8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e57 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.630900:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758579.630902:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782758579.630904:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782758579.630976:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:57997:x1869355196851712:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1910us (2172us total) trans 4294967748 rc 0/0 00000100:00100000:0.0:1782758579.630984:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1172 00010000:00010000:3.0:1782758579.635148:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635166:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635174:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635180:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758579.635185:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635193:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635210:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff91718bcfd500) 00010000:00010000:3.0:1782758579.635214:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758579.635219:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758579.635225:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51400/0xdd99f5c4777dbd85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758579.645775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.645898:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851840 00000100:00100000:0.0:1782758579.645909:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851840 00000100:00100000:0.0:1782758579.645970:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 648 00000100:00100000:0.0:1782758579.645981:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:57997:x1869355196851840:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782758579.646000:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758579.646023:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e5e expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758579.646055:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782758579.646076:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=2648s v=(0 0) 00010000:00010000:0.0:1782758579.646080:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758579.646089:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.646107:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758579.646120:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758579.646183:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:57997:x1869355196851840:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 204us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758579.646191:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 648 00000100:00100000:1.0:1782758579.663188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758579.663291:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196851968 00000100:00100000:0.0:1782758579.663300:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196851968 00002000:00100000:0.0:1782758579.663354:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff91719fc17800 x1869355196851968/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1782758590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1782758579.663376:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91719fc17800 with x1869355196851968 ext(0->1048575) 00002000:00010000:0.0:1782758579.663382:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91719fc17800 00000100:00100000:0.0:1782758579.663417:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1782758579.663426:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196851968:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:2.0:1782758579.679332:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2361:x1869355196851968:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 15894us (16141us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782758579.679348:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00002000:00100000:2.0:1782758579.679361:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff91719fc17800 x1869355196851968/t4294967370(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1782758590 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782758579.681255:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91719fc17800 with x1869355196851968 ext(0->1048575) 00002000:00010000:2.0:1782758579.681267:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91719fc17800 00000100:00100000:1.0:1782758579.683916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758579.684014:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852096 00000100:00100000:3.0:1782758579.684023:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852096 00000100:00100000:3.0:1782758579.684114:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1173 00000100:00100000:3.0:1782758579.684127:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:57997:x1869355196852096:12345-192.168.204.31@tcp:44:dd.60003 00000001:00080000:2.0:1782758579.727096:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967748 is committed 00000100:00100000:1.0:1782758579.727299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57997:x1869355196852096:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 43169us (43387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758579.727312:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1173 00000100:00100000:1.0:1782758579.734546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758579.734629:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852224 00000100:00100000:2.0:1782758579.734640:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852224 00000100:00100000:2.0:1782758579.734811:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00100000:2.0:1782758579.734854:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196852224:12345-192.168.204.31@tcp:16:dd.60003 00010000:00010000:1.0:1782758579.760510:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758579.765354:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000100:00100000:2.0:1782758579.765532:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196852224:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 30705us (30989us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758579.765545:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00100000:2.0:1782758579.768497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758579.768603:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852480 00000100:00100000:1.0:1782758579.768613:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852480 00000100:00100000:1.0:1782758579.768958:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:1.0:1782758579.768969:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:57997:x1869355196852480:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:1.0:1782758579.769470:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:57997:x1869355196852480:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 502us (979us total) trans 4294967749 rc 0/0 00000100:00100000:1.0:1782758579.769478:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:1.0:1782758580.409963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758580.410014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758580.410052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758580.410076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758580.410109:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852608 00000100:00100000:1.0:1782758580.410119:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852608 00000100:00100000:1.0:1782758580.410173:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1442 00000100:00100000:1.0:1782758580.410185:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196852608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758580.410269:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196852608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758580.410276:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1442 00000100:00100000:1.0:1782758580.410333:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852992 00000100:00100000:1.0:1782758580.410338:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852992 00000100:00100000:1.0:1782758580.410375:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852864 00000100:00100000:1.0:1782758580.410378:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852864 00000100:00100000:1.0:1782758580.410400:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1475 00000100:00100000:1.0:1782758580.410406:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196852992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758580.410429:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196852736 00000100:00100000:2.0:1782758580.410433:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196852736 00000100:00100000:1.0:1782758580.410437:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196852992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758580.410443:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1475 00000100:00100000:1.0:1782758580.410456:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1476 00000100:00100000:2.0:1782758580.410461:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1900 00000100:00100000:1.0:1782758580.410462:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196852864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758580.410467:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2364:x1869355196852736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758580.410483:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196852864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758580.410489:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1476 00000100:00100000:2.0:1782758580.410497:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2364:x1869355196852736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758580.410503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1900 00010000:00010000:2.0:1782758580.788641:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758581.167552:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211698816:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.167624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758581.168472:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211699328:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.168513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758581.168545:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758581.168552:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211698944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.168575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758581.168669:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211699456:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.168697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758581.168729:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211699072:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.168752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758581.175022:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698816 00000100:00100000:2.0:1782758581.175037:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698816 00000100:00100000:2.0:1782758581.175088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1782758581.175096:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211698816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758581.175192:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211698816:12345-0@lo:400:kworker.0 Request processed in 96us (7567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758581.175199:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1782758581.175236:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699200:0@lo:400:kworker.0 00000100:00100000:2.0:1782758581.175271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758581.178993:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699456 00000100:00100000:1.0:1782758581.179007:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699456 00000100:00100000:1.0:1782758581.179070:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699200 00000100:00100000:1.0:1782758581.179074:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699200 00000100:00100000:1.0:1782758581.179099:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1782758581.179109:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211699456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.179187:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211699456:12345-0@lo:400:kworker.0 Request processed in 80us (10488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758581.179195:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1782758581.179214:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1782758581.179221:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.179258:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699200:12345-0@lo:400:kworker.0 Request processed in 37us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758581.179263:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1782758581.179308:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211699456:0@lo:400:kworker.0 00000100:00100000:1.0:1782758581.179320:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211698816:0@lo:400:kworker.0 00000100:00080000:1.0:1782758581.179364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758581.179367:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758581.179389:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699200:0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.185918:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699328 00000100:00100000:3.0:1782758581.185933:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699328 00000100:00100000:3.0:1782758581.186011:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211698944 00000100:00100000:3.0:1782758581.186015:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211698944 00000100:00100000:3.0:1782758581.186035:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699072 00000100:00100000:3.0:1782758581.186037:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699072 00000100:00100000:3.0:1782758581.186056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1782758581.186066:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211699328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.186161:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211699328:12345-0@lo:400:kworker.0 Request processed in 95us (17647us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758581.186169:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1782758581.186187:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1782758581.186193:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211698944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.186225:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211698944:12345-0@lo:400:kworker.0 Request processed in 33us (17649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758581.186230:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1782758581.186240:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:3.0:1782758581.186246:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211699072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.186278:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211699072:12345-0@lo:400:kworker.0 Request processed in 33us (17526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758581.186288:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:3.0:1782758581.186589:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758581.186634:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211698944:0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.186662:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211699328:0@lo:400:kworker.0 00000100:00100000:3.0:1782758581.186702:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211699072:0@lo:400:kworker.0 00000001:00080000:3.0:1782758581.285937:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00000001:00080000:3.0:1782758581.285962:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000001:00080000:2.0:1782758581.379446:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967749 is committed 00000100:00100000:2.0:1782758581.676130:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758581.676154:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758581.676232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758581.676414:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699584 00000100:00100000:3.0:1782758581.676423:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699584 00000100:00100000:3.0:1782758581.676483:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1782758581.676503:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758581.676538:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758581.676645:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758581.676652:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1782758581.677221:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:2.0:1782758581.677227:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b77d9500, transno 4294967369 00000100:00100000:2.0:1782758581.677287:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758581.804084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758582.757769:0:99077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2651160943017ns, next at 2628040557083ns, rc = 0 00000004:00080000:1.0:1782758582.757906:0:99077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2651161082472ns, next at 2646689675582ns, rc = 0 00000004:00080000:0.0:1782758582.805220:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000004:00080000:0.0:1782758582.814015:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00010000:00010000:3.0:1782758582.831173:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758583.852183:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758584.236520:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758584.236604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758584.236809:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699712 00000100:00100000:3.0:1782758584.236817:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699712 00000100:00100000:3.0:1782758584.236903:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1782758584.236913:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758584.236946:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758584.236996:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211699712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.237003:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00080000:2.0:1782758584.237101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758584.237137:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211699712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758584.384436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758584.384515:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853120 00000100:00100000:3.0:1782758584.384525:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853120 00000100:00100000:3.0:1782758584.384731:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1174 00000100:00100000:3.0:1782758584.384743:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853120:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758584.384858:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853120:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.384866:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1174 00000100:00080000:2.0:1782758584.386085:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758584.390329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758584.390419:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853248 00000100:00100000:3.0:1782758584.390430:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853248 00000100:00100000:3.0:1782758584.390503:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 650 00000100:00100000:3.0:1782758584.390513:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58190:x1869355196853248:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758584.390911:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58190:x1869355196853248:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 397us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.390919:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 650 00000100:00080000:2.0:1782758584.391035:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758584.395353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758584.395451:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853376 00000100:00100000:3.0:1782758584.395462:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853376 00000100:00100000:3.0:1782758584.395533:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00100000:3.0:1782758584.395543:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58190:x1869355196853376:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758584.395919:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58190:x1869355196853376:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 377us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.395928:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00080000:2.0:1782758584.396193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758584.397772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758584.397870:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853504 00000100:00100000:3.0:1782758584.397879:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853504 00000100:00100000:3.0:1782758584.397925:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1175 00000100:00100000:3.0:1782758584.397935:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853504:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758584.398267:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853504:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 333us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.398294:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1175 00000100:00100000:0.0:1782758584.409179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758584.409248:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853632 00000100:00100000:1.0:1782758584.409258:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853632 00000100:00100000:1.0:1782758584.409320:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1176 00000100:00100000:1.0:1782758584.409330:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853632:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758584.409436:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196853632:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758584.409444:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1176 00000100:00100000:0.0:1782758584.411811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758584.412049:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853760 00000100:00100000:3.0:1782758584.412058:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853760 00000100:00100000:3.0:1782758584.412114:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:3.0:1782758584.412125:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58190:x1869355196853760:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758584.412522:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58190:x1869355196853760:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 397us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758584.412530:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:0.0:1782758584.414675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758584.414752:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196853888 00000100:00100000:1.0:1782758584.414763:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196853888 00000100:00100000:1.0:1782758584.414853:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:1.0:1782758584.414865:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58190:x1869355196853888:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758584.415207:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58190:x1869355196853888:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 343us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758584.415216:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:0.0:1782758584.417010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758584.417090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854016 00000100:00100000:1.0:1782758584.417098:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854016 00000100:00100000:1.0:1782758584.417148:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1177 00000100:00100000:1.0:1782758584.417158:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196854016:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758584.417593:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58190:x1869355196854016:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 434us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758584.417610:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1177 00000100:00100000:0.0:1782758584.514171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758584.514249:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854272 00000100:00100000:2.0:1782758584.514258:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854272 00000100:00100000:2.0:1782758584.514330:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1178 00000100:00100000:2.0:1782758584.514340:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58194:x1869355196854272:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:2.0:1782758584.514397:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758584.514425:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbd8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e57 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514444:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:2.0:1782758584.514466:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758584.514488:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514505:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514515:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514528:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514537:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.514544:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.515151:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.515161:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.515169:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758584.517119:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:3.0:1782758584.517135:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2652920311499ns, next at 2653920308087ns, rc = 0 00010000:00010000:3.0:1782758584.517249:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517266:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517286:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517296:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517303:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517310:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517366:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758584.517395:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517402:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517409:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517415:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758584.517419:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517427:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517440:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff917182dd1000) 00010000:00010000:3.0:1782758584.517442:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758584.517447:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517453:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdaf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517474:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517481:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517487:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517497:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758584.517500:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517505:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517512:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1300) 00010000:00010000:3.0:1782758584.517515:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758584.517518:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.517523:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbda1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758584.517532:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007070216f reply state 0000000032e9c2da transno 4294967750 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758584.517541:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758584.517736:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58194:x1869355196854272:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 3394us (3570us total) trans 4294967750 rc 0/0 00000100:00100000:3.0:1782758584.517746:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1178 00010000:00010000:1.0:1782758584.517948:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758584.517956:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758584.517962:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758584.517965:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758584.517972:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758584.517981:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff917182dd1000) 00010000:00010000:1.0:1782758584.517984:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758584.517987:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758584.517993:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbdb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758584.518007:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758584.518009:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758584.518011:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758584.525100:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525119:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525127:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525134:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758584.525140:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525147:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525166:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff917182dd1500) 00010000:00010000:2.0:1782758584.525169:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758584.525174:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758584.525180:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbda8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758584.880028:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758585.526119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758585.526171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758585.526193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758585.526213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758585.526245:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854656 00000100:00100000:0.0:1782758585.526267:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854656 00000100:00100000:0.0:1782758585.526327:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854784 00000100:00100000:0.0:1782758585.526331:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854784 00000100:00100000:0.0:1782758585.526353:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1479 00000100:00100000:0.0:1782758585.526362:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196854656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758585.526435:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196854656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758585.526442:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1479 00000100:00100000:0.0:1782758585.526459:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:0.0:1782758585.526466:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196854784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758585.526491:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196854784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758585.526497:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:3.0:1782758585.526658:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854400 00000100:00100000:3.0:1782758585.526663:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854400 00000100:00100000:3.0:1782758585.526702:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1444 00000100:00100000:3.0:1782758585.526709:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196854400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758585.526744:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196854400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758585.526752:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1444 00000100:00100000:3.0:1782758585.526786:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854528 00000100:00100000:3.0:1782758585.526789:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854528 00000100:00100000:3.0:1782758585.526818:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1904 00000100:00100000:3.0:1782758585.526848:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196854528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758585.526881:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196854528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758585.526888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1904 00010000:00010000:3.0:1782758585.912595:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758586.290634:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700224:0@lo:400:kworker.0 00000100:00100000:3.0:1782758586.290705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758586.290756:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758586.290763:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211700096:0@lo:400:kworker.0 00000100:00100000:3.0:1782758586.290789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758586.290846:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700096 00000100:00100000:3.0:1782758586.290853:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700096 00000100:00100000:3.0:1782758586.290911:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1782758586.290920:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211700096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758586.290969:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211700096:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758586.290977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00080000:3.0:1782758586.290997:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758586.291029:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211700096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291188:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211699968:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758586.291255:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211700480:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758586.291301:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758586.291307:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211699840:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758586.291356:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211700352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291377:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758586.291412:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700224 00000100:00100000:0.0:1782758586.291416:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700224 00000100:00100000:0.0:1782758586.291448:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700480 00000100:00100000:0.0:1782758586.291451:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700480 00000100:00100000:0.0:1782758586.291473:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1782758586.291481:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211700224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291520:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211700224:12345-0@lo:400:kworker.0 Request processed in 41us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758586.291526:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1782758586.291539:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1782758586.291545:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211700480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291588:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211700480:12345-0@lo:400:kworker.0 Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758586.291595:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1782758586.291616:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699840 00000100:00100000:0.0:1782758586.291619:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699840 00000100:00100000:0.0:1782758586.291642:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1782758586.291648:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211699840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291678:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211699840:12345-0@lo:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758586.291684:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1782758586.291709:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211699968 00000100:00100000:0.0:1782758586.291713:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211699968 00000100:00100000:0.0:1782758586.291731:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700352 00000100:00100000:0.0:1782758586.291734:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700352 00000100:00100000:0.0:1782758586.291752:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:0.0:1782758586.291757:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291785:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211699968:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758586.291791:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:0.0:1782758586.291801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:0.0:1782758586.291806:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211700352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291849:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211700352:12345-0@lo:400:kworker.0 Request processed in 43us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758586.291855:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00080000:0.0:1782758586.291882:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758586.291886:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758586.291887:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758586.291906:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211699840:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291917:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211700352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291927:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211699968:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291935:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211700480:0@lo:400:kworker.0 00000100:00100000:0.0:1782758586.291966:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700224:0@lo:400:kworker.0 00000100:00100000:3.0:1782758586.798685:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758586.798713:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758586.798786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758586.800574:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700608 00000100:00100000:3.0:1782758586.800587:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700608 00000100:00100000:3.0:1782758586.800641:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1782758586.800650:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211700608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758586.800689:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758586.800757:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211700608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758586.800764:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1782758586.800815:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700608:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1782758586.835167:0:99222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2655238340354ns, next at 2653920308087ns, rc = 0 00000004:00080000:1.0:1782758586.892496:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000001:00080000:1.0:1782758586.892534:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00000004:00080000:1.0:1782758586.892540:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00000100:00100000:3.0:1782758586.893167:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758586.893249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758586.893368:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700736 00000100:00100000:1.0:1782758586.893376:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700736 00000100:00100000:1.0:1782758586.893419:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1782758586.893428:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211700736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782758586.893455:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:37 count 1 00010000:00010000:1.0:1782758586.893479:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.893500:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 5 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.893510:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x25:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782758586.893514:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758586.893519:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.893558:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 5 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.893572:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 5 pid: 6599 timeout: 2755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758586.893584:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211700864:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758586.893646:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181254e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782758586.899328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758586.899438:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196854912 00000100:00100000:2.0:1782758586.899448:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196854912 00010000:00010000:2.0:1782758586.899503:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 6 pid: 6599 timeout: 2755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758586.899536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 452 00000100:00100000:2.0:1782758586.899553:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196854912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758586.899568:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758586.899573:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 6 pid: 6599 timeout: 2755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758586.899586:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 6 pid: 6599 timeout: 2755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758586.899611:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758586.899616:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782758586.899621:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758586.899632:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758586.899651:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758586.899698:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196854912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 154us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758586.899705:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 452 00000100:00080000:0.0:1782758586.899781:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758586.899884:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b42cfb6/0xdd99f5c4777dbd9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e5e expref: 5 pid: 6599 timeout: 2755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758586.899900:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211700864:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782758586.899929:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.899949:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.899956:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.899966:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.899974:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758586.899989:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782758586.900531:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211700736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7102us (7280us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1782758586.900539:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000004:00080000:1.0:1782758586.900580:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084c6df80/2, rc 0, transno 4294967371 00000100:00100000:1.0:1782758586.900589:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211700736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782758586.900807:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758586.900815:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758586.900855:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758586.900860:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758586.900870:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758586.900886:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758586.900893:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777dbdbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758586.900911:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758586.900912:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758586.900914:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782758586.901106:0:99222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2655304282720ns, next at 2646689675582ns, rc = 0 00000004:00080000:0.0:1782758586.907246:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00010000:00010000:1.0:1782758586.934606:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758587.948250:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758588.974257:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758589.356228:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758589.356248:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758589.356318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758589.356416:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211700992 00000100:00100000:3.0:1782758589.356423:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211700992 00000100:00100000:3.0:1782758589.356479:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1782758589.356488:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211700992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758589.356520:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758589.356561:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211700992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758589.356568:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1782758589.356877:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211700992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758589.357191:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1782758589.415009:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00010000:00010000:3.0:1782758589.996050:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758590.645415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758590.645450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758590.645769:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855040 00000100:00100000:0.0:1782758590.645780:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855040 00000100:00100000:0.0:1782758590.645860:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1446 00000100:00100000:0.0:1782758590.645870:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196855040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758590.645950:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196855040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758590.645959:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1446 00000100:00100000:1.0:1782758590.646049:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855296 00000100:00100000:1.0:1782758590.646054:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855296 00000100:00100000:1.0:1782758590.646092:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1483 00000100:00100000:1.0:1782758590.646099:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758590.646131:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758590.646138:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1483 00000100:00080000:0.0:1782758590.646198:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758590.671088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758590.671130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758590.671660:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855168 00000100:00100000:2.0:1782758590.671671:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855168 00000100:00100000:2.0:1782758590.671750:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1908 00000100:00100000:2.0:1782758590.671761:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196855168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758590.671861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196855168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758590.671871:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1908 00000100:00100000:2.0:1782758590.671894:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855424 00000100:00100000:2.0:1782758590.671897:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855424 00000100:00100000:2.0:1782758590.671923:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1484 00000100:00100000:2.0:1782758590.671930:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196855424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758590.671955:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196855424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758590.671961:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1484 00000100:00080000:1.0:1782758590.672866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758590.672876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758591.020307:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758591.410354:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211701376:0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.410462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758591.410557:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782758591.410563:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211701248:0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.410588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758591.410607:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211701760:0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.410632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758591.410668:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701376 00000100:00100000:1.0:1782758591.410677:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701376 00000100:00100000:1.0:1782758591.410742:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701248 00000100:00100000:1.0:1782758591.410745:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701248 00000100:00100000:1.0:1782758591.410769:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1782758591.410779:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211701376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.410888:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211701376:12345-0@lo:400:kworker.0 Request processed in 109us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758591.410897:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1782758591.410925:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1782758591.410931:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211701248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.410963:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211701248:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758591.410970:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1782758591.411234:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211701504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758591.411301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782758591.411307:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211701120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758591.411360:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211701632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758591.411407:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701760 00000100:00100000:2.0:1782758591.411411:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701760 00000100:00100000:2.0:1782758591.411445:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701504 00000100:00100000:2.0:1782758591.411448:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701504 00000100:00100000:2.0:1782758591.411479:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1782758591.411486:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211701760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411518:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211701760:12345-0@lo:400:kworker.0 Request processed in 33us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758591.411523:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1782758591.411547:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1782758591.411555:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211701504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411588:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211701504:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758591.411594:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1782758591.411612:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701120 00000100:00100000:2.0:1782758591.411615:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701120 00000100:00100000:2.0:1782758591.411639:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782758591.411645:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211701120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.411675:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211701120:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758591.411681:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782758591.411709:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701632 00000100:00100000:2.0:1782758591.411712:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701632 00000100:00100000:3.0:1782758591.411967:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211701120:0@lo:400:kworker.0 00000100:00100000:3.0:1782758591.413148:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:3.0:1782758591.413158:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084c6df80, transno 4294967371 00000100:00100000:3.0:1782758591.413185:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211701504:0@lo:400:kworker.0 00000100:00080000:3.0:1782758591.413704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758591.413710:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758591.413714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758591.419908:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1782758591.419951:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211701632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.420130:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211701632:12345-0@lo:400:kworker.0 Request processed in 204us (8746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758591.420150:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1782758591.426640:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211701248:0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.426667:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211701760:0@lo:400:kworker.0 00000100:00100000:1.0:1782758591.426681:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211701376:0@lo:400:kworker.0 00000100:00100000:3.0:1782758591.427076:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211701632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758591.916356:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211701888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758591.916452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758591.916594:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211701888 00000100:00100000:3.0:1782758591.916612:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211701888 00000100:00100000:3.0:1782758591.916670:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1782758591.916679:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211701888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758591.916726:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758591.916786:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211701888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758591.916806:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1782758591.918042:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211701888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758592.047379:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758593.068996:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758594.093124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758594.479035:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758594.479055:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211702016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758594.479135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758594.479200:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702016 00000100:00100000:3.0:1782758594.479210:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702016 00000100:00100000:3.0:1782758594.479277:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1782758594.479289:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211702016:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758594.479298:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782758594.479326:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758594.479387:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211702016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758594.479395:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1782758594.479726:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211702016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758595.116727:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758595.764510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758595.764558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758595.764593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758595.764693:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855552 00000100:00100000:0.0:1782758595.764704:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855552 00000100:00100000:3.0:1782758595.764707:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855808 00000100:00100000:3.0:1782758595.764711:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855808 00000100:00100000:1.0:1782758595.764715:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855680 00000100:00100000:1.0:1782758595.764722:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855680 00000100:00100000:3.0:1782758595.764756:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1487 00000100:00100000:0.0:1782758595.764757:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1448 00000100:00100000:3.0:1782758595.764769:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758595.764769:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196855552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758595.764772:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1912 00000100:00100000:1.0:1782758595.764785:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196855680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758595.764902:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196855552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758595.764910:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1448 00000100:00100000:1.0:1782758595.770076:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196855680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5216us (5405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758595.770092:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1912 00000100:00080000:1.0:1782758595.770167:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758595.770173:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758595.773181:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 8400us (8606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758595.773198:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1487 00000100:00100000:0.0:1782758595.780644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758595.781706:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196855936 00000100:00100000:3.0:1782758595.781732:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196855936 00000100:00100000:3.0:1782758595.781841:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1488 00000100:00100000:3.0:1782758595.781854:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758595.781934:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196855936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758595.781942:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1488 00000100:00080000:1.0:1782758595.782115:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758596.140102:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758596.524383:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211702528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758596.524477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758596.524551:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758596.524558:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211702144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758596.524587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758596.524609:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211702656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758596.524634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758596.524757:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702528 00000100:00100000:2.0:1782758596.524765:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702528 00000100:00100000:2.0:1782758596.524851:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:2.0:1782758596.524861:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758596.524913:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211702528:12345-0@lo:400:kworker.0 Request processed in 54us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758596.524920:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1782758596.525274:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211702272:0@lo:400:kworker.0 00000100:00100000:1.0:1782758596.525304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758596.525335:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211702784:0@lo:400:kworker.0 00000100:00100000:1.0:1782758596.525369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758596.525398:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758596.525405:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211702400:0@lo:400:kworker.0 00000100:00100000:1.0:1782758596.525428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758596.525648:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702144 00000100:00100000:3.0:1782758596.525653:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702144 00000100:00100000:3.0:1782758596.525693:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1782758596.525701:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211702144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.525738:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211702144:12345-0@lo:400:kworker.0 Request processed in 38us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758596.525809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1782758596.525870:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702656 00000100:00100000:3.0:1782758596.525874:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702656 00000100:00100000:3.0:1782758596.525899:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702272 00000100:00100000:3.0:1782758596.525902:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702272 00000100:00100000:3.0:1782758596.525916:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702400 00000100:00100000:3.0:1782758596.525918:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702400 00000100:00100000:3.0:1782758596.525932:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1782758596.525938:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211702656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.525969:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211702656:12345-0@lo:400:kworker.0 Request processed in 31us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758596.525975:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1782758596.525985:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1782758596.525990:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211702272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.526022:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211702272:12345-0@lo:400:kworker.0 Request processed in 31us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758596.526027:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1782758596.526049:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1782758596.526055:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.526083:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211702400:12345-0@lo:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758596.526088:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1782758596.526125:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211702400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.526136:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211702272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.526162:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702784 00000100:00100000:3.0:1782758596.526165:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702784 00000100:00100000:3.0:1782758596.526189:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1782758596.526195:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211702784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758596.526231:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211702784:12345-0@lo:400:kworker.0 Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758596.526237:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1782758596.526260:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211702784:0@lo:400:kworker.0 00000100:00080000:0.0:1782758596.526561:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758596.526566:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758596.526568:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758596.526588:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211702144:0@lo:400:kworker.0 00000100:00100000:0.0:1782758596.526600:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211702656:0@lo:400:kworker.0 00000100:00100000:0.0:1782758596.526609:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211702528:0@lo:400:kworker.0 00000100:00100000:1.0:1782758597.036055:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758597.042527:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211702912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758597.042604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758597.046190:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211702912 00000100:00100000:2.0:1782758597.046656:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211702912 00000100:00100000:2.0:1782758597.046754:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1782758597.046764:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211702912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758597.046803:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758597.046914:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211702912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (4309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758597.046921:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1782758597.047100:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211702912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758597.164046:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758598.188182:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758599.212021:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758599.596370:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758599.596393:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211703040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758599.596479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758599.596721:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703040 00000100:00100000:3.0:1782758599.596730:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703040 00000100:00100000:3.0:1782758599.596800:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1782758599.596810:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211703040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758599.596865:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758599.596910:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211703040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758599.596918:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00080000:2.0:1782758599.598924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758599.598989:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211703040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758600.236719:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758600.887511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758600.887557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758600.887596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758600.887638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758600.887718:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856448 00000100:00100000:0.0:1782758600.887730:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856448 00000100:00100000:0.0:1782758600.887795:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856320 00000100:00100000:0.0:1782758600.887798:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856320 00000100:00100000:0.0:1782758600.887863:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1491 00000100:00100000:0.0:1782758600.887876:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196856448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758600.887962:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196856448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758600.887969:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1491 00000100:00100000:0.0:1782758600.887985:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1492 00000100:00100000:0.0:1782758600.887991:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196856320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758600.888015:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196856320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758600.888021:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1492 00000100:00080000:2.0:1782758600.888360:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758600.888365:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758600.889987:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856064 00000100:00100000:1.0:1782758600.889998:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856064 00000100:00100000:1.0:1782758600.890069:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1450 00000100:00100000:1.0:1782758600.890079:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196856064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758600.890152:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196856064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758600.890160:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1450 00000100:00100000:3.0:1782758600.890498:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856192 00000100:00100000:3.0:1782758600.890503:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856192 00000100:00100000:3.0:1782758600.890556:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1916 00000100:00100000:3.0:1782758600.890563:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196856192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758600.890619:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196856192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758600.890625:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1916 00000100:00080000:2.0:1782758600.891726:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758601.263407:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758601.644469:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211703296:0@lo:400:kworker.0 00000100:00100000:3.0:1782758601.644539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758601.644594:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211703808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758601.644619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758601.644711:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211703552:0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.645366:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703296 00000100:00100000:2.0:1782758601.645375:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703296 00000100:00100000:3.0:1782758601.646124:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758601.646136:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211703424:0@lo:400:kworker.0 00000100:00100000:3.0:1782758601.646180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758601.649917:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703808 00000100:00100000:0.0:1782758601.649931:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703808 00000100:00100000:0.0:1782758601.650011:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1782758601.650022:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211703808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758601.650126:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211703808:12345-0@lo:400:kworker.0 Request processed in 106us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758601.650133:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00080000:0.0:1782758601.650157:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758601.650707:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211703168:0@lo:400:kworker.0 00000100:00100000:0.0:1782758601.650754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758601.650787:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211703680:0@lo:400:kworker.0 00000100:00100000:1.0:1782758601.651618:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703168 00000100:00100000:1.0:1782758601.651625:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703168 00000100:00100000:1.0:1782758601.651677:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1782758601.651686:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211703168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758601.651742:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211703168:12345-0@lo:400:kworker.0 Request processed in 56us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758601.651749:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1782758601.651799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758601.651862:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703552 00000100:00100000:1.0:1782758601.651866:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703552 00000100:00100000:1.0:1782758601.651900:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1782758601.651906:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211703552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758601.651956:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211703552:12345-0@lo:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758601.651962:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00080000:1.0:1782758601.651979:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758601.652006:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211703552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758601.665953:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211703808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.670441:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703424 00000100:00100000:2.0:1782758601.670459:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703424 00000100:00100000:2.0:1782758601.670543:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1782758601.670553:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211703296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.670647:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211703296:12345-0@lo:400:kworker.0 Request processed in 95us (26107us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758601.670654:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1782758601.670671:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1782758601.670677:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211703424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.670704:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211703424:12345-0@lo:400:kworker.0 Request processed in 27us (24524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758601.670709:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00080000:3.0:1782758601.671037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758601.671077:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211703424:0@lo:400:kworker.0 00000100:00100000:3.0:1782758601.671091:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211703296:0@lo:400:kworker.0 00000100:00100000:1.0:1782758601.678115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758601.678206:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211703168:0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.678501:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703680 00000100:00100000:2.0:1782758601.678509:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703680 00000100:00100000:2.0:1782758601.678577:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1782758601.678587:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211703680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758601.678661:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211703680:12345-0@lo:400:kworker.0 Request processed in 76us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758601.678669:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00080000:3.0:1782758601.678728:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758601.683319:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211703680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758602.156296:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758602.156320:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211703936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758602.156397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758602.156654:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211703936 00000100:00100000:2.0:1782758602.156675:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211703936 00000100:00100000:2.0:1782758602.156721:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1782758602.156730:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211703936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758602.156771:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758602.156846:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211703936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758602.156852:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1782758602.157011:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211703936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758602.285405:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758603.308591:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758603.352573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758603.352680:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856576 00000100:00100000:3.0:1782758603.352695:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856576 00000100:00100000:3.0:1782758603.352918:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00100000:3.0:1782758603.352933:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196856576:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758603.353063:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196856576:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 133us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758603.353071:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1179 00000100:00080000:1.0:1782758603.353428:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758603.358358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758603.358459:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856704 00000100:00100000:2.0:1782758603.358473:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856704 00000100:00100000:2.0:1782758603.358595:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 655 00000100:00100000:2.0:1782758603.358608:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196856704:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758603.359598:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196856704:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 987us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758603.359609:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 655 00000100:00080000:1.0:1782758603.360154:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758603.361391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758603.361613:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856832 00000100:00100000:1.0:1782758603.361625:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856832 00000100:00100000:1.0:1782758603.361740:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 656 00000100:00100000:1.0:1782758603.361753:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196856832:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758603.362369:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196856832:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 617us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758603.362379:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 656 00000100:00080000:3.0:1782758603.362866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758603.364967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758603.365273:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196856960 00000100:00100000:0.0:1782758603.365286:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196856960 00000100:00100000:0.0:1782758603.365361:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1180 00000100:00100000:0.0:1782758603.365373:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196856960:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758603.365977:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196856960:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 603us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758603.365986:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1180 00000100:00100000:3.0:1782758603.369402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758603.369795:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857088 00000100:00100000:0.0:1782758603.369808:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857088 00000100:00100000:0.0:1782758603.369897:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1181 00000100:00100000:0.0:1782758603.369918:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196857088:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758603.370049:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196857088:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 133us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758603.370057:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1181 00000100:00100000:1.0:1782758603.377715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758603.377789:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857216 00000100:00100000:1.0:1782758603.377802:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857216 00000100:00100000:1.0:1782758603.377877:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 657 00000100:00100000:1.0:1782758603.377889:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196857216:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758603.379611:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196857216:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 1718us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758603.379625:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 657 00000100:00100000:0.0:1782758603.394974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758603.395121:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857344 00000100:00100000:1.0:1782758603.395137:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857344 00000100:00100000:1.0:1782758603.395216:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 658 00000100:00100000:1.0:1782758603.395228:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196857344:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758603.396017:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58412:x1869355196857344:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 787us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758603.396027:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 658 00000100:00100000:1.0:1782758603.415060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758603.415148:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857472 00000100:00100000:3.0:1782758603.415160:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857472 00000100:00100000:0.0:1782758603.415260:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1182 00000100:00100000:0.0:1782758603.415276:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196857472:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758603.416048:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58412:x1869355196857472:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 774us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758603.416058:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1182 00000100:00100000:3.0:1782758603.474241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758603.474294:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857600 00000100:00100000:3.0:1782758603.474306:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857600 00000100:00100000:3.0:1782758603.474378:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:3.0:1782758603.474390:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58413:x1869355196857600:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758603.474420:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758603.474446:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbdc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e65 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.474528:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.478978:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.479025:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758603.479366:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1782758603.479373:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758603.479499:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.480655:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbdc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e65 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.480689:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e65 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758603.480700:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1300) 00010000:00010000:3.0:1782758603.480703:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758603.480708:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758603.482049:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58413:x1869355196857600:12345-192.168.204.31@tcp:101:rm.0 Request processed in 7646us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758603.482067:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1183 00000100:00100000:3.0:1782758603.491578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758603.495042:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857856 00000100:00100000:2.0:1782758603.495062:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857856 00000100:00100000:2.0:1782758603.495144:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1184 00000100:00100000:2.0:1782758603.495157:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58413:x1869355196857856:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758603.495186:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758603.495213:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e6c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758603.495549:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00010000:2.0:1782758603.495805:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e6c expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758603.495850:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782758603.495854:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782758603.495861:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbdd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e6c expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758603.495889:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758603.496001:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58413:x1869355196857856:12345-192.168.204.31@tcp:101:rm.0 Request processed in 846us (4437us total) trans 4294967751 rc 301/301 00000100:00100000:2.0:1782758603.496009:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1184 00000100:00100000:2.0:1782758603.507666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758603.507755:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196857984 00000100:00100000:0.0:1782758603.507779:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196857984 00000100:00100000:0.0:1782758603.507890:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:0.0:1782758603.507913:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58413:x1869355196857984:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:0.0:1782758603.516162:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58413:x1869355196857984:12345-192.168.204.31@tcp:37:rm.0 Request processed in 8247us (8491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758603.516182:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1782758603.531263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758603.532102:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196858240 00000100:00100000:3.0:1782758603.532115:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196858240 00000100:00100000:3.0:1782758603.532180:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:3.0:1782758603.532191:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58413:x1869355196858240:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:3.0:1782758603.532911:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58413:x1869355196858240:12345-192.168.204.31@tcp:35:rm.0 Request processed in 707us (1654us total) trans 4294967752 rc 0/0 00000100:00100000:3.0:1782758603.532922:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:3.0:1782758603.537344:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758603.537818:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196858496 00000100:00100000:0.0:1782758603.538051:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196858496 00000100:00100000:0.0:1782758603.538134:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1185 00000100:00100000:0.0:1782758603.538148:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58413:x1869355196858496:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758603.538815:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782758603.539155:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbdcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e65 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539259:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbd70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e50 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539277:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782758603.539302:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dba7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64d9a expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539314:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:0.0:1782758603.539327:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758603.539365:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539382:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539393:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539408:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539415:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.539423:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.541765:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.541789:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.541804:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758603.544152:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00010000:0.0:1782758603.544243:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544256:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544265:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544271:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758603.544277:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544292:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544312:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758603.544315:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758603.544320:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544327:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbdee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544358:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544364:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544371:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544376:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758603.544379:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544384:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544391:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdb00) 00010000:00010000:0.0:1782758603.544393:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758603.544396:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.544406:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dbde0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758603.544417:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070ed1548 reply state 000000004a2a6030 transno 4294967753 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758603.544426:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758603.544565:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58413:x1869355196858496:12345-192.168.204.31@tcp:36:rm.0 Request processed in 6414us (7229us total) trans 4294967753 rc 0/0 00000100:00100000:0.0:1782758603.544578:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1185 00010000:00010000:0.0:1782758603.551561:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551582:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551592:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551600:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758603.551607:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551618:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551643:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfd000) 00010000:00010000:0.0:1782758603.551648:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758603.551653:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758603.551666:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbde7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758604.338089:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758604.726389:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758604.726412:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211704064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758604.726481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758604.726536:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704064 00000100:00100000:3.0:1782758604.726545:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704064 00000100:00100000:3.0:1782758604.726600:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1782758604.726610:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211704064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758604.726647:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758604.726694:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211704064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758604.726702:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:3.0:1782758604.726721:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758604.726751:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211704064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758605.360415:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758606.009029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758606.009090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758606.009153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758606.009171:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859008 00000100:00100000:2.0:1782758606.009188:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859008 00000100:00100000:0.0:1782758606.009201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758606.009243:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196858624 00000100:00100000:0.0:1782758606.009251:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196858624 00000100:00100000:2.0:1782758606.009276:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196858880 00000100:00100000:2.0:1782758606.009282:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196858880 00000100:00100000:0.0:1782758606.009314:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1452 00000100:00100000:2.0:1782758606.009334:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1495 00000100:00100000:0.0:1782758606.009335:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196858624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758606.009357:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196859008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758606.009448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196858624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758606.009457:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196859008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758606.009468:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1452 00000100:00100000:2.0:1782758606.009477:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1495 00000100:00100000:2.0:1782758606.009496:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1496 00000100:00100000:2.0:1782758606.009504:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196858880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758606.009530:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196858880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758606.009535:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1496 00000100:00080000:2.0:1782758606.009555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758606.009558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758606.009868:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196858752 00000100:00100000:3.0:1782758606.009875:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196858752 00000100:00100000:3.0:1782758606.009940:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1920 00000100:00100000:3.0:1782758606.009952:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196858752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758606.010011:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196858752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 63us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758606.010019:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1920 00000100:00080000:2.0:1782758606.011549:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758606.380744:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758606.768769:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211704192:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.768862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.768919:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211704704:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.768948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.768975:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758606.768980:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211704576:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.769005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.769035:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211704320:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.769058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.769075:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211704832:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.769097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.769114:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758606.769119:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211704448:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.769140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758606.769171:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704192 00000100:00100000:3.0:1782758606.769178:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704192 00000100:00100000:3.0:1782758606.769223:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1782758606.769232:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211704192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.769284:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211704192:12345-0@lo:400:kworker.0 Request processed in 53us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758606.769292:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1782758606.769326:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704704 00000100:00100000:3.0:1782758606.769330:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704704 00000100:00100000:3.0:1782758606.769360:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704320 00000100:00100000:3.0:1782758606.769363:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704320 00000100:00100000:3.0:1782758606.769379:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704448 00000100:00100000:3.0:1782758606.769381:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704448 00000100:00100000:3.0:1782758606.769820:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1782758606.769862:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211704704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758606.769991:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:0.0:1782758606.770001:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211704320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758606.770048:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211704320:12345-0@lo:400:kworker.0 Request processed in 50us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758606.770054:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:0.0:1782758606.770070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1782758606.770077:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211704448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758606.770105:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211704448:12345-0@lo:400:kworker.0 Request processed in 30us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758606.770111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1782758606.770145:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211704448:0@lo:400:kworker.0 00000100:00100000:0.0:1782758606.770156:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211704320:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.771552:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211704704:12345-0@lo:400:kworker.0 Request processed in 1686us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758606.771564:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1782758606.771597:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704576 00000100:00100000:3.0:1782758606.771603:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704576 00000100:00100000:3.0:1782758606.771641:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704832 00000100:00100000:3.0:1782758606.771644:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704832 00000100:00100000:3.0:1782758606.771667:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1782758606.771674:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211704576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.771718:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211704576:12345-0@lo:400:kworker.0 Request processed in 45us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758606.771724:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1782758606.771735:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1782758606.771951:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211704832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.771999:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211704832:12345-0@lo:400:kworker.0 Request processed in 257us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758606.772006:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00080000:3.0:1782758606.772036:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758606.772040:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758606.772042:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758606.772077:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211704576:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.772089:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211704192:0@lo:400:kworker.0 00000100:00100000:3.0:1782758606.772101:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211704704:0@lo:400:kworker.0 00000100:00100000:0.0:1782758606.772198:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211704832:0@lo:400:kworker.0 00000020:00000080:1.0:1782758607.097918:0:99537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde2529a90 20000000:00000080:1.0:1782758607.097938:0:99537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf5a000 uarg=0000000000000000 00010000:00010000:1.0:1782758607.098465:0:99537:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758607.098480:0:99537:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758607.098496:0:99537:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758607.098515:0:99537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.098532:0:99537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.098540:0:99537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.098574:0:99537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.098586:0:99537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 18 pid: 5796 timeout: 2775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758607.098603:0:99537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99537:1869355211704960:0@lo:104: 00000100:00100000:1.0:1782758607.098664:0:99537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758607.098712:0:99537:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708132c180 going to sleep for 11 seconds 00000100:00100000:0.0:1782758607.098854:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211704960 00000100:00100000:0.0:1782758607.098862:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211704960 00000100:00100000:0.0:1782758607.098910:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1782758607.098920:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:99537:x1869355211704960:12345-0@lo:104: 00010000:00010000:0.0:1782758607.098932:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758607.099474:0:99537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99537:1869355211704960:0@lo:104: 00010000:00010000:1.0:1782758607.099493:0:99537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758607.099727:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758607.099735:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:99537:x1869355211704960:12345-0@lo:104: Request processed in 817us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758607.099745:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:3.0:1782758607.099792:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758607.099801:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.099809:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758607.099813:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.100150:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758607.100160:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758607.100167:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758607.100241:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.100248:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782758607.100300:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211705088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758607.100348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758607.100417:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705088 00000100:00100000:1.0:1782758607.100423:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705088 00010000:00010000:1.0:1782758607.100446:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 2775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758607.100470:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1782758607.100477:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211705088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758607.100489:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758607.100494:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 2775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100505:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 2775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100520:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dba6e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dba67 expref: 19 pid: 5796 timeout: 2775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100534:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100542:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100557:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100565:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100571:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100578:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100583:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758607.100588:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100595:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100608:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.100616:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758607.100666:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.100674:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dba67 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dba6e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.100688:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758607.100690:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758607.100703:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758607.105282:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211705088:12345-0@lo:103:ldlm_bl.0 Request processed in 4792us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758607.105299:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:1.0:1782758607.105347:0:99537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.105360:0:99537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758607.105368:0:99537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dbdf5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758607.108008:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211705088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758607.276909:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211705216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758607.276981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758607.277054:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705216 00000100:00100000:3.0:1782758607.277062:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705216 00000100:00100000:3.0:1782758607.277101:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1782758607.277110:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211705216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758607.279355:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758607.279448:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211705216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2336us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758607.279458:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1782758607.279530:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211705216:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1782758607.347602:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967753 is committed 00010000:00010000:1.0:1782758607.404075:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758607.983283:0:99586:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc87ee6220 20000000:00000080:3.0:1782758607.983302:0:99586:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a2800 uarg=0000000000000000 00010000:00010000:3.0:1782758607.984043:0:99586:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758607.984063:0:99586:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758607.984078:0:99586:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758607.984099:0:99586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984115:0:99586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984126:0:99586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984202:0:99586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984210:0:99586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984218:0:99586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984226:0:99586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758607.984231:0:99586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984240:0:99586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984254:0:99586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984262:0:99586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758607.984270:0:99586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690400/0xdd99f5c4777dbdfc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758608.430673:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758608.430682:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758608.430687:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758608.430735:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.430748:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.430759:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758608.430784:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211705344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758608.430886:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758608.430937:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758608.430958:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705344 00000100:00100000:0.0:1782758608.430965:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705344 00000100:00100000:0.0:1782758608.431013:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1782758608.431022:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211705344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758608.431036:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758608.431047:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dbe03 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.431071:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.431081:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.431090:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50400, rc 0) 00000100:00100000:0.0:1782758608.431128:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211705344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758608.431136:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1782758608.431178:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211705344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758608.431195:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.431204:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758608.431223:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758608.431228:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758608.431234:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758608.431296:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758609.452118:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758609.836797:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211705472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758609.836890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758609.836961:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705472 00000100:00100000:2.0:1782758609.836969:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705472 00000100:00100000:2.0:1782758609.837021:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1782758609.837033:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211705472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758609.837070:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758609.837130:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211705472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758609.837138:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00080000:2.0:1782758609.837160:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758609.837195:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211705472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758610.476004:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758610.974004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758610.974131:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859136 00000100:00100000:0.0:1782758610.974142:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859136 00000100:00100000:0.0:1782758610.974217:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1186 00000100:00100000:0.0:1782758610.974231:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58527:x1869355196859136:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758610.974252:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758610.974287:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e73 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974347:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974360:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974371:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758610.974579:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758610.974583:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758610.974665:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974689:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e73 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974706:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e73 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758610.974727:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758610.974731:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758610.974734:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758610.974805:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58527:x1869355196859136:12345-192.168.204.31@tcp:101:rm.0 Request processed in 578us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758610.974811:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1186 00000100:00080000:3.0:1782758610.975498:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758610.980512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758610.982366:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859264 00000100:00100000:3.0:1782758610.982383:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859264 00000100:00100000:3.0:1782758610.982572:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1187 00000100:00100000:3.0:1782758610.982582:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58527:x1869355196859264:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782758610.982605:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758610.982627:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e7a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982688:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982706:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982730:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982744:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982760:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.982767:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983093:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983102:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983110:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983117:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758610.983123:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983130:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983144:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:3.0:1782758610.983147:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758610.983151:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983157:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbe26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983169:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983174:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983179:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983183:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758610.983185:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983191:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983197:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75d00) 00010000:00010000:3.0:1782758610.983200:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758610.983202:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983207:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983238:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e7a expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983254:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:3.0:1782758610.983257:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758610.983272:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e7a expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758610.983283:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758610.983359:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58527:x1869355196859264:12345-192.168.204.31@tcp:101:rm.0 Request processed in 778us (2856us total) trans 0 rc 301/301 00000100:00100000:3.0:1782758610.983367:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1187 00000100:00100000:2.0:1782758611.037506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758611.037553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.037617:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859392 00000100:00100000:0.0:1782758611.037629:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859392 00000100:00100000:3.0:1782758611.037635:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859648 00000100:00100000:3.0:1782758611.037642:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859648 00000100:00100000:0.0:1782758611.037779:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1188 00000100:00100000:0.0:1782758611.037791:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196859392:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782758611.037882:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782758611.037968:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196859392:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 179us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.037975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1188 00000100:00100000:0.0:1782758611.037993:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1189 00000100:00100000:0.0:1782758611.038001:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58531:x1869355196859648:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782758611.038037:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758611.038060:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e73 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038089:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758611.038098:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758611.038406:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038430:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038439:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038451:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038458:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.038464:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758611.040869:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 512 00010000:00010000:0.0:1782758611.040888:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040897:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040905:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040910:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758611.040916:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040924:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040939:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91718bcfda00) 00010000:00010000:0.0:1782758611.040941:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758611.040957:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.040964:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe34 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758611.040982:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c3241f0d reply state 000000002df4ca78 transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758611.040991:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758611.041081:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58531:x1869355196859648:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 3077us (3523us total) trans 4294967754 rc 0/0 00000100:00100000:0.0:1782758611.041089:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1189 00010000:00010000:3.0:1782758611.051682:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051702:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051710:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051725:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758611.051730:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051738:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051765:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfde00) 00010000:00010000:3.0:1782758611.051769:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758611.051774:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.051780:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dbe3b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758611.104008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758611.104616:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859776 00000100:00100000:3.0:1782758611.104627:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859776 00000100:00100000:3.0:1782758611.104683:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1190 00000100:00100000:3.0:1782758611.104694:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58535:x1869355196859776:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782758611.108604:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758611.108644:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e81 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108723:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108739:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108763:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758611.108848:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758611.108852:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758611.108879:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108908:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e81 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108935:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e81 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.108944:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782758611.108948:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758611.108952:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758611.109030:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58535:x1869355196859776:12345-192.168.204.31@tcp:101:chown.0 Request processed in 4336us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758611.109040:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1190 00000100:00100000:2.0:1782758611.114504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.114602:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196859904 00000100:00100000:0.0:1782758611.114612:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196859904 00000100:00100000:0.0:1782758611.114678:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00100000:0.0:1782758611.114689:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58535:x1869355196859904:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782758611.114714:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758611.114734:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e88 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114808:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114857:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114870:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114886:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114893:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.114900:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115019:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115027:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115034:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758611.115087:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 512 00000004:00200000:0.0:1782758611.115091:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758611.115114:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115126:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115137:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115144:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115150:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758611.115155:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115163:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115175:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75d00) 00010000:00010000:0.0:1782758611.115178:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758611.115182:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115188:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50600/0xdd99f5c4777dbe57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115202:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115207:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115213:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115218:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758611.115221:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115227:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115234:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfda00) 00010000:00010000:0.0:1782758611.115236:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758611.115239:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115244:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dbe5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115272:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dbe50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e88 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115284:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e88 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.115291:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758611.115293:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758611.115295:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758611.115356:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58535:x1869355196859904:12345-192.168.204.31@tcp:101:chown.0 Request processed in 668us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.115364:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1191 00000100:00100000:2.0:1782758611.119961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.120164:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860160 00000100:00100000:0.0:1782758611.120174:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860160 00000100:00100000:0.0:1782758611.120231:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1192 00000100:00100000:0.0:1782758611.120241:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58535:x1869355196860160:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:0.0:1782758611.120287:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758611.120314:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dbe65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e88 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.120333:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfdd00) 00010000:00010000:0.0:1782758611.120344:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758611.120368:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.120381:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758611.120389:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758611.129328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.129369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.129397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758611.129425:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860416 00000100:00100000:0.0:1782758611.129434:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860416 00000100:00100000:0.0:1782758611.129481:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860544 00000100:00100000:0.0:1782758611.129484:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860544 00000100:00100000:0.0:1782758611.129504:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1499 00000100:00100000:0.0:1782758611.129515:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758611.129589:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.129598:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1499 00000100:00100000:0.0:1782758611.129614:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1500 00000100:00100000:0.0:1782758611.129622:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758611.129650:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.129656:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1500 00000100:00100000:0.0:1782758611.129672:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860288 00000100:00100000:0.0:1782758611.129676:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860288 00000100:00100000:0.0:1782758611.129700:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1455 00000100:00100000:0.0:1782758611.129706:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196860288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758611.129759:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196860288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.129767:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1455 00000100:00080000:0.0:1782758611.129804:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758611.129808:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782758611.184879:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967755 is committed 00000004:00010000:0.0:1782758611.185514:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087de43f1 reply state 00000000ebfcc31a transno 4294967755 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758611.185530:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758611.185840:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:0.0:1782758611.185990:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782758611.186020:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58535:x1869355196860160:12345-192.168.204.31@tcp:36:chown.0 Request processed in 65775us (66072us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1782758611.186028:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1192 00010000:00010000:3.0:1782758611.186116:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186136:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186143:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186148:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758611.186153:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186161:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186176:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:3.0:1782758611.186179:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758611.186183:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758611.186189:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dbe6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758611.505568:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758611.884358:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211705728:0@lo:400:kworker.0 00000100:00100000:1.0:1782758611.884435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758611.884493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758611.884500:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211705600:0@lo:400:kworker.0 00000100:00100000:1.0:1782758611.884529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758611.884567:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705728 00000100:00100000:1.0:1782758611.884575:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705728 00000100:00100000:1.0:1782758611.884621:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1782758611.884630:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758611.884684:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211705728:12345-0@lo:400:kworker.0 Request processed in 55us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758611.884692:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1782758611.884720:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705600 00000100:00100000:1.0:1782758611.884726:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705600 00000100:00100000:1.0:1782758611.884760:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1782758611.884767:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211705600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758611.884804:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211705600:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758611.884809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1782758611.884883:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211705600:0@lo:400:kworker.0 00000100:00100000:1.0:1782758611.884898:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211705728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.885223:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211705856:0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.885255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758611.885280:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758611.885287:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211705984:0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.885314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758611.885345:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705856 00000100:00100000:3.0:1782758611.885349:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705856 00000100:00100000:3.0:1782758611.885388:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1782758611.885396:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211705856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.885437:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211705856:12345-0@lo:400:kworker.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758611.885443:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1782758611.885465:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211705984 00000100:00100000:3.0:1782758611.885468:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211705984 00000100:00100000:0.0:1782758611.885835:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211706112:0@lo:400:kworker.0 00000100:00100000:0.0:1782758611.885869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758611.885892:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758611.885898:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211706240:0@lo:400:kworker.0 00000100:00100000:0.0:1782758611.885920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758611.885944:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706112 00000100:00100000:0.0:1782758611.885949:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706112 00000100:00100000:0.0:1782758611.885976:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:0.0:1782758611.885982:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758611.886020:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211706112:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758611.886028:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706240 00000100:00100000:0.0:1782758611.886029:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1782758611.886035:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706240 00000100:00100000:0.0:1782758611.886056:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1782758611.886064:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211705984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758611.886094:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211705984:12345-0@lo:400:kworker.0 Request processed in 31us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758611.886100:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1782758611.886129:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211706112:0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.886165:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1782758611.886173:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211706240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.886322:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211706240:12345-0@lo:400:kworker.0 Request processed in 149us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758611.886330:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00080000:3.0:1782758611.886347:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758611.886351:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758611.886353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758611.886432:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211705984:0@lo:400:kworker.0 00000100:00100000:3.0:1782758611.886442:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211705856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758611.890427:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211706240:0@lo:400:kworker.0 00000020:00000080:3.0:1782758612.085799:0:99782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5863a4d0 20000000:00000080:3.0:1782758612.085818:0:99782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317d000 uarg=0000000000000000 00010000:00010000:3.0:1782758612.086805:0:99782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782758612.086873:0:99782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75d00) 00010000:00010000:3.0:1782758612.086878:0:99782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758612.086890:0:99782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e81 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.086913:0:99782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782758612.086929:0:99782:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758612.086943:0:99782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.086956:0:99782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.086963:0:99782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.087000:0:99782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.087015:0:99782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 18 pid: 5796 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758612.087031:0:99782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99782:1869355211706368:0@lo:104: 00000100:00100000:3.0:1782758612.088383:0:99782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758612.088453:0:99782:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193cd9600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758612.088692:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706368 00000100:00100000:0.0:1782758612.088701:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706368 00000100:00100000:0.0:1782758612.088760:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782758612.088769:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:99782:x1869355211706368:12345-0@lo:104: 00010000:00010000:0.0:1782758612.088786:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758612.088885:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758612.088892:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:99782:x1869355211706368:12345-0@lo:104: Request processed in 125us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758612.088898:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:1.0:1782758612.088957:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758612.088964:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.088972:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758612.088976:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.088985:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758612.088992:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758612.088997:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758612.089035:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089041:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758612.089071:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089079:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dbe03 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089095:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758612.089096:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758612.089098:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758612.089111:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211706496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758612.089143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758612.089183:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706496 00000100:00100000:1.0:1782758612.089187:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706496 00010000:00010000:1.0:1782758612.089217:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 19 pid: 5796 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758612.089237:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1782758612.089243:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211706496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758612.089254:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758612.089259:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 19 pid: 5796 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089268:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 19 pid: 5796 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089285:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089293:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089307:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089314:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089321:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089332:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089337:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758612.089342:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089349:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089357:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758612.089368:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758612.089395:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211706496:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758612.089401:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1782758612.089446:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211706496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758612.090347:0:99782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dbe0a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dbe03 expref: 18 pid: 5796 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758612.090363:0:99782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99782:1869355211706368:0@lo:104: 00010000:00010000:3.0:1782758612.090378:0:99782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.090387:0:99782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.090394:0:99782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.090400:0:99782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe73 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758612.396301:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211706624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758612.396375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758612.396504:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706624 00000100:00100000:2.0:1782758612.396512:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706624 00000100:00100000:2.0:1782758612.396565:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1782758612.396574:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211706624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758612.396610:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758612.399694:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211706624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3111us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758612.399710:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1782758612.404335:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211706624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758612.532517:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758612.953445:0:99830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff92b41e40 20000000:00000080:3.0:1782758612.953464:0:99830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317ec00 uarg=0000000000000000 00010000:00010000:3.0:1782758612.953691:0:99830:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758612.953708:0:99830:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758612.953736:0:99830:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758612.953757:0:99830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953773:0:99830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953783:0:99830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953791:0:99830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953798:0:99830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953805:0:99830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953811:0:99830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758612.953816:0:99830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953850:0:99830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953863:0:99830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953871:0:99830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758612.953877:0:99830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dbe7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758613.548439:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758613.739969:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758613.739977:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758613.739983:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758613.740032:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758613.740045:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758613.740056:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758613.740080:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211706752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758613.740149:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758613.740263:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782758613.744151:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706752 00000100:00100000:2.0:1782758613.744165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706752 00000100:00100000:2.0:1782758613.744365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1782758613.744376:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211706752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758613.744392:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758613.744411:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dbe81 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758613.744439:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758613.744451:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758613.744460:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694600, rc 0) 00000100:00100000:2.0:1782758613.744541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211706752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758613.744548:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1782758613.744629:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211706752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758613.744648:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758613.744659:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758613.744683:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758613.744689:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758613.744710:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758614.575412:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758614.957018:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211706880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758614.957087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758614.957443:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211706880 00000100:00100000:2.0:1782758614.957452:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211706880 00000100:00100000:2.0:1782758614.957499:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1782758614.957509:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211706880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758614.957540:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758614.957586:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211706880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758614.957595:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00080000:2.0:1782758614.957614:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758614.957651:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211706880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758615.599760:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758616.202368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758616.202501:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860672 00000100:00100000:2.0:1782758616.202512:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860672 00000100:00100000:2.0:1782758616.202598:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:2.0:1782758616.202609:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196860672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758616.202625:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758616.202628:0:5785:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dbe49) 00010000:00010000:2.0:1782758616.202630:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758616.202694:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:5583:x1869355196860672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (334us total) trans 0 rc 116/116 00000100:00100000:2.0:1782758616.202702:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00080000:0.0:1782758616.203606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758616.244003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758616.244050:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758616.244089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758616.244139:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861056 00000100:00100000:3.0:1782758616.244149:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861056 00000100:00080000:0.0:1782758616.244200:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758616.244211:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860928 00000100:00100000:3.0:1782758616.244214:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860928 00000100:00100000:3.0:1782758616.244246:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1503 00000100:00100000:3.0:1782758616.244314:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196861056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758616.244386:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196861056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758616.244438:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196860800 00000100:00100000:1.0:1782758616.244443:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196860800 00000100:00100000:1.0:1782758616.244472:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1458 00000100:00100000:1.0:1782758616.244479:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196860800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758616.244507:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196860800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758616.244514:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1458 00000100:00080000:1.0:1782758616.244555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758616.248114:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1504 00000100:00100000:0.0:1782758616.248177:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758616.248263:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196860928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 135us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758616.248271:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1504 00000100:00100000:3.0:1782758616.250162:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1503 00010000:00010000:1.0:1782758616.620116:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758617.019299:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211707392:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019436:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758617.019443:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211707008:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019499:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211707520:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019554:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211707264:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019608:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782758617.019613:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211707136:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019661:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211707648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758617.019713:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707392 00000100:00100000:1.0:1782758617.019721:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707392 00000100:00100000:1.0:1782758617.019769:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707648 00000100:00100000:1.0:1782758617.019772:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707648 00000100:00100000:1.0:1782758617.019793:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:1.0:1782758617.019801:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211707392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.019891:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211707392:12345-0@lo:400:kworker.0 Request processed in 90us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.019899:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:1.0:1782758617.019918:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1782758617.019924:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211707648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.020219:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211707648:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.020226:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1782758617.020247:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707008 00000100:00100000:1.0:1782758617.020251:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707008 00000100:00100000:1.0:1782758617.020283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1782758617.020290:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211707008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758617.020322:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211707008:12345-0@lo:400:kworker.0 Request processed in 33us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.020328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1782758617.020356:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707520 00000100:00100000:1.0:1782758617.020359:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707520 00000100:00100000:1.0:1782758617.020384:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707264 00000100:00100000:1.0:1782758617.020387:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707264 00000100:00080000:0.0:1782758617.020863:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758617.020868:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758617.020871:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758617.020917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707136 00000100:00100000:1.0:1782758617.020922:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707136 00000100:00100000:3.0:1782758617.023074:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211707008:0@lo:400:kworker.0 00000100:00100000:3.0:1782758617.023099:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211707392:0@lo:400:kworker.0 00000100:00100000:2.0:1782758617.023674:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1782758617.024010:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1782758617.024027:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211707264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758617.024132:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211707264:12345-0@lo:400:kworker.0 Request processed in 101us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758617.024140:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1782758617.024169:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1782758617.024177:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758617.024208:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211707136:12345-0@lo:400:kworker.0 Request processed in 32us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758617.024214:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1782758617.028805:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211707520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758617.028930:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211707520:12345-0@lo:400:kworker.0 Request processed in 5246us (9401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758617.028940:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1782758617.029021:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211707520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758617.029302:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211707136:0@lo:400:kworker.0 00000100:00100000:0.0:1782758617.029318:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211707648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758617.029329:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211707264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758617.178360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758617.178814:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861184 00000100:00100000:3.0:1782758617.178868:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861184 00000100:00100000:3.0:1782758617.178920:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1193 00000100:00100000:3.0:1782758617.178931:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58640:x1869355196861184:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758617.178957:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758617.178982:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e8f expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179153:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179168:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179182:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758617.179393:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758617.179398:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758617.179482:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179510:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbe8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e8f expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179524:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e8f expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.179533:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758617.179536:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758617.179540:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758617.179654:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58640:x1869355196861184:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 724us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758617.179662:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1193 00000100:00100000:0.0:1782758617.189986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758617.190135:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861312 00000100:00100000:1.0:1782758617.190145:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861312 00000100:00100000:1.0:1782758617.190201:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:1.0:1782758617.190210:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58640:x1869355196861312:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758617.190231:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758617.190251:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbe9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e96 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190319:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190334:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190344:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190358:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190365:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190371:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190722:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190731:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190738:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758617.190865:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1782758617.190870:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758617.190953:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190970:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190976:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190982:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190988:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758617.190992:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.190998:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191024:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:1.0:1782758617.191027:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758617.191032:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191037:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191050:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191055:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191060:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191065:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758617.191067:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191072:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191079:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758617.191081:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758617.191083:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191088:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbeab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191118:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbe9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e96 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191131:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e96 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.191138:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:1.0:1782758617.191140:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758617.191143:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758617.191214:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58640:x1869355196861312:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1003us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.191223:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1194 00000100:00100000:0.0:1782758617.197926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758617.200151:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861568 00000100:00100000:3.0:1782758617.200182:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861568 00000100:00100000:3.0:1782758617.200258:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1195 00000100:00100000:3.0:1782758617.200269:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58640:x1869355196861568:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758617.200318:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758617.200346:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbeb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e96 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.200366:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a800) 00010000:00010000:3.0:1782758617.200378:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758617.200402:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.200413:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.200421:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758617.295209:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967756 is committed 00000004:00010000:2.0:1782758617.295983:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ebcc8f3 reply state 000000009291d4c3 transno 4294967756 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758617.295998:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758617.296162:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:2.0:1782758617.296257:0:5801:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782758617.296273:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58640:x1869355196861568:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 96002us (98353us total) trans 4294967756 rc 0/0 00000100:00100000:2.0:1782758617.296282:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1195 00010000:00010000:2.0:1782758617.296419:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296429:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296436:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296443:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758617.296447:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296455:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296472:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782758617.296476:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782758617.296480:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.296486:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690000/0xdd99f5c4777dbeb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758617.381650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758617.381751:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861696 00000100:00100000:3.0:1782758617.381762:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861696 00000100:00100000:3.0:1782758617.381895:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1196 00000100:00100000:3.0:1782758617.381906:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58644:x1869355196861696:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758617.381931:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758617.381950:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64e9d expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382009:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382022:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382033:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382046:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382054:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382062:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382481:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382490:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382497:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758617.382580:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1782758617.382585:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758617.382680:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382694:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382701:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382707:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382713:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.382717:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382724:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382736:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758617.382739:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.382743:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382749:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382760:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382766:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382771:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382776:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.382778:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382784:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382790:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75b00) 00010000:00010000:3.0:1782758617.382793:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.382795:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382801:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbece lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382875:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e9d expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382888:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e9d expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.382895:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758617.382897:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758617.382899:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758617.382967:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58644:x1869355196861696:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1063us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758617.382974:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1196 00000100:00100000:0.0:1782758617.394995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758617.397527:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196861952 00000100:00100000:3.0:1782758617.397544:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196861952 00000100:00100000:3.0:1782758617.397613:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1197 00000100:00100000:3.0:1782758617.397624:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58644:x1869355196861952:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758617.397660:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758617.397681:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbedc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ea4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398138:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398153:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398235:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398306:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398315:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.398323:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782758617.399359:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:3.0:1782758617.399669:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399682:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399693:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399729:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399737:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399744:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399750:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.399754:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399765:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399776:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758617.399778:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.399783:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399788:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbee3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758617.399800:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048fd3b11 reply state 000000003fea4db3 transno 4294967757 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758617.399809:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758617.399968:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbedc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ea4 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399983:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ea4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.399990:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782758617.399993:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758617.399995:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782758617.400087:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58644:x1869355196861952:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2464us (5102us total) trans 4294967757 rc 0/0 00000100:00100000:3.0:1782758617.400096:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1197 00010000:00010000:3.0:1782758617.404057:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404076:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404083:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404089:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.404095:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404104:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404122:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917191f75b00) 00010000:00010000:3.0:1782758617.404126:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.404130:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.404137:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbeea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758617.405301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758617.405401:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862208 00000100:00100000:2.0:1782758617.405412:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862208 00000100:00100000:2.0:1782758617.405464:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1198 00000100:00100000:2.0:1782758617.405473:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58644:x1869355196862208:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782758617.405529:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758617.405552:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691800/0xdd99f5c4777dbef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ea4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.405568:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782758617.405578:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758617.405621:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.405647:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758617.405658:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758617.405866:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da517f98 reply state 00000000a1cf1371 transno 4294967758 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758617.405876:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758617.406149:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58644:x1869355196862208:12345-192.168.204.31@tcp:36:touch.0 Request processed in 675us (853us total) trans 4294967758 rc 0/0 00000100:00100000:2.0:1782758617.406157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1198 00000100:00100000:2.0:1782758617.409393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758617.409668:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862336 00000100:00100000:1.0:1782758617.409679:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862336 00000100:00100000:1.0:1782758617.409739:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1199 00000100:00100000:1.0:1782758617.409750:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58644:x1869355196862336:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758617.409775:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758617.409796:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbf06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64eab expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.409889:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbf06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eab expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.409905:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbf06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eab expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.409926:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:1.0:1782758617.409930:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782758617.409934:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758617.410143:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58644:x1869355196862336:12345-192.168.204.31@tcp:101:touch.0 Request processed in 394us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.410151:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1199 00010000:00010000:3.0:1782758617.411159:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411172:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411180:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411185:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.411190:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411198:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411212:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:3.0:1782758617.411215:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.411219:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.411224:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dbeff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758617.412762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758617.412897:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862464 00000100:00100000:0.0:1782758617.412905:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862464 00000100:00100000:0.0:1782758617.412968:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 659 00000100:00100000:0.0:1782758617.412980:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196862464:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:0.0:1782758617.413309:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196862464:12345-192.168.204.31@tcp:2:touch.0 Request processed in 330us (553us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1782758617.413319:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 659 00000100:00100000:2.0:1782758617.415916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758617.416084:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862720 00000100:00100000:0.0:1782758617.416093:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862720 00000100:00100000:0.0:1782758617.416159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:0.0:1782758617.416171:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58644:x1869355196862720:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:0.0:1782758617.416482:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58644:x1869355196862720:12345-192.168.204.31@tcp:35:touch.0 Request processed in 313us (573us total) trans 4294967759 rc 0/0 00000100:00100000:0.0:1782758617.416490:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:3.0:1782758617.464175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758617.464360:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862848 00000100:00100000:1.0:1782758617.464370:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862848 00000100:00100000:1.0:1782758617.464433:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1200 00000100:00100000:1.0:1782758617.464443:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58648:x1869355196862848:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758617.464468:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758617.464488:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dbf0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64eb2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464549:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464563:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464574:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464588:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464596:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464602:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464713:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464721:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464729:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758617.464763:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x62:0x0]: returning size 0 00000004:00200000:1.0:1782758617.464768:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758617.464787:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464804:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464813:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.464994:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465002:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465008:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758617.465082:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465092:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465105:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758617.465109:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758617.465113:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465120:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dbf14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465134:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465140:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465147:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465151:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758617.465154:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465160:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465167:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758617.465169:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758617.465172:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465178:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dbf1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dbf0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb2 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465223:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb2 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.465230:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:1.0:1782758617.465232:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758617.465235:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:3.0:1782758617.465475:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58648:x1869355196862848:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1031us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758617.465483:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1200 00000100:00100000:1.0:1782758617.470509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758617.470623:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196862976 00000100:00100000:0.0:1782758617.470644:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196862976 00000100:00100000:1.0:1782758617.470892:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 660 00000100:00100000:1.0:1782758617.470905:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196862976:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782758617.470925:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758617.471155:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64eb9 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782758617.471183:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x6a42bcd8, atime: 0x6a42bcd8, ctime: 0x6a42bcd8, blocks: 0x1 00010000:00010000:1.0:1782758617.471204:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=2685s v=(0 0) 00010000:00010000:1.0:1782758617.471209:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758617.471219:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.471240:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.471254:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758617.471371:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196862976:12345-192.168.204.31@tcp:101:rm.0 Request processed in 467us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758617.471379:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 660 00000100:00100000:2.0:1782758617.475145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758617.475233:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196863232 00000100:00100000:3.0:1782758617.475243:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196863232 00000100:00100000:3.0:1782758617.475304:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1201 00000100:00100000:3.0:1782758617.475315:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58648:x1869355196863232:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758617.475369:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758617.475398:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dbf22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb2 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475421:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dbf06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eab expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475431:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:3.0:1782758617.475444:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758617.475465:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475479:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475489:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475504:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475512:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475519:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475673:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475683:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.475691:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782758617.476371:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:3.0:1782758617.476383:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2685879559569ns, next at 2686879556810ns, rc = 0 00010000:00010000:3.0:1782758617.476443:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476458:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476467:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476476:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476483:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476490:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476511:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782758617.476531:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476538:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476545:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476551:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.476556:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476563:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476578:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758617.476581:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758617.476585:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476591:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476606:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476613:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476619:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476638:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.476642:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476648:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476657:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782758617.476659:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.476662:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.476669:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758617.476684:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bb0a753 reply state 00000000942d47c9 transno 4294967760 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758617.476693:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758617.476774:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58648:x1869355196863232:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1459us (1637us total) trans 4294967760 rc 0/0 00000100:00100000:3.0:1782758617.476782:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1201 00010000:00010000:1.0:1782758617.477074:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758617.477081:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.477088:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758617.477091:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.477098:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.477109:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff917191f75300) 00010000:00010000:1.0:1782758617.477111:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758617.477115:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.477121:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dbf45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758617.477134:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758617.477136:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758617.477138:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758617.480809:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481190:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481199:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481206:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758617.481211:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481220:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481238:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917191f75b00) 00010000:00010000:3.0:1782758617.481241:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758617.481246:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758617.481252:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758617.516253:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211707776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758617.516330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758617.516570:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707776 00000100:00100000:2.0:1782758617.516579:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707776 00000100:00100000:2.0:1782758617.516650:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1782758617.516660:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211707776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758617.516697:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758617.526397:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211707776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9729us (10057us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758617.526411:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1782758617.529362:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211707776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758617.644727:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758618.451747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758618.451802:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196863360 00000100:00100000:1.0:1782758618.451811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196863360 00000100:00100000:1.0:1782758618.451889:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00100000:1.0:1782758618.451900:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58663:x1869355196863360:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782758618.451924:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758618.451944:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ec0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452003:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452016:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452027:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758618.452085:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1782758618.452088:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758618.452112:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452135:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452153:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec0 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.452160:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758618.452163:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758618.452166:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782758618.452228:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58663:x1869355196863360:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 329us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758618.452235:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1202 00000100:00080000:1.0:1782758618.452261:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758618.463492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758618.463572:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196863616 00000100:00100000:1.0:1782758618.463582:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196863616 00000100:00100000:1.0:1782758618.463645:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1203 00000100:00100000:1.0:1782758618.463656:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58663:x1869355196863616:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758618.463707:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758618.463734:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dbf53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec0 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.463751:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dbed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e9d expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.463762:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75a00) 00010000:00010000:1.0:1782758618.463773:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758618.463799:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.463811:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.463847:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782758618.537058:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967759 is committed 00000001:00080000:3.0:1782758618.537078:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967761 is committed 00000004:00080000:3.0:1782758618.537092:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000004:00010000:1.0:1782758618.537231:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f245e23 reply state 00000000f11f0138 transno 4294967761 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758618.537245:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758618.537404:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:1.0:1782758618.537497:0:5802:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758618.537515:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58663:x1869355196863616:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 73857us (74025us total) trans 4294967761 rc 0/0 00000100:00100000:1.0:1782758618.537524:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1203 00010000:00010000:1.0:1782758618.539154:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539169:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539177:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539184:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758618.539190:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539198:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539214:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758618.539217:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758618.539222:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.539228:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758618.547361:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211707904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782758618.547432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758618.547499:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211707904 00000100:00100000:0.0:1782758618.547506:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211707904 00000100:00100000:0.0:1782758618.547546:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1782758618.547554:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211707904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782758618.547581:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:37 count 1 00010000:00010000:0.0:1782758618.547612:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.547632:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.547647:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782758618.547652:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758618.547657:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.547684:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.547697:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 6 pid: 6597 timeout: 2786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758618.547709:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211708032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758618.547777:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e30240 going to sleep for 11 seconds 00000100:00100000:1.0:1782758618.565366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758618.565389:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211708032:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758618.565416:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758618.568981:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196863744 00000100:00100000:3.0:1782758618.568997:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196863744 00010000:00010000:3.0:1782758618.569055:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 2786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758618.569099:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 455 00000100:00100000:3.0:1782758618.569107:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196863744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758618.569120:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758618.569125:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 2786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.569139:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 2786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.569161:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdfb4c1/0xdd99f5c4777dbf29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eb9 expref: 7 pid: 6597 timeout: 2786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.569175:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758618.569179:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758618.569186:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.569200:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782758618.569210:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782758618.569231:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758618.569238:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.569247:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.569256:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.569263:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.569279:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782758618.569289:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196863744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 182us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758618.569297:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 455 00000100:00100000:1.0:1782758618.570008:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211707904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22453us (22575us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1782758618.570018:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:1.0:1782758618.570042:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758618.570048:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.570057:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758618.570062:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.570072:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.570084:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.570091:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a34bc0/0xdd99f5c4777dbf61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.570107:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758618.570109:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758618.570110:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758618.571397:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170818cce00/2, rc 0, transno 4294967371 00000100:00100000:3.0:1782758618.571408:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211707904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782758618.629593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758618.641017:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196863872 00000100:00100000:0.0:1782758618.641030:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196863872 00000100:00100000:1.0:1782758618.646936:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1204 00000100:00100000:1.0:1782758618.646949:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58667:x1869355196863872:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782758618.646970:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758618.646987:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbf68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ec7 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647050:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647063:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647075:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647088:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647095:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647101:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647757:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647767:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.647774:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758618.648089:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1782758618.648093:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758618.648188:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648207:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648215:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648228:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648234:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758618.648238:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648246:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648258:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:1.0:1782758618.648262:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758618.648266:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648273:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dbf6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648283:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648291:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648297:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648302:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758618.648305:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648310:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648318:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9171a0e3a600) 00010000:00010000:1.0:1782758618.648320:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758618.648322:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648341:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dbf76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648371:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbf68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec7 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648383:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec7 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.648390:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:1.0:1782758618.648393:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758618.648395:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758618.648507:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58667:x1869355196863872:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1559us (18923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758618.648515:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1204 00000100:00100000:1.0:1782758618.654870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758618.658957:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196864128 00000100:00100000:2.0:1782758618.658973:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196864128 00000100:00100000:3.0:1782758618.659299:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1205 00000100:00100000:3.0:1782758618.659311:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58667:x1869355196864128:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782758618.659341:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758618.659362:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ece expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659694:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659709:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659720:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659735:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659742:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.659748:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782758618.660956:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:3.0:1782758618.661324:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbf99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661350:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661361:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661395:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661402:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661409:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661415:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758618.661420:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661427:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661444:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782758618.661447:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758618.661451:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661458:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dbf8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758618.661470:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dd915ae reply state 00000000db85a538 transno 4294967762 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758618.661479:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758618.661510:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dbf84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ece expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661523:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbf99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ece expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.661530:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782758618.661533:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758618.661535:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758618.661674:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58667:x1869355196864128:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2364us (6855us total) trans 4294967762 rc 0/0 00000100:00100000:3.0:1782758618.661683:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1205 00010000:00010000:0.0:1782758618.664474:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664491:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664498:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664504:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758618.664508:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664516:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664533:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917191f75700) 00010000:00010000:0.0:1782758618.664536:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758618.664540:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.664546:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dbf92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.668547:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758618.675233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758618.675415:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196864384 00000100:00100000:1.0:1782758618.675425:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196864384 00000100:00100000:1.0:1782758618.675486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1206 00000100:00100000:1.0:1782758618.675496:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58667:x1869355196864384:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782758618.675552:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758618.675578:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dbf99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ece expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.675598:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff917191f75500) 00010000:00010000:1.0:1782758618.675620:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758618.675663:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.675675:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758618.675684:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758618.675809:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8d63b8b reply state 00000000b0715476 transno 4294967763 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758618.675818:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758618.676610:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58667:x1869355196864384:12345-192.168.204.31@tcp:36:touch.0 Request processed in 1105us (1377us total) trans 4294967763 rc 0/0 00000100:00100000:1.0:1782758618.676619:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1206 00000100:00100000:1.0:1782758618.682576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782758618.682610:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.682624:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.682631:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.682637:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.682643:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.682651:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758618.682667:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196864512 00010000:00010000:2.0:1782758618.682669:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9171a0e3a600) 00010000:00010000:2.0:1782758618.682672:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758618.682677:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758618.682677:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196864512 00010000:00010000:2.0:1782758618.682683:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dbfa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758618.682734:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1207 00000100:00100000:0.0:1782758618.682745:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58667:x1869355196864512:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782758618.682774:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758618.682795:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbfae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ed5 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.682879:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbfae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ed5 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.682892:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbfae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ed5 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.682911:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:0.0:1782758618.682913:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782758618.682916:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782758618.682986:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58667:x1869355196864512:12345-192.168.204.31@tcp:101:touch.0 Request processed in 243us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758618.682994:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1207 00000100:00100000:0.0:1782758618.686252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758618.686723:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196864640 00000100:00100000:3.0:1782758618.686732:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196864640 00000100:00100000:3.0:1782758618.686811:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 662 00000100:00100000:3.0:1782758618.686842:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196864640:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:1.0:1782758618.687307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758618.687506:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196864640:12345-192.168.204.31@tcp:2:touch.0 Request processed in 684us (1261us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1782758618.687515:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 662 00000100:00100000:3.0:1782758618.689815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758618.689958:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196864896 00000100:00100000:0.0:1782758618.689967:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196864896 00000100:00100000:0.0:1782758618.690023:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:0.0:1782758618.690033:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58667:x1869355196864896:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:0.0:1782758618.690347:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58667:x1869355196864896:12345-192.168.204.31@tcp:35:touch.0 Request processed in 315us (539us total) trans 4294967764 rc 0/0 00000100:00100000:0.0:1782758618.690355:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:1.0:1782758618.729655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758618.730276:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865024 00000100:00100000:3.0:1782758618.730287:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865024 00000100:00100000:2.0:1782758618.730482:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1208 00000100:00100000:2.0:1782758618.730494:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58671:x1869355196865024:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758618.730519:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758618.730538:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbfb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64edc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730599:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730625:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730637:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730652:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730660:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730667:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730874:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730888:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.730897:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758618.731001:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x63:0x0]: returning size 0 00000004:00200000:2.0:1782758618.731006:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758618.731183:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731196:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731205:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731212:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731219:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731225:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.731230:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731237:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731249:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782758618.731253:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758618.731258:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731264:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dbfbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731277:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731284:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731290:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731296:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.731299:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731306:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731313:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917182dd1400) 00010000:00010000:2.0:1782758618.731316:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758618.731318:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731324:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dbfc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731353:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dbfb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64edc expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731366:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64edc expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.731373:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:2.0:1782758618.731375:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758618.731378:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782758618.731496:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58671:x1869355196865024:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1002us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758618.731504:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1208 00000100:00100000:3.0:1782758618.734590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758618.735088:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865152 00000100:00100000:0.0:1782758618.735098:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865152 00000100:00100000:0.0:1782758618.735185:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 663 00000100:00100000:0.0:1782758618.735195:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196865152:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758618.735211:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758618.735231:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ee3 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782758618.735257:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x6a42bcd9, atime: 0x6a42bcd9, ctime: 0x6a42bcd9, blocks: 0x1 00010000:00010000:0.0:1782758618.735275:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=2687s v=(0 0) 00010000:00010000:0.0:1782758618.735280:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782758618.735289:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.735307:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758618.735321:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782758618.735381:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196865152:12345-192.168.204.31@tcp:101:rm.0 Request processed in 187us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758618.735388:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 663 00000100:00100000:3.0:1782758618.737925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758618.738038:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865408 00000100:00100000:2.0:1782758618.738048:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865408 00000100:00100000:2.0:1782758618.738096:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1209 00000100:00100000:2.0:1782758618.738106:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58671:x1869355196865408:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782758618.738156:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758618.738182:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694400/0xdd99f5c4777dbfca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64edc expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738203:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dbfae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ed5 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738213:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff91718bcfd100) 00010000:00010000:2.0:1782758618.738223:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758618.738242:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738253:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738262:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738275:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738282:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738289:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738393:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738401:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.738408:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782758618.738949:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:2.0:1782758618.738960:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2687142136531ns, next at 2688142134171ns, rc = 0 00010000:00010000:2.0:1782758618.739018:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739028:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739036:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739049:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739055:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739061:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739086:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782758618.739105:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739111:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739117:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739122:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.739126:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739134:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739142:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff917182dd1100) 00010000:00010000:2.0:1782758618.739145:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782758618.739149:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739159:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dbfe6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739174:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739180:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739186:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739191:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.739194:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739201:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739208:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782758618.739210:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758618.739213:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.739218:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dbfd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758618.739227:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ae5709d reply state 000000005269d030 transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758618.739235:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782758618.739303:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58671:x1869355196865408:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1196us (1395us total) trans 4294967765 rc 0/0 00000100:00100000:2.0:1782758618.739311:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1209 00010000:00010000:3.0:1782758618.743167:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758618.743181:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.743192:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758618.743197:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.743207:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.743225:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff917182dd1100) 00010000:00010000:3.0:1782758618.743227:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758618.743232:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.743237:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dbfed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758618.743262:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758618.743264:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758618.743266:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758618.743314:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743322:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743328:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743334:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758618.743338:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743345:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743355:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917182dd1a00) 00010000:00010000:2.0:1782758618.743357:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758618.743360:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758618.743367:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dbfdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758619.513660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758619.513702:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865536 00000100:00100000:0.0:1782758619.513712:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865536 00000100:00100000:0.0:1782758619.513762:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1210 00000100:00100000:0.0:1782758619.513773:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58685:x1869355196865536:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782758619.513799:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758619.513819:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64eea expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514545:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514563:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514576:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758619.514645:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:0.0:1782758619.514649:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758619.514675:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514700:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dbff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eea expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514718:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eea expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.514727:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:0.0:1782758619.514731:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758619.514734:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782758619.514794:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58685:x1869355196865536:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1021us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758619.514801:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1210 00000100:00100000:0.0:1782758619.519620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.522385:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865792 00000100:00100000:2.0:1782758619.522396:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865792 00000100:00100000:2.0:1782758619.522556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1211 00000100:00100000:2.0:1782758619.522567:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58685:x1869355196865792:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782758619.522631:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782758619.522656:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dbffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eea expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.522675:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dbf7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ec7 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.522685:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:2.0:1782758619.522695:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758619.522718:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.522730:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.522740:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758619.523326:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004c09131 reply state 0000000009554e54 transno 4294967766 ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758619.523337:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782758619.523352:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:2.0:1782758619.523564:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58685:x1869355196865792:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 997us (3950us total) trans 4294967766 rc 0/0 00000100:00100000:2.0:1782758619.523572:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1211 00010000:00010000:1.0:1782758619.529811:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.529944:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.529952:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.529959:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758619.529963:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.529971:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.529988:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:1.0:1782758619.529991:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782758619.529996:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.530002:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758619.635813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758619.635941:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196865920 00000100:00100000:3.0:1782758619.635950:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196865920 00000100:00100000:3.0:1782758619.636006:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1212 00000100:00100000:3.0:1782758619.636016:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196865920:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758619.636113:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196865920:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758619.636121:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1212 00000100:00100000:0.0:1782758619.637919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.638313:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866048 00000100:00100000:2.0:1782758619.638321:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866048 00000100:00100000:3.0:1782758619.638502:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 664 00000100:00100000:3.0:1782758619.638514:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58697:x1869355196866048:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758619.639023:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58697:x1869355196866048:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 509us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758619.639030:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 664 00000100:00100000:1.0:1782758619.642076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.642174:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866176 00000100:00100000:2.0:1782758619.642184:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866176 00000100:00100000:2.0:1782758619.642243:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 665 00000100:00100000:2.0:1782758619.642253:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58697:x1869355196866176:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758619.642629:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58697:x1869355196866176:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 376us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758619.642654:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 665 00000100:00100000:0.0:1782758619.646268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.646394:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866304 00000100:00100000:1.0:1782758619.646404:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866304 00000100:00100000:1.0:1782758619.646519:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1213 00000100:00100000:1.0:1782758619.646530:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866304:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758619.647022:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866304:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 492us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758619.647031:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1213 00000100:00100000:3.0:1782758619.653971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.654046:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866432 00000100:00100000:2.0:1782758619.654058:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866432 00000100:00100000:2.0:1782758619.654119:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00100000:2.0:1782758619.654129:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866432:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782758619.654234:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866432:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758619.654241:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1214 00000100:00100000:3.0:1782758619.656618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.657030:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866560 00000100:00100000:1.0:1782758619.657041:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866560 00000100:00100000:1.0:1782758619.657096:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 666 00000100:00100000:1.0:1782758619.657107:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58697:x1869355196866560:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758619.657862:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58697:x1869355196866560:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 717us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758619.657872:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 666 00000100:00100000:0.0:1782758619.659902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.659992:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866688 00000100:00100000:2.0:1782758619.660002:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866688 00000100:00100000:2.0:1782758619.660056:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 667 00000100:00100000:2.0:1782758619.660066:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58697:x1869355196866688:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758619.662347:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58697:x1869355196866688:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2269us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758619.662362:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 667 00000100:00100000:0.0:1782758619.665207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.665323:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866816 00000100:00100000:1.0:1782758619.665334:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866816 00000100:00100000:1.0:1782758619.665427:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1215 00000100:00100000:1.0:1782758619.665436:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866816:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758619.665954:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58697:x1869355196866816:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 517us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758619.665963:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1215 00010000:00010000:1.0:1782758619.694216:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758619.726639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.726757:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196866944 00000100:00100000:1.0:1782758619.726768:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196866944 00000100:00100000:1.0:1782758619.726871:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1216 00000100:00100000:1.0:1782758619.726882:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+11:58701:x1869355196866944:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758619.726916:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758619.726938:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dc009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ef1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727000:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727015:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727027:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727042:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727049:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727056:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727407:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727416:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727424:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758619.727458:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1782758619.727462:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782758619.727490:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727503:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727510:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727521:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727528:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758619.727532:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727539:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727553:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:1.0:1782758619.727556:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758619.727561:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727568:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727592:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727599:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727605:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727609:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758619.727612:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727622:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727629:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9171a0e3ac00) 00010000:00010000:1.0:1782758619.727631:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758619.727634:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727638:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727669:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dc009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef1 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727681:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef1 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.727688:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758619.727690:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782758619.727692:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758619.727744:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58701:x1869355196866944:12345-192.168.204.31@tcp:101:dd.0 Request processed in 864us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758619.727751:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1216 00000100:00100000:0.0:1782758619.735357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.735740:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867200 00000100:00100000:1.0:1782758619.735750:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867200 00000100:00100000:1.0:1782758619.735807:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1217 00000100:00100000:1.0:1782758619.735816:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:58701:x1869355196867200:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1782758619.735865:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758619.735886:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dc025 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ef8 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736103:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736717:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736729:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736747:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736754:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.736761:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782758619.737848:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:1.0:1782758619.738244:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dc03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738259:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738270:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738307:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738315:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738322:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738328:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758619.738333:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738340:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738351:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758619.738354:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758619.738359:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738365:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc02c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758619.738378:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000340c065d reply state 000000007951cc9b transno 4294967767 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758619.738388:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782758619.738422:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dc025 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef8 expref: 15 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738441:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dc03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef8 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758619.738449:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:1.0:1782758619.738451:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782758619.738453:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758619.738807:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+15:58701:x1869355196867200:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2989us (3459us total) trans 4294967767 rc 0/0 00000100:00100000:1.0:1782758619.738816:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1217 00010000:00010000:2.0:1782758619.743101:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743129:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743137:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743145:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758619.743150:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743157:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743173:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9171a0e3ac00) 00010000:00010000:2.0:1782758619.743176:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758619.743180:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.743186:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dc033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758619.748692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758619.749094:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867328 00000100:00100000:3.0:1782758619.749104:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867328 00000100:00100000:3.0:1782758619.749215:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 668 00000100:00100000:3.0:1782758619.749225:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58701:x1869355196867328:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782758619.749242:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758619.749260:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64eff expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782758619.749284:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782758619.749303:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=2688s v=(0 0) 00010000:00010000:3.0:1782758619.749307:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758619.749316:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758619.749334:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758619.749347:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758619.749491:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:58701:x1869355196867328:12345-192.168.204.31@tcp:101:dd.0 Request processed in 266us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758619.749499:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 668 00000100:00100000:0.0:1782758619.766056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.766236:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867456 00000100:00100000:2.0:1782758619.766246:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867456 00002000:00100000:2.0:1782758619.766295:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9171b2dfd180 x1869355196867456/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:535/0 lens 488/0 e 0 to 0 dl 1782758630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782758619.766307:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b2dfd180 with x1869355196867456 ext(0->1048575) 00002000:00010000:2.0:1782758619.766313:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b2dfd180 00000100:00100000:2.0:1782758619.766393:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1782758619.766402:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196867456:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:2.0:1782758619.788400:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196867456:12345-192.168.204.31@tcp:4:dd.0 Request processed in 21989us (22346us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1782758619.788415:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00002000:00100000:2.0:1782758619.788428:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9171b2dfd180 x1869355196867456/t4294967372(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:535/0 lens 488/448 e 0 to 0 dl 1782758630 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782758619.788439:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b2dfd180 with x1869355196867456 ext(0->1048575) 00002000:00010000:2.0:1782758619.788446:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b2dfd180 00000100:00100000:2.0:1782758619.792610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758619.792702:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867584 00000100:00100000:1.0:1782758619.792713:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867584 00000100:00100000:1.0:1782758619.792787:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000100:00100000:1.0:1782758619.792798:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+14:58701:x1869355196867584:12345-192.168.204.31@tcp:44:dd.0 00000100:00100000:2.0:1782758619.837695:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+14:58701:x1869355196867584:12345-192.168.204.31@tcp:44:dd.0 Request processed in 42663us (42860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758619.837714:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1218 00000001:00080000:2.0:1782758619.837777:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00000001:00080000:2.0:1782758619.837791:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967767 is committed 00000004:00080000:2.0:1782758619.837807:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000100:00100000:0.0:1782758619.838159:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758619.838175:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211708160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782758619.838240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758619.838570:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708160 00000100:00100000:2.0:1782758619.838585:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708160 00000100:00100000:2.0:1782758619.838720:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1782758619.838729:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211708160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782758619.838757:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:38 count 1 00010000:00010000:2.0:1782758619.838782:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.838803:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.838812:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782758619.838816:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758619.838838:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.838865:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.838879:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 6 pid: 9120 timeout: 2788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758619.838960:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211708288:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782758619.839017:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191ab1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758619.842617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.843220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758619.843248:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867840 00000100:00100000:2.0:1782758619.843255:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867840 00010000:00010000:2.0:1782758619.843295:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 2788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758619.843328:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 456 00000100:00100000:2.0:1782758619.843336:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196867840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758619.843351:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758619.843356:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 2788 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.843369:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 2788 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.843392:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758619.843396:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758619.843403:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.843414:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758619.843433:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758619.843672:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ab478b4/0xdd99f5c4777dbfd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ee3 expref: 7 pid: 9120 timeout: 2788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758619.843690:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211708288:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758619.843712:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.844340:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.844350:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.844362:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.844370:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.844389:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782758619.844604:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196867840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1263us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758619.844614:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 456 00000100:00100000:3.0:1782758619.845144:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196867712 00000100:00100000:3.0:1782758619.845152:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196867712 00000100:00100000:3.0:1782758619.845189:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 670 00000100:00100000:3.0:1782758619.845198:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196867712:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:0.0:1782758619.847707:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211708160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8971us (9458us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1782758619.847730:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00010000:00010000:0.0:1782758619.847786:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758619.847794:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.847807:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758619.847812:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.847855:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.847876:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.847884:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c22c6b/0xdd99f5c4777dc04f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758619.847916:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758619.847919:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758619.847921:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782758619.848058:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782758619.848384:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2dfc700/2, rc 0, transno 4294967373 00000100:00100000:3.0:1782758619.848392:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211708160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758619.889456:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2361:x1869355196867712:12345-192.168.204.31@tcp:16:dd.0 Request processed in 44250us (46841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758619.889481:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 670 00000001:00080000:2.0:1782758619.890267:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000001:00080000:2.0:1782758619.890280:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:2.0:1782758619.890286:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:2.0:1782758619.894359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758619.894455:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868096 00000100:00100000:0.0:1782758619.894532:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868096 00000100:00100000:0.0:1782758619.894619:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:0.0:1782758619.894629:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58701:x1869355196868096:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:0.0:1782758619.895221:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967768 00000100:00100000:0.0:1782758619.895377:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:58701:x1869355196868096:12345-192.168.204.31@tcp:35:dd.0 Request processed in 747us (1025us total) trans 4294967769 rc 0/0 00000100:00100000:0.0:1782758619.895385:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 123 00000020:00080000:0.0:1782758619.895390:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782758620.080021:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758620.080048:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211708416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758620.080123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758620.088369:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708416 00000100:00100000:3.0:1782758620.088381:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708416 00000100:00100000:3.0:1782758620.088435:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1782758620.088444:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211708416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758620.088483:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758620.088591:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211708416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (8467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758620.088603:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1782758620.090416:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211708416:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782758620.149923:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000001:00080000:3.0:1782758620.149941:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00010000:00010000:1.0:1782758620.724066:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758621.364402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758621.364477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758621.364510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758621.364536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758621.364578:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868608 00000100:00100000:3.0:1782758621.364587:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868608 00000100:00100000:3.0:1782758621.364638:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868480 00000100:00100000:3.0:1782758621.364641:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868480 00000100:00100000:3.0:1782758621.364665:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1507 00000100:00100000:3.0:1782758621.364674:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196868608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758621.364743:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196868608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758621.364751:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1507 00000100:00100000:3.0:1782758621.364767:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1508 00000100:00100000:3.0:1782758621.364773:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196868480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758621.364796:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196868480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758621.364803:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1508 00000100:00100000:3.0:1782758621.364820:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868224 00000100:00100000:3.0:1782758621.364847:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868224 00000100:00100000:3.0:1782758621.364890:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1460 00000100:00100000:3.0:1782758621.364896:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196868224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758621.364923:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196868224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758621.364930:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1460 00000100:00080000:3.0:1782758621.364957:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758621.364961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758621.369245:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868352 00000100:00100000:2.0:1782758621.369261:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868352 00000100:00100000:2.0:1782758621.369347:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:2.0:1782758621.369359:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2361:x1869355196868352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758621.369443:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:2361:x1869355196868352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (5051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758621.369451:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00080000:3.0:1782758621.370942:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1782758621.570287:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967769 is committed 00010000:00010000:1.0:1782758621.751127:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758622.124456:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211708672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758622.124570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758622.124722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758622.124742:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211708544:0@lo:400:kworker.0 00000100:00100000:1.0:1782758622.124798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758622.124876:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708672 00000100:00100000:1.0:1782758622.124885:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708672 00000100:00100000:1.0:1782758622.124945:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:1.0:1782758622.124955:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211708672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758622.125264:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708544 00000100:00100000:2.0:1782758622.125270:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708544 00000100:00100000:2.0:1782758622.125307:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1782758622.125315:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211708544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758622.125364:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211708544:12345-0@lo:400:kworker.0 Request processed in 49us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758622.125372:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1782758622.125442:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211708800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758622.125565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758622.125605:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708800 00000100:00100000:2.0:1782758622.125609:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708800 00000100:00100000:2.0:1782758622.125646:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1782758622.125653:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211708800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758622.125689:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211708800:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758622.125696:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1782758622.125743:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211708800:0@lo:400:kworker.0 00000100:00080000:2.0:1782758622.125785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758622.126253:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211708544:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.126730:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211709056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.126776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758622.126804:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758622.126809:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211708928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.126850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758622.126880:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709056 00000100:00100000:0.0:1782758622.126885:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709056 00000100:00100000:0.0:1782758622.126932:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:0.0:1782758622.126940:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211709056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.126999:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211709056:12345-0@lo:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758622.127013:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00080000:0.0:1782758622.127034:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758622.128504:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211709056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.128579:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758622.128597:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211709184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.128665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758622.128968:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211708928 00000100:00100000:3.0:1782758622.128979:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211708928 00000100:00080000:0.0:1782758622.129246:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758622.129299:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709184 00000100:00100000:3.0:1782758622.129303:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709184 00000100:00100000:0.0:1782758622.129419:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1782758622.129432:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758622.129598:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1782758622.129608:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211709184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758622.129688:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211708672:12345-0@lo:400:kworker.0 Request processed in 4730us (5115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758622.129704:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00080000:1.0:1782758622.129763:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758622.129886:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211709184:12345-0@lo:400:kworker.0 Request processed in 281us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758622.129893:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1782758622.129999:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:1.0:1782758622.130012:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170818cce00, transno 4294967371 00000100:00100000:1.0:1782758622.130033:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211709184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758622.134010:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211708928:12345-0@lo:400:kworker.0 Request processed in 4550us (7128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758622.134031:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1782758622.134391:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211708672:0@lo:400:kworker.0 00000100:00100000:1.0:1782758622.134556:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:1.0:1782758622.134564:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2dfc700, transno 4294967373 00000100:00100000:1.0:1782758622.134622:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211708928:0@lo:400:kworker.0 00000100:00100000:1.0:1782758622.639187:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211709312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758622.639265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758622.646045:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709312 00000100:00100000:2.0:1782758622.646061:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709312 00000100:00100000:2.0:1782758622.646147:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1782758622.646158:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211709312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758622.646198:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782758622.646309:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211709312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758622.646316:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1782758622.646474:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211709312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758622.764025:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782758622.858926:0:100222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2691262100703ns, next at 2688142134171ns, rc = 0 00000004:00080000:1.0:1782758622.859028:0:100222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2691262204968ns, next at 2686879556810ns, rc = 0 00000004:00080000:2.0:1782758622.897725:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000004:00080000:2.0:1782758622.897747:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00010000:00010000:1.0:1782758623.790388:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758624.374021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758624.374093:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868736 00000100:00100000:3.0:1782758624.374104:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868736 00000100:00100000:3.0:1782758624.374182:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1219 00000100:00100000:3.0:1782758624.374193:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196868736:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758624.374284:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196868736:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758624.374292:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1219 00000100:00080000:1.0:1782758624.374446:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758624.380062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758624.380193:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868864 00000100:00100000:0.0:1782758624.380204:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868864 00000100:00100000:0.0:1782758624.380277:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 671 00000100:00100000:0.0:1782758624.380289:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58895:x1869355196868864:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758624.380696:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58895:x1869355196868864:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 408us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758624.380705:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 671 00000100:00080000:3.0:1782758624.380928:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758624.386870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758624.387078:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196868992 00000100:00100000:3.0:1782758624.387089:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196868992 00000100:00100000:3.0:1782758624.387160:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 672 00000100:00100000:3.0:1782758624.387172:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58895:x1869355196868992:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782758624.387561:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58895:x1869355196868992:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 390us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758624.387569:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 672 00000100:00080000:1.0:1782758624.387819:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758624.389314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758624.389382:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869120 00000100:00100000:1.0:1782758624.389389:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869120 00000100:00100000:1.0:1782758624.389445:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1220 00000100:00100000:1.0:1782758624.389454:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869120:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758624.389915:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869120:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 461us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758624.389923:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1220 00000100:00100000:3.0:1782758624.392530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758624.395702:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869248 00000100:00100000:1.0:1782758624.395716:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869248 00000100:00100000:1.0:1782758624.395782:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1221 00000100:00100000:1.0:1782758624.395802:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869248:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758624.395928:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869248:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 127us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758624.395936:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1221 00000100:00100000:3.0:1782758624.412289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758624.414679:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869376 00000100:00100000:0.0:1782758624.414695:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869376 00000100:00100000:0.0:1782758624.414754:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 673 00000100:00100000:0.0:1782758624.414766:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58895:x1869355196869376:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782758624.419373:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:58895:x1869355196869376:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 4600us (7082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758624.419386:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 673 00000100:00100000:1.0:1782758624.433529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758624.433578:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869504 00000100:00100000:1.0:1782758624.433587:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869504 00000100:00100000:1.0:1782758624.433642:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 674 00000100:00100000:1.0:1782758624.433652:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58895:x1869355196869504:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758624.434069:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:58895:x1869355196869504:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 417us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758624.434077:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 674 00000100:00100000:1.0:1782758624.441038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758624.441090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869632 00000100:00100000:1.0:1782758624.441102:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869632 00000100:00100000:1.0:1782758624.441159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00100000:1.0:1782758624.441170:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869632:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758624.441623:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58895:x1869355196869632:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 453us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758624.441632:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1222 00000100:00100000:1.0:1782758624.502229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758624.502309:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196869888 00000100:00100000:0.0:1782758624.502319:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196869888 00000100:00100000:0.0:1782758624.502382:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1223 00000100:00100000:0.0:1782758624.502393:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:58899:x1869355196869888:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782758624.502447:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758624.502478:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dc03a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef8 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502506:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9171a0e3a300) 00010000:00010000:0.0:1782758624.502518:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758624.502539:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502554:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502563:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502578:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502584:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.502590:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.503201:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.503212:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.503220:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782758624.511416:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:1.0:1782758624.511434:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2692914610706ns, next at 2693914606126ns, rc = 0 00010000:00010000:1.0:1782758624.511572:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511590:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511601:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511609:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511615:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511621:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511645:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758624.511669:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511675:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511681:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511686:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758624.511690:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511697:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511711:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:1.0:1782758624.511714:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782758624.511719:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511724:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc064 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511741:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511746:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511751:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511756:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758624.511758:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511764:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511770:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:1.0:1782758624.511772:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758624.511775:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758624.511781:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc056 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758624.511796:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e859867 reply state 000000002a11f25a transno 4294967770 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758624.511805:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758624.511928:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:58899:x1869355196869888:12345-192.168.204.31@tcp:36:rm.0 Request processed in 9533us (9703us total) trans 4294967770 rc 0/0 00000100:00100000:1.0:1782758624.511936:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1223 00010000:00010000:2.0:1782758624.516570:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758624.516586:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.516597:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758624.516602:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.516612:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.516631:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff91718bcfd700) 00010000:00010000:2.0:1782758624.516635:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782758624.516640:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.516646:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc06b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.516675:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758624.516677:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758624.516679:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758624.517449:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.517923:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.517931:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.519293:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758624.519301:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.519315:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.519332:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff91718bcfdf00) 00010000:00010000:2.0:1782758624.519892:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758624.519898:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758624.519906:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc05d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758624.812076:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758625.208525:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211709440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758625.208596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758625.208669:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709440 00000100:00100000:1.0:1782758625.208676:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709440 00000100:00100000:1.0:1782758625.208731:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1782758625.208741:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211709440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758625.208776:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758625.208836:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211709440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758625.208844:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00080000:1.0:1782758625.208869:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758625.208904:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211709440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758625.837057:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758626.489853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758626.489891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758626.489922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758626.489948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758626.489979:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870400 00000100:00100000:1.0:1782758626.489988:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870400 00000100:00100000:1.0:1782758626.490042:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870272 00000100:00100000:1.0:1782758626.490046:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870272 00000100:00100000:1.0:1782758626.490068:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1511 00000100:00100000:1.0:1782758626.490079:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196870400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758626.490165:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2364:x1869355196870400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758626.490173:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1511 00000100:00100000:1.0:1782758626.490193:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1512 00000100:00100000:1.0:1782758626.490200:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196870272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758626.490224:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196870272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758626.490230:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1512 00000100:00100000:1.0:1782758626.490246:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870016 00000100:00100000:1.0:1782758626.490250:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870016 00000100:00100000:1.0:1782758626.490274:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1462 00000100:00100000:1.0:1782758626.490280:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196870016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758626.490304:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196870016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758626.490310:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1462 00000100:00080000:1.0:1782758626.490340:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758626.490344:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758626.491257:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870144 00000100:00100000:3.0:1782758626.491264:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870144 00000100:00100000:3.0:1782758626.491317:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:3.0:1782758626.491328:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196870144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758626.491379:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2364:x1869355196870144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 54us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758626.491386:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00080000:1.0:1782758626.493094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758626.862462:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758626.941095:0:100369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2695344269739ns, next at 2688142134171ns, rc = 0 00000004:00080000:2.0:1782758626.941211:0:100369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2695344387575ns, next at 2693914606126ns, rc = 0 00000001:00080000:2.0:1782758627.050926:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967770 is committed 00000004:00080000:2.0:1782758627.050944:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000100:00100000:1.0:1782758627.051253:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211709568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782758627.051324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758627.051514:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709568 00000100:00100000:3.0:1782758627.051522:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709568 00000100:00100000:3.0:1782758627.051604:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1782758627.051614:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211709568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782758627.051647:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:38 count 1 00010000:00010000:3.0:1782758627.051673:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758627.051696:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758627.051707:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782758627.051711:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758627.051717:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758627.051746:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758627.051956:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 5 pid: 6597 timeout: 2795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758627.051970:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211709696:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758627.052039:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0f840c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782758627.054207:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758627.056795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758627.056949:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870528 00000100:00100000:1.0:1782758627.056958:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870528 00010000:00010000:1.0:1782758627.057001:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 6 pid: 6597 timeout: 2795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758627.057046:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 457 00000100:00100000:1.0:1782758627.057057:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196870528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758627.057072:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758627.057078:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 6 pid: 6597 timeout: 2795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.057092:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 6 pid: 6597 timeout: 2795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.057116:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758627.057120:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782758627.057126:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.057136:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.057156:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758627.057208:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196870528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758627.057216:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 457 00000004:00080000:2.0:1782758627.059219:0:100223:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000004:00080000:2.0:1782758627.059249:0:100223:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00010000:00010000:0.0:1782758627.059381:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64eff expref: 5 pid: 6597 timeout: 2795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758627.059403:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355211709696:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758627.059427:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758627.059449:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758627.059463:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758627.059474:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758627.059482:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758627.059506:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782758627.059894:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758627.059901:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.059911:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758627.059915:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.059924:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.059941:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.059948:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6c1b1be/0xdd99f5c4777dc072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758627.059968:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758627.059970:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758627.059972:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758627.060583:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211709568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8966us (9254us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1782758627.060592:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000004:00080000:0.0:1782758627.060648:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b77c6680/2, rc 0, transno 4294967373 00000100:00100000:0.0:1782758627.060660:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211709568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758627.244976:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211709952:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758627.245107:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782758627.245114:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211709824:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758627.245164:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211710336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758627.245209:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211710080:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758627.245246:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758627.245252:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211710208:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758627.245319:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709952 00000100:00100000:2.0:1782758627.245327:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709952 00000100:00100000:2.0:1782758627.245367:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710336 00000100:00100000:2.0:1782758627.245370:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710336 00000100:00100000:2.0:1782758627.245392:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710080 00000100:00100000:2.0:1782758627.245395:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710080 00000100:00100000:2.0:1782758627.245410:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1782758627.245432:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211709952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245493:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211709952:12345-0@lo:400:kworker.0 Request processed in 76us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758627.245500:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1782758627.245516:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1782758627.245522:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245547:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211710336:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758627.245552:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1782758627.245562:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1782758627.245568:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211710080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245593:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211710080:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758627.245598:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1782758627.245616:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211709824 00000100:00100000:2.0:1782758627.245619:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211709824 00000100:00100000:2.0:1782758627.245645:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1782758627.245652:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211709824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245680:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211709824:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758627.245686:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1782758627.245717:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710208 00000100:00100000:2.0:1782758627.245720:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710208 00000100:00100000:2.0:1782758627.245745:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1782758627.245751:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211710208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245779:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211710208:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758627.245784:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00080000:2.0:1782758627.245799:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758627.245804:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758627.245851:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211709824:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245866:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211710336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245874:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211709952:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245904:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211710208:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.245912:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211710080:0@lo:400:kworker.0 00000100:00100000:2.0:1782758627.756079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211710464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758627.756152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758627.756207:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710464 00000100:00100000:3.0:1782758627.756215:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710464 00000100:00100000:3.0:1782758627.756263:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1782758627.756273:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211710464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758627.756314:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782758627.756376:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211710464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758627.756383:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1782758627.756736:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211710464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758627.884233:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758628.909081:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782758629.387920:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00010000:00010000:1.0:1782758629.932024:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758630.316562:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758630.316599:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211710592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758630.316670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758630.317454:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710592 00000100:00100000:1.0:1782758630.317464:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710592 00000100:00100000:1.0:1782758630.317535:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1782758630.317545:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211710592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758630.317585:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758630.317640:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211710592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758630.317648:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1782758630.317964:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211710592:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758630.318042:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758630.957054:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758631.609849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758631.609893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758631.609929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758631.609964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758631.610043:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870656 00000100:00100000:0.0:1782758631.610053:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870656 00000100:00100000:0.0:1782758631.610106:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1464 00000100:00100000:0.0:1782758631.610116:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196870656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758631.610183:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196870656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758631.610195:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1464 00000100:00100000:0.0:1782758631.610229:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871040 00000100:00100000:0.0:1782758631.610232:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871040 00000100:00100000:0.0:1782758631.610261:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870912 00000100:00100000:0.0:1782758631.610265:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870912 00000100:00100000:0.0:1782758631.610282:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1514 00000100:00100000:0.0:1782758631.610288:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758631.610315:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758631.610321:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1514 00000100:00100000:0.0:1782758631.610332:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00100000:0.0:1782758631.610338:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196870912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758631.610374:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196870912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758631.610380:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00100000:1.0:1782758631.610460:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196870784 00000100:00100000:1.0:1782758631.610464:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196870784 00000100:00100000:1.0:1782758631.610507:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:1.0:1782758631.610514:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196870784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758631.610543:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196870784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758631.610550:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00080000:2.0:1782758631.610818:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758631.610854:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758631.610856:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758631.982231:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758632.368015:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758632.368048:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211710720:0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.368159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758632.368259:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211710848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.368315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758632.368355:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758632.368364:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211710976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.368399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758632.368443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710720 00000100:00100000:3.0:1782758632.368453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710720 00000100:00100000:3.0:1782758632.368520:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1782758632.368531:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211710720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758632.368573:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710848 00000100:00100000:0.0:1782758632.368587:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710848 00000100:00100000:3.0:1782758632.368601:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211710720:12345-0@lo:400:kworker.0 Request processed in 71us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758632.368611:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1782758632.368646:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211710976 00000100:00100000:0.0:1782758632.368652:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211710976 00000100:00100000:3.0:1782758632.368667:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1782758632.368678:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211710848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758632.368701:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1782758632.368714:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211710976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.368726:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211710848:12345-0@lo:400:kworker.0 Request processed in 49us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758632.368735:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1782758632.368797:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211710848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.369262:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211710720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758632.369355:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211710976:12345-0@lo:400:kworker.0 Request processed in 641us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758632.369366:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00080000:0.0:1782758632.369395:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758632.369439:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211710976:0@lo:400:kworker.0 00000100:00100000:1.0:1782758632.369721:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211711232:0@lo:400:kworker.0 00000100:00100000:1.0:1782758632.369764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758632.369791:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758632.369796:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211711104:0@lo:400:kworker.0 00000100:00100000:1.0:1782758632.369839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758632.371739:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711232 00000100:00100000:0.0:1782758632.371752:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711232 00000100:00080000:2.0:1782758632.372223:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758632.372255:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1782758632.372267:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211711232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758632.372270:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758632.372310:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211711360:0@lo:400:kworker.0 00000100:00100000:0.0:1782758632.372381:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211711232:12345-0@lo:400:kworker.0 Request processed in 115us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758632.372389:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1782758632.372417:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711104 00000100:00100000:0.0:1782758632.372421:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711104 00000100:00100000:0.0:1782758632.372456:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1782758632.372462:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211711104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758632.372537:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211711232:0@lo:400:kworker.0 00000100:00080000:3.0:1782758632.372605:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758632.372670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758632.373234:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711360 00000100:00100000:3.0:1782758632.373241:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711360 00000100:00100000:3.0:1782758632.373326:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1782758632.373348:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211711360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758632.373416:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211711360:12345-0@lo:400:kworker.0 Request processed in 82us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758632.373424:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1782758632.373457:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:3.0:1782758632.373463:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b77c6680, transno 4294967373 00000100:00100000:3.0:1782758632.373476:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211711360:0@lo:400:kworker.0 00000100:00080000:2.0:1782758632.374746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758632.375088:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211711104:12345-0@lo:400:kworker.0 Request processed in 2618us (5240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758632.375102:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782758632.376060:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211711104:0@lo:400:kworker.0 00000100:00100000:2.0:1782758632.878975:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211711488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758632.879047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758632.880803:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711488 00000100:00100000:1.0:1782758632.880819:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711488 00000100:00100000:1.0:1782758632.880904:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1782758632.880914:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211711488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758632.880958:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758632.881040:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211711488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758632.881049:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1782758632.881291:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211711488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758633.005257:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758634.028558:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758635.052071:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758635.436945:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211711616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758635.437018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758635.437194:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711616 00000100:00100000:0.0:1782758635.437203:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711616 00000100:00100000:0.0:1782758635.437291:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1782758635.437301:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211711616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758635.437338:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758635.437406:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211711616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758635.437413:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:2.0:1782758635.437477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758635.437557:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211711616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758636.076065:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758636.728938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758636.728990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758636.729032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758636.729078:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871552 00000100:00100000:1.0:1782758636.729087:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871552 00000100:00100000:3.0:1782758636.729112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758636.729136:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871424 00000100:00100000:3.0:1782758636.729140:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871424 00000100:00100000:1.0:1782758636.729153:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1518 00000100:00100000:2.0:1782758636.729215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871168 00000100:00100000:2.0:1782758636.729220:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871168 00000100:00100000:2.0:1782758636.729262:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1466 00000100:00100000:2.0:1782758636.729271:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196871168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758636.729309:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871296 00000100:00100000:0.0:1782758636.729327:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871296 00000100:00100000:2.0:1782758636.729343:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196871168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758636.729350:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1466 00000100:00100000:0.0:1782758636.729358:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:0.0:1782758636.729365:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196871296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758636.729396:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196871296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758636.729403:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00080000:0.0:1782758636.729451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758636.729456:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758636.729458:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758636.730995:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758636.731307:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 325us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758636.742972:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000100:00100000:3.0:1782758636.742995:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758636.743202:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 216us (14088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758636.743210:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000100:00100000:1.0:1782758636.750352:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1518 00010000:00010000:1.0:1782758637.100145:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758637.484175:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211711744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.484277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.484330:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211712256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.484355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.484370:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758637.484375:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211712128:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.484397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.484429:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712128 00000100:00100000:1.0:1782758637.484436:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712128 00000100:00100000:0.0:1782758637.484451:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211711872:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.484487:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1782758637.484492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.484498:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211712128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758637.484522:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211712384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758637.484563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.484567:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211712128:12345-0@lo:400:kworker.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758637.484579:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1782758637.484589:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758637.484598:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211712000:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.484599:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712384 00000100:00100000:1.0:1782758637.484604:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712384 00000100:00100000:1.0:1782758637.484633:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1782758637.484639:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211712384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758637.484965:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711744 00000100:00100000:3.0:1782758637.484970:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711744 00000100:00100000:3.0:1782758637.484993:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1782758637.484999:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211711744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758637.487269:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712256 00000100:00100000:2.0:1782758637.487282:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712256 00000100:00100000:2.0:1782758637.487327:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211711872 00000100:00100000:2.0:1782758637.487330:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211711872 00000100:00100000:2.0:1782758637.487557:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1782758637.487567:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211712256:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758637.491296:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758637.491308:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758637.491311:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758637.491365:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211712128:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.491452:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211712384:12345-0@lo:400:kworker.0 Request processed in 6811us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758637.491462:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1782758637.491529:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1782758637.491541:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211711872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.491592:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211711872:12345-0@lo:400:kworker.0 Request processed in 55us (7101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758637.491598:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1782758637.494910:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211711744:12345-0@lo:400:kworker.0 Request processed in 9900us (10622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758637.494926:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1782758637.495019:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211711744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758637.503445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758637.503532:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712000 00000100:00100000:0.0:1782758637.503542:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712000 00000100:00080000:3.0:1782758637.505730:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758637.506269:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211712256:12345-0@lo:400:kworker.0 Request processed in 18694us (21903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758637.506285:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1782758637.506332:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1782758637.506347:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211712000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758637.506404:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211712000:12345-0@lo:400:kworker.0 Request processed in 64us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758637.506408:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1782758637.506570:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211712256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.511510:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211712000:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.511530:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211711872:0@lo:400:kworker.0 00000100:00100000:1.0:1782758637.511544:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211712384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758637.997393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758637.997417:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211712512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758637.997491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758637.997610:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712512 00000100:00100000:1.0:1782758637.997617:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712512 00000100:00100000:1.0:1782758637.997664:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1782758637.997672:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211712512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758637.997715:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758637.997762:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211712512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758637.997768:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1782758637.997967:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211712512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758638.124244:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758639.149966:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758640.172010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758640.556527:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211712640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758640.556597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758640.556819:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712640 00000100:00100000:0.0:1782758640.556841:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712640 00000100:00100000:0.0:1782758640.556911:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1782758640.556921:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211712640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758640.556954:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758640.557002:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211712640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758640.557009:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:1.0:1782758640.557147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758640.557193:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211712640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758641.198225:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758641.847055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758641.847106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758641.847159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758641.847265:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871808 00000100:00100000:1.0:1782758641.847278:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871808 00000100:00100000:1.0:1782758641.847349:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:1.0:1782758641.847360:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196871808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758641.847441:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196871808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758641.847448:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00080000:1.0:1782758641.847601:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758641.848608:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872064 00000100:00100000:3.0:1782758641.848616:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872064 00000100:00100000:3.0:1782758641.848670:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1522 00000100:00100000:3.0:1782758641.848678:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196872064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758641.848728:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196872064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758641.848736:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1522 00000100:00100000:2.0:1782758641.848896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758641.849014:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871936 00000100:00100000:3.0:1782758641.849018:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871936 00000100:00100000:3.0:1782758641.849052:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1523 00000100:00100000:3.0:1782758641.849059:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758641.849091:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196871936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758641.849097:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1523 00000100:00080000:1.0:1782758641.849681:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758641.849686:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758641.855721:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196871680 00000100:00100000:0.0:1782758641.855738:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196871680 00000100:00100000:0.0:1782758641.855908:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1468 00000100:00100000:0.0:1782758641.855920:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196871680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758641.856019:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196871680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758641.856027:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1468 00010000:00010000:1.0:1782758642.220125:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758642.604231:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211713024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758642.604305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758642.604362:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782758642.604368:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211712896:0@lo:400:kworker.0 00000100:00100000:1.0:1782758642.604391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758642.604408:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211713408:0@lo:400:kworker.0 00000100:00100000:1.0:1782758642.604431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758642.604460:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713024 00000100:00100000:1.0:1782758642.604467:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713024 00000100:00100000:3.0:1782758642.604603:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211712768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.604636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758642.604669:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211713280:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.604688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758642.604707:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758642.604712:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211713152:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.604731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758642.604755:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713408 00000100:00100000:3.0:1782758642.604759:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713408 00000100:00100000:1.0:1782758642.604865:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712896 00000100:00100000:1.0:1782758642.604869:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712896 00000100:00100000:1.0:1782758642.604886:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713280 00000100:00100000:1.0:1782758642.604889:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713280 00000100:00100000:2.0:1782758642.604962:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1782758642.604973:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211713024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758642.605031:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211713024:12345-0@lo:400:kworker.0 Request processed in 61us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758642.605039:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1782758642.605059:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1782758642.605065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211712896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758642.605089:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211712896:12345-0@lo:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758642.605094:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1782758642.605148:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713152 00000100:00100000:2.0:1782758642.605152:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713152 00000100:00100000:0.0:1782758642.605207:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211712768 00000100:00100000:0.0:1782758642.605212:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211712768 00000100:00100000:0.0:1782758642.605241:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1782758642.605248:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758642.605287:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211712768:12345-0@lo:400:kworker.0 Request processed in 40us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758642.605293:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1782758642.607743:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1782758642.607757:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211713408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.607857:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211713408:12345-0@lo:400:kworker.0 Request processed in 104us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758642.607864:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1782758642.610194:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211712768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.610922:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211712896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.610945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211713408:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.610956:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211713024:0@lo:400:kworker.0 00000100:00100000:1.0:1782758642.615728:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1782758642.615743:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211713280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758642.616036:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211713280:12345-0@lo:400:kworker.0 Request processed in 296us (11345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758642.616045:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:2.0:1782758642.618901:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1782758642.618920:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211713152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758642.619031:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211713152:12345-0@lo:400:kworker.0 Request processed in 117us (14297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758642.619038:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1782758642.622648:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211713280:0@lo:400:kworker.0 00000100:00100000:3.0:1782758642.622693:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211713152:0@lo:400:kworker.0 00000100:00080000:0.0:1782758642.624381:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758642.624394:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758642.624398:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758643.116372:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758643.116400:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211713536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758643.116477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758643.116663:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713536 00000100:00100000:1.0:1782758643.116673:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713536 00000100:00100000:1.0:1782758643.116729:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1782758643.116738:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211713536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758643.116774:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758643.116847:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211713536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758643.116854:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1782758643.116940:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211713536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758643.244282:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758643.818184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758643.828552:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872192 00000100:00100000:3.0:1782758643.828572:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872192 00000100:00100000:3.0:1782758643.828697:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1224 00000100:00100000:3.0:1782758643.828711:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872192:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758643.828903:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872192:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 196us (10734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758643.828913:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1224 00000100:00080000:0.0:1782758643.830477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758643.838354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758643.839436:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872320 00000100:00100000:0.0:1782758643.839451:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872320 00000100:00100000:0.0:1782758643.839543:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 676 00000100:00100000:0.0:1782758643.839554:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872320:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782758643.840069:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758643.840699:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872320:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 1140us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758643.840715:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 676 00000100:00100000:2.0:1782758643.843971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758643.844257:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872448 00000100:00100000:3.0:1782758643.844272:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872448 00000100:00100000:3.0:1782758643.844362:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 677 00000100:00100000:3.0:1782758643.844373:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872448:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782758643.845002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758643.845255:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872448:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 880us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758643.845265:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 677 00000100:00100000:2.0:1782758643.854077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758643.863185:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872576 00000100:00100000:3.0:1782758643.863208:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872576 00000100:00100000:1.0:1782758643.875157:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1225 00000100:00100000:1.0:1782758643.875175:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872576:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758643.877376:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872576:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 2191us (23579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758643.877395:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1225 00000100:00100000:0.0:1782758643.885313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758643.885895:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872704 00000100:00100000:1.0:1782758643.885910:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872704 00000100:00100000:1.0:1782758643.885983:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:1.0:1782758643.885996:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872704:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782758643.886147:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196872704:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 152us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758643.886155:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1226 00000100:00100000:3.0:1782758643.894063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758643.895038:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872832 00000100:00100000:1.0:1782758643.895054:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872832 00000100:00100000:1.0:1782758643.895133:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 678 00000100:00100000:1.0:1782758643.895144:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872832:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782758643.902207:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872832:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 7045us (8138us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758643.902226:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 678 00000100:00100000:2.0:1782758643.922712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758643.922758:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196872960 00000100:00100000:2.0:1782758643.922769:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196872960 00000100:00100000:2.0:1782758643.922868:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 679 00000100:00100000:2.0:1782758643.922890:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872960:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782758643.926689:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59117:x1869355196872960:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 3784us (3975us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758643.926709:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 679 00000100:00100000:1.0:1782758643.949844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758643.950020:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196873088 00000100:00100000:3.0:1782758643.950033:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196873088 00000100:00100000:3.0:1782758643.950099:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1227 00000100:00100000:3.0:1782758643.950122:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196873088:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782758643.950710:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59117:x1869355196873088:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 600us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758643.950720:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1227 00010000:00010000:3.0:1782758644.274383:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758645.292319:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758645.676410:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758645.676436:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211713664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758645.676512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758645.677415:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713664 00000100:00100000:0.0:1782758645.677424:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713664 00000100:00100000:0.0:1782758645.677487:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1782758645.677498:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211713664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758645.677533:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758645.677582:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211713664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758645.677588:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1782758645.677632:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211713664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758645.678120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758646.327673:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758646.431681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.433319:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196873216 00000100:00100000:3.0:1782758646.433331:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196873216 00000100:00100000:3.0:1782758646.433441:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1228 00000100:00100000:3.0:1782758646.433450:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59131:x1869355196873216:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758646.433471:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758646.433490:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f06 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433558:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433573:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433584:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758646.433813:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1782758646.433817:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758646.433919:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433946:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f06 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433961:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f06 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.433971:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758646.433974:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758646.433978:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758646.436459:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59131:x1869355196873216:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2998us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758646.436471:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1228 00000100:00080000:2.0:1782758646.437500:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758646.438605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.438909:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196873472 00000100:00100000:3.0:1782758646.438919:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196873472 00000100:00100000:3.0:1782758646.438975:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1229 00000100:00100000:3.0:1782758646.438985:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59131:x1869355196873472:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782758646.439038:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782758646.444303:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f06 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.444356:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dc01e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ef1 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.444373:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3a100) 00010000:00010000:3.0:1782758646.444387:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758646.444424:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.444437:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.444447:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758646.573082:0:100223:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967771 is committed 00000004:00010000:3.0:1782758646.573088:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038b4167e reply state 00000000ad8944a3 transno 4294967771 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758646.573103:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782758646.573262:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:3.0:1782758646.573362:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782758646.573389:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59131:x1869355196873472:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 134401us (134784us total) trans 4294967771 rc 0/0 00000100:00100000:3.0:1782758646.573399:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1229 00010000:00010000:0.0:1782758646.573533:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573543:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573550:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573555:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758646.573560:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573568:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573584:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75c00) 00010000:00010000:0.0:1782758646.573587:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758646.573592:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.573597:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc087 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758646.703537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758646.713170:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196873600 00000100:00100000:2.0:1782758646.713185:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196873600 00000100:00100000:2.0:1782758646.713244:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:2.0:1782758646.713254:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59136:x1869355196873600:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782758646.713278:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758646.713297:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc08e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f0d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713361:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713375:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713387:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713402:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713409:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.713416:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715247:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715263:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715273:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758646.715350:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1782758646.715354:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758646.715429:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715447:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715453:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715460:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715466:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758646.715471:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715479:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715492:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782758646.715496:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758646.715500:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715505:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715515:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715520:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715525:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715531:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758646.715534:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715540:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715547:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917182dd1500) 00010000:00010000:2.0:1782758646.715549:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758646.715552:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715557:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc09c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715591:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc08e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f0d expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715603:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f0d expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.715610:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:2.0:1782758646.715612:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782758646.715614:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782758646.715678:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59136:x1869355196873600:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 2426us (12150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758646.715685:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1230 00000100:00100000:0.0:1782758646.731944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.732146:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196873856 00000100:00100000:3.0:1782758646.732156:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196873856 00000100:00100000:3.0:1782758646.732211:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1231 00000100:00100000:3.0:1782758646.732221:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59136:x1869355196873856:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758646.732245:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758646.732267:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f14 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732620:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732634:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732644:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732659:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732665:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.732672:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782758646.733882:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:3.0:1782758646.746664:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.746689:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.746701:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748135:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748143:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748150:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748155:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758646.748160:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748167:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748183:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782758646.748187:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758646.748192:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748198:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758646.748213:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd4bbd5d reply state 000000004e94799d transno 4294967772 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758646.748223:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782758646.748269:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f14 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748290:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f14 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.748297:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758646.748299:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758646.748302:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782758646.749819:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59136:x1869355196873856:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 17591us (17877us total) trans 4294967772 rc 0/0 00000100:00100000:3.0:1782758646.749865:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1231 00010000:00010000:0.0:1782758646.771501:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771520:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771528:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771534:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758646.771539:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771546:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771564:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917191f75a00) 00010000:00010000:0.0:1782758646.771568:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758646.771573:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.771579:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc0b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758646.772526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.772674:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874112 00000100:00100000:3.0:1782758646.772684:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874112 00000100:00100000:3.0:1782758646.772750:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1232 00000100:00100000:3.0:1782758646.772761:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59136:x1869355196874112:12345-192.168.204.31@tcp:36:touch.60003 00010000:00010000:3.0:1782758646.772851:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758646.772873:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f14 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.772887:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782758646.772895:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758646.772940:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.772965:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.772977:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758646.773125:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f547fead reply state 0000000014f84f80 transno 4294967773 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758646.773135:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758646.773227:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59136:x1869355196874112:12345-192.168.204.31@tcp:36:touch.60003 Request processed in 467us (707us total) trans 4294967773 rc 0/0 00000100:00100000:3.0:1782758646.773235:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1232 00000100:00100000:1.0:1782758646.776434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782758646.776629:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776641:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776649:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776654:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758646.776659:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776665:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776680:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917191f75400) 00010000:00010000:3.0:1782758646.776684:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758646.776688:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.776693:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758646.776859:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874240 00000100:00100000:2.0:1782758646.776868:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874240 00000100:00100000:2.0:1782758646.776916:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1233 00000100:00100000:2.0:1782758646.776926:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59136:x1869355196874240:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:2.0:1782758646.776946:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758646.782172:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc0d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f1b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.782254:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f1b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.782269:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f1b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.782289:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782758646.782292:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782758646.782296:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758646.782357:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59136:x1869355196874240:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 5433us (5930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758646.782366:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1233 00000100:00100000:2.0:1782758646.785137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758646.785222:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874368 00000100:00100000:0.0:1782758646.785230:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874368 00000100:00100000:0.0:1782758646.785306:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 680 00000100:00100000:0.0:1782758646.785319:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196874368:12345-192.168.204.31@tcp:2:touch.60003 00000100:00100000:0.0:1782758646.785649:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196874368:12345-192.168.204.31@tcp:2:touch.60003 Request processed in 332us (517us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1782758646.785656:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 680 00000100:00080000:3.0:1782758646.785979:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758646.803162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758646.803274:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874624 00000100:00100000:2.0:1782758646.803284:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874624 00000100:00100000:2.0:1782758646.803345:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:2.0:1782758646.803355:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59136:x1869355196874624:12345-192.168.204.31@tcp:35:touch.60003 00000100:00100000:2.0:1782758646.803661:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:59136:x1869355196874624:12345-192.168.204.31@tcp:35:touch.60003 Request processed in 307us (508us total) trans 4294967774 rc 0/0 00000100:00100000:2.0:1782758646.803668:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:2.0:1782758646.892959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.893042:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874752 00000100:00100000:3.0:1782758646.893060:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874752 00000100:00100000:3.0:1782758646.893119:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00100000:3.0:1782758646.893128:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+11:59140:x1869355196874752:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:3.0:1782758646.893150:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758646.893168:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f22 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893229:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893242:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893253:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893266:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893273:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893279:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893367:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893393:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893399:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758646.893433:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x65:0x0]: returning size 0 00000004:00200000:3.0:1782758646.893437:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758646.893456:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893467:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893475:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893481:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893488:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893493:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758646.893497:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893504:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893515:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782758646.893518:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758646.893523:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893529:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc0e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893541:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893547:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893554:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893559:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758646.893562:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893568:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893573:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917191f75400) 00010000:00010000:3.0:1782758646.893575:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758646.893578:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893584:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc0e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893608:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc0db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f22 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893620:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f22 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.893628:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917182dd1500) 00010000:00010000:3.0:1782758646.893630:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782758646.893633:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690400, rc 0) 00000100:00100000:3.0:1782758646.893697:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+12:59140:x1869355196874752:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 570us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758646.893703:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1234 00000100:00100000:0.0:1782758646.903997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758646.904096:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196874880 00000100:00100000:2.0:1782758646.904107:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196874880 00000100:00100000:2.0:1782758646.904165:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 681 00000100:00100000:2.0:1782758646.904176:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2361:x1869355196874880:12345-192.168.204.31@tcp:101:rm.60003 00010000:00010000:2.0:1782758646.904193:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758646.904213:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f29 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758646.904239:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x6a42bcf5, atime: 0x6a42bcf5, ctime: 0x6a42bcf5, blocks: 0x1 00010000:00010000:2.0:1782758646.904257:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=2715s v=(0 0) 00010000:00010000:2.0:1782758646.904261:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758646.904270:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.904289:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758646.904303:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758646.904361:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2361:x1869355196874880:12345-192.168.204.31@tcp:101:rm.60003 Request processed in 186us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758646.904377:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 681 00000100:00100000:1.0:1782758646.908316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758646.908420:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875136 00000100:00100000:0.0:1782758646.908429:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875136 00000100:00100000:0.0:1782758646.908487:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1235 00000100:00100000:0.0:1782758646.908497:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:59140:x1869355196875136:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:0.0:1782758646.908545:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758646.908571:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690400/0xdd99f5c4777dc0f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f22 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908592:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc0d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f1b expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908602:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff917182dd1500) 00010000:00010000:0.0:1782758646.908611:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758646.908629:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908645:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908653:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908667:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908674:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908681:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908811:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908819:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.908880:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758646.909588:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:0.0:1782758646.909597:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2715312774252ns, next at 2716312772433ns, rc = 0 00010000:00010000:0.0:1782758646.909654:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.909664:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.909677:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.909685:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.909691:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.909697:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910062:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758646.910084:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910091:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910098:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910104:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758646.910108:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910115:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910126:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758646.910129:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758646.910133:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910139:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc10c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910154:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910159:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910165:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910170:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758646.910173:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910178:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910184:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782758646.910186:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758646.910189:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.910195:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc0fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758646.910203:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc20289f reply state 000000009811623e transno 4294967775 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758646.910217:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758646.910293:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:59140:x1869355196875136:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 1795us (1982us total) trans 4294967775 rc 0/0 00000100:00100000:0.0:1782758646.910301:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1235 00010000:00010000:3.0:1782758646.913239:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758646.913251:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.913262:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758646.913265:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.913276:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.913291:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:3.0:1782758646.913294:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782758646.913298:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.913304:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51a00/0xdd99f5c4777dc113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758646.913324:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758646.913327:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758646.913329:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758646.913474:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913484:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913490:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913496:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758646.913500:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913506:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913515:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff91718bcfd900) 00010000:00010000:0.0:1782758646.913517:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758646.913520:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758646.913526:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758646.964580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758646.964694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758646.964848:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875392 00000100:00100000:3.0:1782758646.964858:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875392 00000100:00100000:3.0:1782758646.964931:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1526 00000100:00100000:3.0:1782758646.964941:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196875392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758646.965022:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196875392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758646.965029:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1526 00000100:00100000:0.0:1782758646.965664:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875264 00000100:00100000:0.0:1782758646.965669:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875264 00000100:00100000:0.0:1782758646.965718:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1470 00000100:00100000:0.0:1782758646.965726:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196875264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758646.965771:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196875264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758646.965779:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1470 00000100:00080000:1.0:1782758646.966865:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782758647.342275:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758647.730720:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211714048:0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.730784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758647.730852:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782758647.730858:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211713920:0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.730879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758647.730893:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211714432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.730915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758647.730941:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714048 00000100:00100000:3.0:1782758647.730948:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714048 00000100:00100000:3.0:1782758647.730995:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713920 00000100:00100000:3.0:1782758647.730998:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713920 00000100:00100000:3.0:1782758647.731017:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1782758647.731024:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211714048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.731080:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211714048:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758647.731087:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1782758647.731103:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1782758647.731109:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211713920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.731129:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211713920:12345-0@lo:400:kworker.0 Request processed in 20us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758647.731134:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1782758647.731167:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211713920:0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.731176:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211714048:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731304:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211713792:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758647.731372:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211714304:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758647.731406:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758647.731411:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211714176:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782758647.731445:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758647.731454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714304 00000100:00100000:1.0:1782758647.731457:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714304 00000100:00100000:1.0:1782758647.731480:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1782758647.731485:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211714304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731514:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211714304:12345-0@lo:400:kworker.0 Request processed in 28us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758647.731519:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1782758647.731539:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714432 00000100:00100000:1.0:1782758647.731542:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714432 00000100:00100000:1.0:1782758647.731561:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1782758647.731566:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211714432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731592:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211714432:12345-0@lo:400:kworker.0 Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758647.731598:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1782758647.731605:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714176 00000100:00100000:1.0:1782758647.731608:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714176 00000100:00100000:1.0:1782758647.731627:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1782758647.731631:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731651:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211714176:12345-0@lo:400:kworker.0 Request processed in 20us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758647.731657:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00080000:1.0:1782758647.731672:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758647.731674:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758647.731676:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758647.731701:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211714176:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731710:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211714304:0@lo:400:kworker.0 00000100:00100000:1.0:1782758647.731732:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211714432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.737509:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211713792 00000100:00100000:3.0:1782758647.737525:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211713792 00000100:00100000:3.0:1782758647.737590:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1782758647.737599:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211713792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758647.737687:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211713792:12345-0@lo:400:kworker.0 Request processed in 89us (6350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758647.737706:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1782758647.737756:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211713792:0@lo:400:kworker.0 00000100:00100000:2.0:1782758648.236180:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211714560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758648.236252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758648.237883:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714560 00000100:00100000:1.0:1782758648.237895:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714560 00000100:00100000:1.0:1782758648.237952:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1782758648.237972:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211714560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758648.238013:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758648.238262:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211714560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758648.238270:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1782758648.238663:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211714560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758648.380579:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758648.574687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758648.574982:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875520 00000100:00100000:3.0:1782758648.574993:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875520 00000100:00100000:3.0:1782758648.575084:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1236 00000100:00100000:3.0:1782758648.575096:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+11:59155:x1869355196875520:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782758648.575123:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758648.575146:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc11a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f30 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575235:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575250:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575262:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758648.575323:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1782758648.575327:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758648.575352:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575485:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc11a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f30 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575505:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f30 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.575513:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782758648.575516:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758648.575521:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758648.575585:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+12:59155:x1869355196875520:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 492us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758648.575602:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1236 00000100:00080000:1.0:1782758648.576117:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758648.580189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758648.580265:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875776 00000100:00100000:1.0:1782758648.580276:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875776 00000100:00100000:1.0:1782758648.580345:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1237 00000100:00100000:1.0:1782758648.580356:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+12:59155:x1869355196875776:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782758648.580419:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782758648.580449:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690600/0xdd99f5c4777dc121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f30 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.580471:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc0a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f0d expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.580482:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917182dd1700) 00010000:00010000:1.0:1782758648.580494:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758648.580522:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.580534:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.580544:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782758648.683709:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967775 is committed 00000004:00080000:2.0:1782758648.683726:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00000001:00080000:2.0:1782758648.683752:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967776 is committed 00000100:00100000:3.0:1782758648.684006:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758648.684041:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211714688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782758648.684116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758648.684185:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714688 00000100:00100000:3.0:1782758648.684192:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714688 00000100:00100000:3.0:1782758648.684240:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1782758648.684249:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211714688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782758648.684279:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:39 count 1 00000004:00010000:1.0:1782758648.685657:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc1b6933 reply state 00000000fbfdca72 transno 4294967776 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758648.685675:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782758648.685860:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:1.0:1782758648.685959:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782758648.685976:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59155:x1869355196875776:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 105620us (105796us total) trans 4294967776 rc 0/0 00000100:00100000:1.0:1782758648.685984:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1237 00010000:00010000:3.0:1782758648.686586:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686608:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686617:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782758648.686621:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782758648.686626:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686662:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686676:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 6 pid: 6598 timeout: 2817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758648.686689:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211714816:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782758648.686754:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff917184d113c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782758648.686786:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686795:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686806:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686811:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758648.686815:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686837:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686857:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9171a0e3ae00) 00010000:00010000:3.0:1782758648.686860:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782758648.686864:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.686869:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dc128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758648.697894:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211714816:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782758648.697935:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758648.710941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758648.711878:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196875904 00000100:00100000:1.0:1782758648.711894:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196875904 00010000:00010000:1.0:1782758648.711982:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 2817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758648.712030:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 458 00000100:00100000:1.0:1782758648.712040:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2362:x1869355196875904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758648.712058:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758648.712063:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 2817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.712077:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 2817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.712100:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b5a967/0xdd99f5c4777dc0f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f29 expref: 7 pid: 6598 timeout: 2817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.712116:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758648.712120:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782758648.712125:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.712132:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.712157:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758648.712210:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196875904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 172us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758648.712217:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 458 00010000:00010000:0.0:1782758648.712360:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758648.712379:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758648.712390:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758648.712396:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758648.712418:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782758648.712958:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211714688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28709us (28841us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1782758648.712968:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000004:00080000:0.0:1782758648.713026:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170835f9500/2, rc 0, transno 4294967375 00000100:00100000:0.0:1782758648.713033:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211714688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782758648.714063:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758648.714072:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.714083:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758648.714087:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.714097:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.714115:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.714123:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e84a7ae1/0xdd99f5c4777dc12f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758648.714144:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758648.714146:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758648.714148:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782758648.726270:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758648.854777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758648.854920:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876032 00000100:00100000:3.0:1782758648.854931:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876032 00000100:00100000:3.0:1782758648.855006:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1238 00000100:00100000:3.0:1782758648.855026:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59159:x1869355196876032:12345-192.168.204.31@tcp:101:touch.60003 00010000:00010000:3.0:1782758648.855062:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758648.855083:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f37 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855148:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855163:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855173:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855186:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855193:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855199:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855673:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855683:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855690:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758648.855771:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1782758648.855776:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758648.855896:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855910:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855920:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855928:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855933:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758648.855937:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855944:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855956:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758648.855958:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758648.855964:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855969:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855980:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855985:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855990:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.855995:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758648.855998:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856003:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856009:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75400) 00010000:00010000:3.0:1782758648.856022:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758648.856025:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856031:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc144 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856063:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f37 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856077:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f37 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758648.856083:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75100) 00010000:00010000:3.0:1782758648.856086:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782758648.856088:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758648.856153:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59159:x1869355196876032:12345-192.168.204.31@tcp:101:touch.60003 Request processed in 1138us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758648.856161:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1238 00010000:00010000:1.0:1782758649.390010:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758649.819551:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000001:00080000:1.0:1782758649.819566:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:3.0:1782758649.909852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758649.909879:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876160 00000100:00100000:2.0:1782758649.909889:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876160 00000100:00100000:2.0:1782758649.909941:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1239 00000100:00100000:2.0:1782758649.909951:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59173:x1869355196876160:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782758649.909970:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758649.910660:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f3e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.910888:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.910904:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.910921:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758649.911159:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1782758649.911164:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758649.911401:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.911435:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f3e expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.911454:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f3e expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758649.911477:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782758649.911481:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758649.911485:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758649.911554:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59173:x1869355196876160:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1605us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758649.911560:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1239 00000100:00100000:1.0:1782758649.920984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758649.923606:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876416 00000100:00100000:0.0:1782758649.923622:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876416 00000100:00100000:0.0:1782758649.923696:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1240 00000100:00100000:0.0:1782758649.923707:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59173:x1869355196876416:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782758649.923759:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782758649.923787:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695800/0xdd99f5c4777dc159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f3e expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.923809:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690e00/0xdd99f5c4777dc14b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f37 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.923843:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75100) 00010000:00010000:0.0:1782758649.923854:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758649.923879:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.923892:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.923902:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758649.924949:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc6143cb reply state 000000002828ec96 transno 4294967777 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758649.924962:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782758649.925079:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:0.0:1782758649.929084:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59173:x1869355196876416:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 5364us (8096us total) trans 4294967777 rc 0/0 00000100:00100000:0.0:1782758649.929099:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1240 00010000:00010000:0.0:1782758649.945685:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945702:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945710:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945716:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758649.945721:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945729:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945747:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd500) 00010000:00010000:0.0:1782758649.945750:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782758649.945756:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758649.945761:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758650.161183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758650.161314:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876544 00000100:00100000:3.0:1782758650.161324:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876544 00000100:00100000:3.0:1782758650.161394:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1241 00000100:00100000:3.0:1782758650.161405:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196876544:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758650.161550:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196876544:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758650.161558:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1241 00000100:00080000:1.0:1782758650.161666:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758650.164168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.164269:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876672 00000100:00100000:2.0:1782758650.164277:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876672 00000100:00100000:2.0:1782758650.164345:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 683 00000100:00100000:2.0:1782758650.164357:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196876672:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758650.164742:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196876672:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 387us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758650.164750:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 683 00000100:00080000:1.0:1782758650.165345:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758650.167963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758650.168065:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876800 00000100:00100000:3.0:1782758650.168078:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876800 00000100:00100000:3.0:1782758650.168156:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 684 00000100:00100000:3.0:1782758650.168167:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196876800:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758650.168594:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196876800:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 426us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758650.168602:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 684 00000100:00080000:1.0:1782758650.168861:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758650.171405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758650.171612:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196876928 00000100:00100000:0.0:1782758650.171623:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196876928 00000100:00100000:0.0:1782758650.171744:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:0.0:1782758650.171756:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196876928:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758650.172222:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196876928:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 468us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758650.172231:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1242 00000100:00100000:2.0:1782758650.178107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758650.178233:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877056 00000100:00100000:1.0:1782758650.178246:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877056 00000100:00100000:1.0:1782758650.178321:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1243 00000100:00100000:1.0:1782758650.178331:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196877056:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:1.0:1782758650.178449:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196877056:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758650.178458:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1243 00000100:00100000:1.0:1782758650.182365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758650.182508:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877184 00000100:00100000:3.0:1782758650.182519:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877184 00000100:00100000:3.0:1782758650.182626:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 685 00000100:00100000:3.0:1782758650.182635:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196877184:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758650.183223:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196877184:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 588us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758650.183231:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 685 00000100:00100000:2.0:1782758650.189126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758650.189223:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877312 00000100:00100000:3.0:1782758650.189233:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877312 00000100:00100000:3.0:1782758650.189459:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:3.0:1782758650.189470:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196877312:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758650.189911:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59185:x1869355196877312:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 443us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758650.189923:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:1.0:1782758650.194007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.194177:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877440 00000100:00100000:2.0:1782758650.194187:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877440 00000100:00100000:2.0:1782758650.194277:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1244 00000100:00100000:2.0:1782758650.194288:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196877440:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758650.197272:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59185:x1869355196877440:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 2973us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758650.197287:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1244 00000100:00100000:1.0:1782758650.312969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758650.313254:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877568 00000100:00100000:0.0:1782758650.313265:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877568 00000100:00100000:0.0:1782758650.313333:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1245 00000100:00100000:0.0:1782758650.313343:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59189:x1869355196877568:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:0.0:1782758650.313365:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758650.313386:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313449:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313462:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313473:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313486:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313494:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313500:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.313992:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314006:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314013:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758650.314096:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:0.0:1782758650.314101:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758650.314170:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314182:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314188:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314195:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314201:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758650.314206:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314213:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314224:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:0.0:1782758650.314227:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758650.314231:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314240:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc16e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314250:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314256:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314262:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314266:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758650.314269:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314275:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314281:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff91718bcfd500) 00010000:00010000:0.0:1782758650.314283:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758650.314286:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314291:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc175 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314319:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f45 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314332:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f45 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758650.314339:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758650.314342:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782758650.314344:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758650.314403:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59189:x1869355196877568:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 1061us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758650.314410:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1245 00000100:00100000:3.0:1782758650.319880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.320091:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877824 00000100:00100000:2.0:1782758650.320101:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877824 00000100:00100000:2.0:1782758650.320163:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1246 00000100:00100000:2.0:1782758650.320174:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59189:x1869355196877824:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758650.320211:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758650.320233:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc183 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f4c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320582:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320597:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320610:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320625:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320632:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.320639:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782758650.325051:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:2.0:1782758650.325360:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dc198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325379:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dc198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325393:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dc198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325435:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325443:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325449:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325455:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758650.325460:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325467:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325478:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:2.0:1782758650.325482:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758650.325487:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325493:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc18a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782758650.325506:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5451a79 reply state 000000008f1eb915 transno 4294967778 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758650.325516:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782758650.325552:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc183 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f4c expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325573:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dc198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f4c expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.325580:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782758650.325582:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782758650.325585:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758650.325666:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+11:59189:x1869355196877824:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 5494us (5797us total) trans 4294967778 rc 0/0 00000100:00100000:2.0:1782758650.325675:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1246 00010000:00010000:3.0:1782758650.331978:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332006:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332015:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332021:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758650.332027:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332035:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332060:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff917182dd1600) 00010000:00010000:3.0:1782758650.332064:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758650.332069:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758650.332076:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc191 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758650.340545:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.340645:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196877952 00000100:00100000:2.0:1782758650.340656:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196877952 00000100:00100000:2.0:1782758650.340732:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:2.0:1782758650.340742:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59189:x1869355196877952:12345-192.168.204.31@tcp:101:dd.60003 00010000:00010000:2.0:1782758650.340762:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758650.340785:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f53 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782758650.340813:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782758650.340875:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=2718s v=(0 0) 00010000:00010000:2.0:1782758650.340881:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782758650.340891:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.340909:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758650.340929:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758650.341002:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59189:x1869355196877952:12345-192.168.204.31@tcp:101:dd.60003 Request processed in 262us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758650.341010:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:1.0:1782758650.365099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758650.366850:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878080 00000100:00100000:0.0:1782758650.366863:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878080 00002000:00100000:0.0:1782758650.366926:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9171b2dff100 x1869355196878080/t0(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1782758661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1782758650.366938:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b2dff100 with x1869355196878080 ext(0->1048575) 00002000:00010000:0.0:1782758650.366944:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b2dff100 00000100:00100000:0.0:1782758650.367428:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:0.0:1782758650.367445:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196878080:12345-192.168.204.31@tcp:4:dd.60003 00000100:00100000:2.0:1782758650.396237:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196878080:12345-192.168.204.31@tcp:4:dd.60003 Request processed in 28787us (31138us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1782758650.396252:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00002000:00100000:2.0:1782758650.396265:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9171b2dff100 x1869355196878080/t4294967374(0) o4->7285eadf-a700-4e2b-8948-9c4e88301f08@192.168.204.31@tcp:566/0 lens 488/448 e 0 to 0 dl 1782758661 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1782758650.396276:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b2dff100 with x1869355196878080 ext(0->1048575) 00002000:00010000:2.0:1782758650.396284:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9171b2dff100 00000100:00100000:1.0:1782758650.404038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.404147:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878208 00000100:00100000:2.0:1782758650.404156:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878208 00000100:00100000:2.0:1782758650.404474:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1247 00000100:00100000:2.0:1782758650.404487:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59189:x1869355196878208:12345-192.168.204.31@tcp:44:dd.60003 00010000:00010000:2.0:1782758650.417503:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782758650.455575:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967777 is committed 00000001:00080000:0.0:1782758650.455603:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967778 is committed 00000100:00100000:2.0:1782758650.455699:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59189:x1869355196878208:12345-192.168.204.31@tcp:44:dd.60003 Request processed in 51210us (51665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758650.455712:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1247 00000100:00100000:0.0:1782758650.459327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.459555:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878336 00000100:00100000:2.0:1782758650.459564:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878336 00000100:00100000:2.0:1782758650.460051:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 688 00000100:00100000:2.0:1782758650.460063:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196878336:12345-192.168.204.31@tcp:16:dd.60003 00000100:00100000:2.0:1782758650.482702:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2363:x1869355196878336:12345-192.168.204.31@tcp:16:dd.60003 Request processed in 22630us (23373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758650.482718:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 688 00000001:00080000:3.0:1782758650.482872:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000100:00100000:0.0:1782758650.486963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758650.487033:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878592 00000100:00100000:2.0:1782758650.487042:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878592 00000100:00100000:2.0:1782758650.487231:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:2.0:1782758650.487242:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59189:x1869355196878592:12345-192.168.204.31@tcp:35:dd.60003 00000100:00100000:2.0:1782758650.487803:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59189:x1869355196878592:12345-192.168.204.31@tcp:35:dd.60003 Request processed in 563us (848us total) trans 4294967779 rc 0/0 00000100:00100000:2.0:1782758650.487810:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:2.0:1782758650.797933:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758650.797961:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211714944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758650.798053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758650.800478:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211714944 00000100:00100000:0.0:1782758650.800491:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211714944 00000100:00100000:0.0:1782758650.801065:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1782758650.801077:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211714944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758650.801118:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758650.801209:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211714944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (3154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758650.801217:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00080000:1.0:1782758650.801292:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758650.801361:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:3.0:1782758650.801385:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170835f9500, transno 4294967375 00000100:00100000:3.0:1782758650.801500:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211714944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758651.436027:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758652.090207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758652.090256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758652.091046:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878848 00000100:00100000:2.0:1782758652.091064:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878848 00000100:00100000:2.0:1782758652.091185:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1953 00000100:00100000:2.0:1782758652.091200:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2363:x1869355196878848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758652.091343:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+9:2363:x1869355196878848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 146us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758652.091351:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1953 00000100:00080000:1.0:1782758652.091590:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758652.093296:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878720 00000100:00100000:3.0:1782758652.093315:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878720 00000100:00100000:0.0:1782758652.095227:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1472 00000100:00100000:0.0:1782758652.095242:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196878720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758652.095356:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196878720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 117us (5161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758652.095364:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1472 00000100:00100000:1.0:1782758652.102365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758652.102478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758652.102754:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196878976 00000100:00100000:3.0:1782758652.102762:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879104 00000100:00100000:2.0:1782758652.102772:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196878976 00000100:00100000:3.0:1782758652.102775:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879104 00000100:00100000:3.0:1782758652.102893:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1529 00000100:00100000:3.0:1782758652.102904:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196879104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758652.103014:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2363:x1869355196879104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758652.103026:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1529 00000100:00080000:1.0:1782758652.103097:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758652.103102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782758652.107864:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967779 is committed 00000100:00100000:2.0:1782758652.115684:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1530 00000100:00100000:2.0:1782758652.115719:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196878976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758652.115874:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196878976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 162us (13510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758652.115885:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1530 00010000:00010000:1.0:1782758652.462717:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758652.848685:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211715072:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.848773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.848890:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211715584:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.848920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.848953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758652.848959:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211715200:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.848984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.849007:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211715712:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.849032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.849069:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211715328:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.849093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.849113:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758652.849119:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211715456:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.849142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758652.849177:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715584 00000100:00100000:3.0:1782758652.849185:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715584 00000100:00100000:3.0:1782758652.849237:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715200 00000100:00100000:3.0:1782758652.849241:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715200 00000100:00100000:3.0:1782758652.849256:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715328 00000100:00100000:3.0:1782758652.849258:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715328 00000100:00100000:3.0:1782758652.849275:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1782758652.849283:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211715584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.849341:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211715584:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758652.849348:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1782758652.849369:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1782758652.849375:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211715200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.849402:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211715200:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758652.849408:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1782758652.849420:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1782758652.849425:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211715328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758652.849788:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715712 00000100:00100000:2.0:1782758652.849793:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715712 00000100:00100000:2.0:1782758652.849838:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715456 00000100:00100000:2.0:1782758652.849842:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715456 00000100:00100000:2.0:1782758652.849880:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1782758652.849888:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758652.849925:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211715712:12345-0@lo:400:kworker.0 Request processed in 39us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758652.849931:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1782758652.849956:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1782758652.849962:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211715456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758652.849994:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211715456:12345-0@lo:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758652.849999:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:3.0:1782758652.851598:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211715328:12345-0@lo:400:kworker.0 Request processed in 2169us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758652.851609:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1782758652.851671:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211715456:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.851684:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211715328:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.851722:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211715200:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.851735:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211715712:0@lo:400:kworker.0 00000100:00100000:3.0:1782758652.851747:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211715584:0@lo:400:kworker.0 00000100:00100000:1.0:1782758652.851865:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715072 00000100:00100000:1.0:1782758652.851872:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715072 00000100:00100000:1.0:1782758652.851912:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1782758652.851921:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758652.851980:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211715072:12345-0@lo:400:kworker.0 Request processed in 59us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758652.851986:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00080000:1.0:1782758652.852020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758652.852025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758652.852028:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758652.853581:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211715072:0@lo:400:kworker.0 00000100:00100000:0.0:1782758653.356644:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758653.356668:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758653.356740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758653.356802:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715840 00000100:00100000:0.0:1782758653.356809:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715840 00000100:00100000:0.0:1782758653.356878:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1782758653.356889:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211715840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758653.356938:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758653.356988:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211715840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758653.356995:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1782758653.357045:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211715840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758653.490788:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758653.868514:0:100784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2722271689106ns, next at 2716312772433ns, rc = 0 00000004:00080000:2.0:1782758653.868700:0:100784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2722271876461ns, next at 2693914606126ns, rc = 0 00000004:00080000:3.0:1782758653.871437:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000004:00080000:3.0:1782758653.871453:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 112 committed 00010000:00010000:1.0:1782758654.509392:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758655.532082:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758655.895398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758655.898119:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879232 00000100:00100000:3.0:1782758655.898132:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879232 00000100:00100000:3.0:1782758655.898231:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1248 00000100:00100000:3.0:1782758655.898243:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879232:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00080000:1.0:1782758655.898414:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758655.898585:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879232:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 344us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758655.898593:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1248 00000100:00100000:3.0:1782758655.901601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758655.901808:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879360 00000100:00100000:1.0:1782758655.901818:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879360 00000100:00100000:1.0:1782758655.901915:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 689 00000100:00100000:1.0:1782758655.901926:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59382:x1869355196879360:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:1.0:1782758655.902565:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59382:x1869355196879360:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 639us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758655.902574:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 689 00000100:00080000:3.0:1782758655.902665:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758655.910746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758655.910976:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879488 00000100:00100000:2.0:1782758655.910987:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879488 00000100:00100000:2.0:1782758655.911090:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00100000:2.0:1782758655.911102:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59382:x1869355196879488:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:2.0:1782758655.911741:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59382:x1869355196879488:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 639us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758655.911749:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00080000:3.0:1782758655.913616:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758655.914703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758655.914784:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879616 00000100:00100000:0.0:1782758655.914795:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879616 00000100:00100000:3.0:1782758655.915018:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1249 00000100:00100000:3.0:1782758655.915031:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879616:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758655.915653:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879616:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 623us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758655.915661:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1249 00000100:00100000:3.0:1782758655.916093:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758655.916108:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211715968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758655.916156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758655.916395:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211715968 00000100:00100000:0.0:1782758655.916402:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211715968 00000100:00100000:0.0:1782758655.916464:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1782758655.916472:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211715968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758655.916499:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758655.916541:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211715968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758655.916548:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1782758655.917162:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211715968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758655.917204:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758655.923099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758655.923478:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879744 00000100:00100000:2.0:1782758655.923489:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879744 00000100:00100000:2.0:1782758655.923585:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000100:00100000:2.0:1782758655.923598:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879744:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:2.0:1782758655.923704:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196879744:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 109us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758655.923712:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1250 00000100:00100000:1.0:1782758655.925939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758655.926462:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196879872 00000100:00100000:3.0:1782758655.926473:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196879872 00000100:00100000:3.0:1782758655.926522:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 691 00000100:00100000:3.0:1782758655.926532:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59382:x1869355196879872:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758655.927121:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59382:x1869355196879872:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 588us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758655.927129:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 691 00000100:00100000:3.0:1782758655.930579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758655.930681:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880000 00000100:00100000:0.0:1782758655.930691:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880000 00000100:00100000:0.0:1782758655.930752:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 692 00000100:00100000:0.0:1782758655.930761:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59382:x1869355196880000:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758655.931188:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+6:59382:x1869355196880000:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 426us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758655.931210:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 692 00000100:00100000:1.0:1782758655.935701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758655.935791:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880128 00000100:00100000:3.0:1782758655.935804:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880128 00000100:00100000:0.0:1782758655.936128:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1251 00000100:00100000:0.0:1782758655.936144:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196880128:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758655.936651:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59382:x1869355196880128:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 510us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758655.936659:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1251 00000100:00100000:1.0:1782758656.129196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758656.129473:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880384 00000100:00100000:0.0:1782758656.129487:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880384 00000100:00100000:0.0:1782758656.129572:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1252 00000100:00100000:0.0:1782758656.129584:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59386:x1869355196880384:12345-192.168.204.31@tcp:36:rm.60003 00010000:00010000:0.0:1782758656.129657:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758656.130374:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dc198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f4c expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130402:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff917182dd1400) 00010000:00010000:0.0:1782758656.130415:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758656.130441:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130454:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130462:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130497:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130504:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130509:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130935:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130945:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.130954:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782758656.136514:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:0.0:1782758656.136531:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2724539707245ns, next at 2725539703893ns, rc = 0 00010000:00010000:0.0:1782758656.139075:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139101:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139119:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139356:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139363:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139369:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139455:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782758656.139483:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139490:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139497:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139504:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758656.139508:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139516:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139528:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:0.0:1782758656.139531:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782758656.139537:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139542:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc1bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139563:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.139570:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.150364:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.150385:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758656.150390:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.150402:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.150421:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:0.0:1782758656.150424:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758656.150429:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.150436:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc1ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782758656.150456:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea335354 reply state 00000000011f07ab transno 4294967780 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758656.150471:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782758656.150596:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59386:x1869355196880384:12345-192.168.204.31@tcp:36:rm.60003 Request processed in 21010us (21418us total) trans 4294967780 rc 0/0 00000100:00100000:0.0:1782758656.150605:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1252 00010000:00010000:1.0:1782758656.153303:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758656.153317:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758656.153329:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758656.153335:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758656.153345:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758656.153365:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff91718bcfd800) 00010000:00010000:1.0:1782758656.153368:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782758656.153372:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758656.153378:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50e00/0xdd99f5c4777dc1c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153495:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758656.153496:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758656.153500:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758656.153505:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758656.153506:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153514:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153519:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758656.153523:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153529:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153538:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff91718bcfd500) 00010000:00010000:0.0:1782758656.153540:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758656.153555:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758656.153561:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc1b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758656.570190:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758657.219586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758657.219635:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758657.219667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758657.219696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758657.219736:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880512 00000100:00100000:0.0:1782758657.219748:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880512 00000100:00100000:0.0:1782758657.219926:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1474 00000100:00100000:0.0:1782758657.219939:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196880512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758657.220507:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196880512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 568us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.220517:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1474 00000100:00100000:0.0:1782758657.220575:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880768 00000100:00100000:0.0:1782758657.220579:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880768 00000100:00100000:0.0:1782758657.220620:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880896 00000100:00100000:0.0:1782758657.220623:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880896 00000100:00100000:0.0:1782758657.220650:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1533 00000100:00100000:0.0:1782758657.220657:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196880768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758657.220689:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196880768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.220696:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1533 00000100:00100000:0.0:1782758657.220710:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1534 00000100:00100000:0.0:1782758657.220716:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196880896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758657.220743:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196880896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.220749:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1534 00000100:00100000:0.0:1782758657.220787:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196880640 00000100:00100000:0.0:1782758657.220791:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196880640 00000100:00100000:0.0:1782758657.220859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1957 00000100:00100000:0.0:1782758657.220868:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196880640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758657.220904:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:2362:x1869355196880640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.220910:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1957 00000100:00080000:2.0:1782758657.221558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758657.221565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758657.221568:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758657.599785:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758657.966903:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211716480:0@lo:400:kworker.0 00000100:00100000:0.0:1782758657.966992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758657.967067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758657.967073:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211716352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758657.967100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758657.967139:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716480 00000100:00100000:0.0:1782758657.967148:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716480 00000100:00100000:0.0:1782758657.967227:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1782758657.967236:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211716480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758657.967292:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211716480:12345-0@lo:400:kworker.0 Request processed in 57us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.967300:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1782758657.967323:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716352 00000100:00100000:0.0:1782758657.967326:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716352 00000100:00100000:0.0:1782758657.967354:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1782758657.967359:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211716352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758657.967387:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211716352:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758657.967393:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00080000:0.0:1782758657.967407:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758657.967412:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758657.967449:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211716352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758657.967460:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211716480:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968458:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211716096:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758657.968556:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211716608:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758657.968598:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758657.968603:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211716224:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758657.968652:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211716736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758657.968727:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716608 00000100:00100000:3.0:1782758657.968732:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716608 00000100:00100000:3.0:1782758657.968776:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716224 00000100:00100000:3.0:1782758657.968779:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716224 00000100:00100000:3.0:1782758657.968796:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1782758657.968802:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211716608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968880:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211716608:12345-0@lo:400:kworker.0 Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758657.968887:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1782758657.968902:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1782758657.968908:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211716224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.968932:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211716224:12345-0@lo:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758657.968939:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1782758657.968958:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716736 00000100:00100000:3.0:1782758657.968961:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716736 00000100:00100000:3.0:1782758657.968988:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:3.0:1782758657.968993:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211716736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.969021:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211716736:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758657.969027:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00080000:3.0:1782758657.969049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758657.969053:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758657.969079:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211716224:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.969089:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211716736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758657.969097:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211716608:0@lo:400:kworker.0 00000100:00100000:2.0:1782758657.969369:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716096 00000100:00100000:2.0:1782758657.969374:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716096 00000100:00100000:2.0:1782758657.969415:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1782758657.969422:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758657.969461:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211716096:12345-0@lo:400:kworker.0 Request processed in 39us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758657.969467:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:3.0:1782758657.971379:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211716096:0@lo:400:kworker.0 00000004:00080000:0.0:1782758658.479080:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2726882252957ns, next at 2727882249420ns, rc = 0 00000100:00100000:2.0:1782758658.479174:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758658.479202:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211716864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758658.479372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758658.479568:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716864 00000100:00100000:0.0:1782758658.479578:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716864 00000100:00100000:0.0:1782758658.479649:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1782758658.479661:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211716864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758658.479708:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782758658.479785:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211716864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758658.479793:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1782758658.479939:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211716864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758658.605440:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782758659.136107:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 113 committed 00000001:00080000:3.0:1782758659.136170:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967780 is committed 00000004:00080000:3.0:1782758659.136186:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 112 committed 00000100:00100000:2.0:1782758659.137113:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758659.137146:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211716992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782758659.137264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758659.138865:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211716992 00000100:00100000:0.0:1782758659.138880:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211716992 00000100:00100000:0.0:1782758659.138978:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1782758659.138994:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211716992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782758659.139036:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:39 count 1 00000100:00080000:3.0:1782758659.139091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758659.139201:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758659.139231:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758659.139242:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1782758659.139247:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782758659.139253:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758659.139306:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 5 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758659.139323:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 5 pid: 6597 timeout: 2827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758659.140856:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211717120:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782758659.141001:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358840 going to sleep for 11 seconds 00000100:00100000:0.0:1782758659.165478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758659.165676:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881024 00000100:00100000:3.0:1782758659.165690:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881024 00010000:00010000:3.0:1782758659.165765:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 6 pid: 6597 timeout: 2827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758659.165847:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 459 00000100:00100000:3.0:1782758659.165859:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196881024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758659.165878:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758659.165885:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 6 pid: 6597 timeout: 2827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758659.165914:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 6 pid: 6597 timeout: 2827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758659.165948:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758659.165954:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782758659.165961:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758659.165972:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758659.166013:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758659.166088:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2362:x1869355196881024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 230us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758659.166096:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 459 00010000:00010000:2.0:1782758659.166524:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a37f7ea5/0xdd99f5c4777dc1a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f53 expref: 5 pid: 6597 timeout: 2827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758659.166546:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211717120:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758659.166573:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758659.166584:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758659.166592:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758659.166606:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758659.166615:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758659.166645:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782758659.167558:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211716992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28566us (30291us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782758659.167569:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000004:00080000:2.0:1782758659.167635:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171bb960700/2, rc 0, transno 4294967375 00000100:00100000:2.0:1782758659.167644:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211716992:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1782758659.169312:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758659.169501:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758659.169513:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758659.169529:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758659.169535:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758659.169548:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758659.169575:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758659.169590:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec7a8fe9/0xdd99f5c4777dc1c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758659.169629:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758659.169631:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758659.169632:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758659.628756:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782758660.229780:0:100933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2728632954217ns, next at 2716312772433ns, rc = 0 00000004:00080000:2.0:1782758660.230017:0:100933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2728633193092ns, next at 2727882249420ns, rc = 0 00000004:00080000:3.0:1782758660.232500:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 114 committed 00000004:00080000:3.0:1782758660.232530:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 113 committed 00010000:00010000:3.0:1782758660.652975:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758661.053886:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211717248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758661.053976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758661.054077:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717248 00000100:00100000:3.0:1782758661.054085:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717248 00000100:00100000:3.0:1782758661.054134:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1782758661.054143:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211717248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758661.054178:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758661.054218:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211717248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758661.054225:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:3.0:1782758661.054428:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758661.054468:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211717248:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782758661.112967:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00010000:00010000:1.0:1782758661.676803:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758662.329220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758662.329273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758662.329311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758662.329417:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881536 00000100:00100000:2.0:1782758662.329439:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881536 00000100:00100000:2.0:1782758662.329503:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1537 00000100:00100000:2.0:1782758662.329512:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196881536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758662.329579:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196881536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758662.329586:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1537 00000100:00080000:2.0:1782758662.329731:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758662.330082:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881280 00000100:00100000:0.0:1782758662.330087:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881280 00000100:00100000:0.0:1782758662.330137:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:0.0:1782758662.330146:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196881280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758662.330182:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2364:x1869355196881280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758662.330188:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:3.0:1782758662.331246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758662.331618:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881408 00000100:00100000:0.0:1782758662.331625:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881408 00000100:00100000:0.0:1782758662.331681:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1538 00000100:00100000:0.0:1782758662.331691:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196881408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758662.331760:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196881408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 61us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758662.331768:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1538 00000100:00080000:2.0:1782758662.332238:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758662.332243:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758662.337365:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881152 00000100:00100000:1.0:1782758662.337381:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881152 00000100:00100000:1.0:1782758662.337614:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1476 00000100:00100000:1.0:1782758662.337627:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196881152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758662.337704:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196881152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (8392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758662.337711:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1476 00010000:00010000:2.0:1782758662.700766:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758663.084305:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211717504:0@lo:400:kworker.0 00000100:00100000:1.0:1782758663.084379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758663.084440:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211718016:0@lo:400:kworker.0 00000100:00100000:1.0:1782758663.084468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758663.084494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758663.084500:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211717632:0@lo:400:kworker.0 00000100:00100000:1.0:1782758663.084519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758663.084551:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717504 00000100:00100000:1.0:1782758663.084559:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717504 00000100:00100000:1.0:1782758663.084599:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717632 00000100:00100000:1.0:1782758663.084602:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717632 00000100:00100000:1.0:1782758663.084633:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:1.0:1782758663.084641:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211717504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758663.084690:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211717504:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758663.084697:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:1.0:1782758663.084716:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:1.0:1782758663.084722:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758663.084763:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211717632:12345-0@lo:400:kworker.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.085093:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211717760:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758663.085160:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758663.085167:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211717376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758663.085234:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211717888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758663.085280:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717888 00000100:00100000:0.0:1782758663.085284:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717888 00000100:00100000:0.0:1782758663.085312:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1782758663.085318:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211717888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085354:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211717888:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.085360:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1782758663.085382:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718016 00000100:00100000:0.0:1782758663.085385:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718016 00000100:00100000:0.0:1782758663.085410:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717760 00000100:00100000:0.0:1782758663.085413:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717760 00000100:00100000:0.0:1782758663.085434:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1782758663.085440:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211718016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085470:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211718016:12345-0@lo:400:kworker.0 Request processed in 31us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.085476:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1782758663.085488:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1782758663.085494:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211717760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085518:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211717760:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.085524:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1782758663.085541:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211717376 00000100:00100000:0.0:1782758663.085544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211717376 00000100:00100000:0.0:1782758663.085568:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1782758663.085573:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211717376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085602:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211717376:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.085607:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1782758663.085655:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211717376:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085669:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211717888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.085678:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211717760:0@lo:400:kworker.0 00000100:00080000:0.0:1782758663.085718:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758663.085722:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758663.085724:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758663.086119:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1782758663.086389:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211717632:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.086404:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211717504:0@lo:400:kworker.0 00000100:00100000:0.0:1782758663.086414:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:0.0:1782758663.086418:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171bb960700, transno 4294967375 00000100:00100000:0.0:1782758663.086440:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211718016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758663.596488:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758663.596511:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211718144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758663.596581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758663.596678:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718144 00000100:00100000:0.0:1782758663.596686:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718144 00000100:00100000:0.0:1782758663.596745:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1782758663.596755:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211718144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758663.596792:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758663.596869:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211718144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758663.596876:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1782758663.597109:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211718144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758663.725080:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758664.748453:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758665.773020:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758666.164915:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758666.164939:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211718272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758666.165090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758666.172586:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718272 00000100:00100000:1.0:1782758666.172601:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718272 00000100:00100000:1.0:1782758666.172753:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1782758666.172765:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211718272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758666.172810:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758666.172914:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211718272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (7893us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758666.172922:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1782758666.173005:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211718272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758666.176955:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758666.796202:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758667.450348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758667.450397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758667.450440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758667.450560:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881792 00000100:00100000:1.0:1782758667.450571:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881792 00000100:00100000:1.0:1782758667.450658:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00100000:1.0:1782758667.450671:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196881792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758667.450746:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196881792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758667.450754:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00080000:3.0:1782758667.450939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758667.451123:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881664 00000100:00100000:2.0:1782758667.451128:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881664 00000100:00100000:2.0:1782758667.451164:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1478 00000100:00100000:2.0:1782758667.451172:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196881664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758667.451274:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196881920 00000100:00100000:1.0:1782758667.451279:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196881920 00000100:00100000:1.0:1782758667.451311:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1541 00000100:00100000:1.0:1782758667.451318:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196881920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758667.451363:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196881664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 191us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758667.451371:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1478 00000100:00080000:2.0:1782758667.451406:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758667.459930:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196881920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 8597us (9474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758667.459948:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1541 00000100:00100000:2.0:1782758667.460664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758667.468208:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882048 00000100:00100000:0.0:1782758667.468230:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882048 00000100:00100000:0.0:1782758667.473383:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1542 00000100:00100000:0.0:1782758667.473403:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758667.473493:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 97us (12843us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758667.473502:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1542 00000100:00080000:2.0:1782758667.474890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758667.820059:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758668.204663:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211718528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758668.204664:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211718656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758668.204747:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211718400:0@lo:400:kworker.0 00000100:00100000:2.0:1782758668.204803:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211718784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758668.208750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758668.208819:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211719040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758668.208877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758668.208931:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719040 00000100:00100000:3.0:1782758668.208939:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719040 00000100:00100000:3.0:1782758668.208998:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1782758668.209007:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211719040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758668.209057:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211719040:12345-0@lo:400:kworker.0 Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758668.209064:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1782758668.209099:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211719040:0@lo:400:kworker.0 00000100:00080000:3.0:1782758668.209209:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758668.209228:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718528 00000100:00100000:3.0:1782758668.209231:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718528 00000100:00100000:3.0:1782758668.209255:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1782758668.209260:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211718528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758668.209291:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211718528:12345-0@lo:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758668.209298:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1782758668.209554:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211718528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758668.211949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758668.213017:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718656 00000100:00100000:3.0:1782758668.213028:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718656 00000100:00100000:3.0:1782758668.213084:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1782758668.213094:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211718656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782758668.213123:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758668.213162:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211718656:12345-0@lo:400:kworker.0 Request processed in 69us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758668.213169:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1782758668.213193:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211718656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758668.213568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758668.213608:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211718912:0@lo:400:kworker.0 00000100:00100000:1.0:1782758668.213649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758668.213717:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718912 00000100:00100000:3.0:1782758668.213722:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718912 00000100:00100000:3.0:1782758668.213764:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1782758668.213772:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211718912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758668.213774:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718400 00000100:00100000:0.0:1782758668.213781:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718400 00000100:00100000:3.0:1782758668.213815:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211718912:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758668.213843:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1782758668.213845:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1782758668.213855:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211718400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758668.213894:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211718400:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758668.213903:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00080000:1.0:1782758668.213969:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758668.213987:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211718400:0@lo:400:kworker.0 00000100:00100000:1.0:1782758668.213997:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211718912:0@lo:400:kworker.0 00000100:00100000:1.0:1782758668.220056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758668.220104:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211718784 00000100:00100000:0.0:1782758668.220114:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211718784 00000100:00100000:0.0:1782758668.220270:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1782758668.220282:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211718784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758668.220355:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211718784:12345-0@lo:400:kworker.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758668.220363:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1782758668.220459:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211718784:0@lo:400:kworker.0 00000100:00080000:2.0:1782758668.226102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758668.721508:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211719168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758668.721583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758668.722861:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719168 00000100:00100000:3.0:1782758668.722877:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719168 00000100:00100000:3.0:1782758668.723029:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1782758668.723040:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211719168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758668.723081:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758668.728521:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211719168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5475us (6930us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758668.728535:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1782758668.729236:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211719168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758668.844139:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758669.868248:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758670.892077:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758671.276191:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758671.276215:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758671.276290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758671.276474:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719296 00000100:00100000:1.0:1782758671.276484:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719296 00000100:00100000:1.0:1782758671.276551:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1782758671.276561:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211719296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758671.276605:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758671.276660:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211719296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758671.276667:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:2.0:1782758671.276734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758671.276769:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211719296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758671.917163:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758672.566688:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758672.566730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758672.566759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758672.566798:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882176 00000100:00100000:2.0:1782758672.566799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758672.566811:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882176 00000100:00100000:0.0:1782758672.566919:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:0.0:1782758672.566930:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196882176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758672.566948:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882304 00000100:00100000:1.0:1782758672.566953:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882304 00000100:00100000:1.0:1782758672.567007:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:1.0:1782758672.567016:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196882304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782758672.567038:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758672.567094:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:2363:x1869355196882304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758672.567102:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:3.0:1782758672.567330:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882432 00000100:00100000:3.0:1782758672.567335:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882432 00000100:00100000:0.0:1782758672.567350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196882176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 421us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758672.567359:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1480 00000100:00100000:3.0:1782758672.567378:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882560 00000100:00100000:3.0:1782758672.567382:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882560 00000100:00100000:3.0:1782758672.567408:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1545 00000100:00100000:0.0:1782758672.567418:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1546 00000100:00100000:3.0:1782758672.567419:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758672.567434:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758672.567465:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758672.567473:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196882560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758672.567478:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1545 00000100:00100000:0.0:1782758672.567488:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1546 00000100:00080000:1.0:1782758672.567678:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758672.567682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758672.940513:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758673.325133:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211719552:0@lo:400:kworker.0 00000100:00100000:2.0:1782758673.325199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758673.325251:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211720064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325273:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211719808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758673.325280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758673.325306:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758673.325314:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211719680:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758673.325341:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758673.325349:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211719424:0@lo:400:kworker.0 00000100:00100000:2.0:1782758673.325360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758673.325385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758673.325404:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719552 00000100:00100000:2.0:1782758673.325411:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719552 00000100:00100000:1.0:1782758673.325414:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211719936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758673.325455:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719680 00000100:00100000:2.0:1782758673.325459:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719680 00000100:00100000:2.0:1782758673.325490:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1782758673.325498:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211719552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758673.325550:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758673.325564:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719936 00000100:00100000:1.0:1782758673.325568:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719936 00000100:00100000:2.0:1782758673.325570:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211719552:12345-0@lo:400:kworker.0 Request processed in 71us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758673.325579:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1782758673.325599:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1782758673.325606:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758673.325633:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211719680:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758673.325638:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1782758673.325649:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1782758673.325655:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211719936:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758673.325668:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758673.325680:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719424 00000100:00100000:1.0:1782758673.325684:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719424 00000100:00100000:2.0:1782758673.325689:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211719936:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758673.325696:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:1.0:1782758673.325717:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1782758673.325725:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211719424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758673.325756:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211719680:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325763:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211719424:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758673.325771:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1782758673.325775:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211719552:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325819:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211719424:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.325856:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211719936:0@lo:400:kworker.0 00000100:00100000:3.0:1782758673.326739:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720064 00000100:00100000:3.0:1782758673.326748:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720064 00000100:00100000:3.0:1782758673.326798:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211719808 00000100:00100000:3.0:1782758673.326802:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211719808 00000100:00100000:3.0:1782758673.326858:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1782758673.326867:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758673.326930:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211720064:12345-0@lo:400:kworker.0 Request processed in 63us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758673.326936:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1782758673.326950:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1782758673.326956:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211719808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758673.326987:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211719808:12345-0@lo:400:kworker.0 Request processed in 32us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758673.326993:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00080000:1.0:1782758673.327274:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758673.327279:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758673.327307:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211719808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758673.332475:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211720064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758673.836923:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211720192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758673.837005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758673.837212:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720192 00000100:00100000:3.0:1782758673.837221:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720192 00000100:00100000:3.0:1782758673.837271:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1782758673.837281:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211720192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758673.837320:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758673.837376:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211720192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758673.837383:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1782758673.837466:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211720192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758673.964076:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758674.229780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.229860:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882688 00000100:00100000:3.0:1782758674.229870:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882688 00000100:00080000:1.0:1782758674.229910:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758674.229932:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1253 00000100:00100000:3.0:1782758674.229942:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196882688:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758674.230036:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196882688:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.230044:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1253 00000100:00100000:1.0:1782758674.236197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.239851:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882816 00000100:00100000:3.0:1782758674.239865:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882816 00000100:00080000:1.0:1782758674.239912:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758674.239945:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:3.0:1782758674.239969:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196882816:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758674.240365:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196882816:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 408us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.240374:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:0.0:1782758674.246800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.247113:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196882944 00000100:00100000:3.0:1782758674.247124:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196882944 00000100:00100000:3.0:1782758674.247198:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00100000:3.0:1782758674.247210:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196882944:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:3.0:1782758674.247679:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196882944:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 470us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.247688:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00080000:0.0:1782758674.249670:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758674.257262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.257298:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883072 00000100:00100000:3.0:1782758674.257308:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883072 00000100:00100000:3.0:1782758674.257356:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00100000:3.0:1782758674.257365:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883072:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758674.257875:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883072:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 509us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.257883:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1254 00000100:00100000:2.0:1782758674.265737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758674.265915:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883200 00000100:00100000:0.0:1782758674.265926:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883200 00000100:00100000:0.0:1782758674.265983:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1255 00000100:00100000:0.0:1782758674.265993:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883200:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:0.0:1782758674.266092:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883200:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 100us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758674.266351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1255 00000100:00100000:0.0:1782758674.273985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758674.274033:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883328 00000100:00100000:0.0:1782758674.274043:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883328 00000100:00100000:0.0:1782758674.274284:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:0.0:1782758674.274297:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196883328:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758674.274672:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196883328:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 377us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758674.274680:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:0.0:1782758674.283020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758674.283070:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883456 00000100:00100000:0.0:1782758674.283080:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883456 00000100:00100000:0.0:1782758674.283143:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 697 00000100:00100000:0.0:1782758674.283153:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196883456:12345-192.168.204.31@tcp:19:lfs.60003 00000100:00100000:0.0:1782758674.283545:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:59563:x1869355196883456:12345-192.168.204.31@tcp:19:lfs.60003 Request processed in 392us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758674.283553:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 697 00000100:00100000:1.0:1782758674.291650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.291724:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883584 00000100:00100000:3.0:1782758674.291734:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883584 00000100:00100000:3.0:1782758674.291797:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1256 00000100:00100000:3.0:1782758674.291808:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883584:12345-192.168.204.31@tcp:48:lfs.60003 00000100:00100000:3.0:1782758674.292555:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59563:x1869355196883584:12345-192.168.204.31@tcp:48:lfs.60003 Request processed in 746us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.292564:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1256 00000100:00100000:1.0:1782758674.333531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758674.338279:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883712 00000100:00100000:2.0:1782758674.338294:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883712 00000100:00100000:2.0:1782758674.338356:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1257 00000100:00100000:2.0:1782758674.338367:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+7:59565:x1869355196883712:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782758674.338388:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758674.338453:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc1d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f5a expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.338528:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.338543:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.338555:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758674.338745:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1782758674.338750:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758674.340615:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.340666:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc1d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f5a expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.340687:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f5a expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.340698:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:2.0:1782758674.340701:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758674.340704:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758674.340779:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59565:x1869355196883712:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2413us (7266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758674.340788:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1257 00000100:00100000:1.0:1782758674.359077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758674.359574:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196883968 00000100:00100000:0.0:1782758674.359585:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196883968 00000100:00100000:0.0:1782758674.359642:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00100000:0.0:1782758674.359653:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+8:59565:x1869355196883968:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782758674.359675:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758674.359696:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dc1de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f61 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758674.359977:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00010000:0.0:1782758674.360414:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dc1de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f61 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.360429:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:0.0:1782758674.360432:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782758674.360436:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dc1de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f61 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.360449:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50400, rc 0) 00000100:00100000:0.0:1782758674.360511:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59565:x1869355196883968:12345-192.168.204.31@tcp:101:rm.0 Request processed in 860us (1443us total) trans 4294967781 rc 301/301 00000100:00100000:0.0:1782758674.360530:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1258 00000100:00100000:1.0:1782758674.366925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.367084:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884096 00000100:00100000:3.0:1782758674.367104:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884096 00000100:00100000:3.0:1782758674.367161:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:3.0:1782758674.367171:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59565:x1869355196884096:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782758674.373685:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59565:x1869355196884096:12345-192.168.204.31@tcp:37:rm.0 Request processed in 6503us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758674.373701:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:3.0:1782758674.378171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758674.378319:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884352 00000100:00100000:1.0:1782758674.378329:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884352 00000100:00100000:1.0:1782758674.378390:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:1.0:1782758674.378400:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59565:x1869355196884352:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:1.0:1782758674.380083:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59565:x1869355196884352:12345-192.168.204.31@tcp:35:rm.0 Request processed in 1678us (1989us total) trans 4294967782 rc 0/0 00000100:00100000:1.0:1782758674.380510:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:2.0:1782758674.387507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758674.387596:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884608 00000100:00100000:3.0:1782758674.387607:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884608 00000100:00100000:3.0:1782758674.387668:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1259 00000100:00100000:3.0:1782758674.387679:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+10:59565:x1869355196884608:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782758674.387741:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782758674.387769:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f5a expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.387791:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc17c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f45 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.387814:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff91718bcfd900) 00010000:00010000:3.0:1782758674.390353:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dbe96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64e8f expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390382:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782758674.390394:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782758674.390423:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390436:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390445:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390502:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390511:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.390527:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.391383:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.391394:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.391402:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758674.392591:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00010000:3.0:1782758674.392614:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392624:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392632:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392638:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758674.392643:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392651:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392664:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782758674.392667:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782758674.392672:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392678:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc1fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392700:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392707:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392712:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392717:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782758674.392720:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392729:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392736:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782758674.392739:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782758674.392742:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758674.392748:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691200/0xdd99f5c4777dc1ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782758674.392761:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4c45d28 reply state 000000007b9324ef transno 4294967783 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758674.392769:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782758674.393413:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+9:59565:x1869355196884608:12345-192.168.204.31@tcp:36:rm.0 Request processed in 5731us (5911us total) trans 4294967783 rc 0/0 00000100:00100000:3.0:1782758674.393423:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1259 00010000:00010000:0.0:1782758674.402296:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402315:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402323:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402330:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782758674.402334:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402343:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402360:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff917191f75b00) 00010000:00010000:0.0:1782758674.402363:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782758674.402368:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758674.402373:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dc1f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758674.988818:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782758675.972634:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967781 is committed 00000001:00080000:1.0:1782758675.972654:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967782 is committed 00000001:00080000:1.0:1782758675.972661:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967783 is committed 00010000:00010000:0.0:1782758676.013874:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758676.023386:0:101103:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe68680af0 20000000:00000080:0.0:1782758676.023404:0:101103:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718bf16000 uarg=0000000000000000 00010000:00010000:0.0:1782758676.026726:0:101103:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758676.026746:0:101103:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758676.027108:0:101103:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758676.027128:0:101103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.027146:0:101103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.027156:0:101103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.027193:0:101103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.027207:0:101103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 18 pid: 5796 timeout: 2844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758676.027222:0:101103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101103:1869355211720320:0@lo:104: 00000100:00100000:0.0:1782758676.027283:0:101103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758676.027337:0:101103:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758676.027462:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782758676.027475:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720320 00000100:00100000:3.0:1782758676.027491:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720320 00000100:00100000:3.0:1782758676.027570:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1782758676.027580:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082be0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101103:x1869355211720320:12345-0@lo:104: 00010000:00010000:3.0:1782758676.027595:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758676.027658:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758676.027665:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082be0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101103:x1869355211720320:12345-0@lo:104: Request processed in 87us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758676.027675:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1782758676.027760:0:101103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101103:1869355211720320:0@lo:104: 00010000:00010000:0.0:1782758676.027778:0:101103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027853:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758676.027860:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027868:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758676.027872:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027881:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758676.027889:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758676.027895:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758676.027924:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027939:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758676.027962:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027969:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50200/0xdd99f5c4777dbe81 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dbe88 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.027985:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758676.027987:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758676.027989:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758676.028000:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211720448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758676.028028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758676.028060:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720448 00000100:00100000:1.0:1782758676.028064:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720448 00010000:00010000:1.0:1782758676.028080:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 2844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758676.028101:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1782758676.028107:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211720448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758676.028116:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758676.028121:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 2844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028130:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 2844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028143:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777dbe88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dbe81 expref: 19 pid: 5796 timeout: 2844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028155:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028163:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028175:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028184:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028191:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028198:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028203:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758676.028207:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028214:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028223:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758676.028232:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758676.028254:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211720448:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758676.028260:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1782758676.028288:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211720448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758676.028501:0:101103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.028510:0:101103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758676.028517:0:101103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc201 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758676.396115:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758676.396137:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211720576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758676.396204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758676.396306:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720576 00000100:00100000:1.0:1782758676.396315:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720576 00000100:00100000:1.0:1782758676.396380:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1782758676.396389:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211720576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758676.396426:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758676.396470:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211720576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758676.396488:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1782758676.396535:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211720576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758676.396594:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782758677.036949:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758677.191614:0:101151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca3f4d830 20000000:00000080:0.0:1782758677.191632:0:101151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd8c00 uarg=0000000000000000 00010000:00010000:0.0:1782758677.192217:0:101151:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758677.192233:0:101151:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758677.192251:0:101151:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758677.192445:0:101151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192470:0:101151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192482:0:101151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192490:0:101151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192497:0:101151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192504:0:101151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192510:0:101151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758677.192515:0:101151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192522:0:101151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192536:0:101151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192542:0:101151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758677.192549:0:101151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc208 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758677.693411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758677.693458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758677.693485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758677.693517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758677.694028:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884736 00000100:00100000:0.0:1782758677.694039:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884736 00000100:00100000:0.0:1782758677.694102:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1482 00000100:00100000:0.0:1782758677.694114:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196884736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758677.694200:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196884736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758677.694209:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1482 00000100:00100000:0.0:1782758677.694245:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884992 00000100:00100000:0.0:1782758677.694249:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884992 00000100:00100000:0.0:1782758677.694287:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885120 00000100:00100000:0.0:1782758677.694291:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885120 00000100:00100000:0.0:1782758677.694315:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1549 00000100:00100000:0.0:1782758677.694321:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196884992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758677.694353:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196884992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758677.694359:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1549 00000100:00100000:0.0:1782758677.694371:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1550 00000100:00100000:0.0:1782758677.694377:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196885120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758677.694397:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196885120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 20us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758677.694403:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1550 00000100:00080000:0.0:1782758677.694548:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758677.694552:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758677.694628:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196884864 00000100:00100000:2.0:1782758677.694633:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196884864 00000100:00100000:2.0:1782758677.694679:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1973 00000100:00100000:2.0:1782758677.694688:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196884864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758677.694732:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196884864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758677.694738:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1973 00000100:00080000:0.0:1782758677.697688:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782758677.868765:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758677.868773:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758677.868778:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758677.868861:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.868873:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.868884:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758677.868913:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211720704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758677.868985:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758677.869029:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181377840 going to sleep for 11 seconds 00000100:00100000:2.0:1782758677.869051:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720704 00000100:00100000:2.0:1782758677.869058:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720704 00000100:00100000:2.0:1782758677.869102:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1782758677.869110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211720704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758677.869123:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758677.869136:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc20f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.869158:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.869169:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.869177:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758677.869213:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211720704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758677.869220:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1782758677.869264:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211720704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758677.869277:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.869286:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758677.869304:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758677.869308:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758677.869315:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758678.059999:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758678.136258:0:101199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea4dea330 20000000:00000080:3.0:1782758678.136275:0:101199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30d8800 uarg=0000000000000000 00010000:00010000:3.0:1782758678.137139:0:101199:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758678.137156:0:101199:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758678.137176:0:101199:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758678.137197:0:101199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.137405:0:101199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.137415:0:101199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.137465:0:101199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.137478:0:101199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 18 pid: 5796 timeout: 2846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758678.137492:0:101199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101199:1869355211720832:0@lo:104: 00000100:00100000:3.0:1782758678.137551:0:101199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758678.137601:0:101199:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186293540 going to sleep for 11 seconds 00000100:00100000:1.0:1782758678.137612:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720832 00000100:00100000:1.0:1782758678.137621:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720832 00000100:00100000:1.0:1782758678.137737:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1782758678.137748:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101199:x1869355211720832:12345-0@lo:104: 00010000:00010000:1.0:1782758678.137762:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758678.137880:0:101199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101199:1869355211720832:0@lo:104: 00010000:00010000:3.0:1782758678.137900:0:101199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758678.138117:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758678.138125:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101199:x1869355211720832:12345-0@lo:104: Request processed in 379us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758678.138133:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:3.0:1782758678.138299:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758678.138307:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.138316:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758678.138320:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.138330:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758678.138337:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758678.138343:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758678.138416:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.138424:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758678.138474:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.138483:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc20f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc216 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758678.138484:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211720960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758678.138508:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758678.138511:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758678.138513:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758678.138526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758678.139073:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211720960 00000100:00100000:3.0:1782758678.139081:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211720960 00010000:00010000:3.0:1782758678.139109:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 2846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758678.139148:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1782758678.139158:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211720960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758678.139171:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758678.139315:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 2846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139328:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 2846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139342:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc216 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc20f expref: 19 pid: 5796 timeout: 2846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139356:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139365:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139380:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139388:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139395:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139401:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139412:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758678.139416:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139423:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139450:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758678.139519:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758678.139538:0:101199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758678.139552:0:101199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758678.139557:0:101199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc21d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758678.139632:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211720960:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758678.139639:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1782758678.139696:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211720960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758678.447068:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211721472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758678.447136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758678.447260:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211721344:0@lo:400:kworker.0 00000100:00100000:0.0:1782758678.447295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758678.447355:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758678.447362:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211721216:0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.447467:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211721088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758678.447517:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721344 00000100:00100000:0.0:1782758678.447526:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721344 00000100:00100000:0.0:1782758678.447579:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:0.0:1782758678.447588:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211721344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758678.447642:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211721344:12345-0@lo:400:kworker.0 Request processed in 55us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758678.447649:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1782758678.449985:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721472 00000100:00100000:3.0:1782758678.449999:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721472 00000100:00100000:3.0:1782758678.450062:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1782758678.450072:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211721472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758678.450166:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211721472:12345-0@lo:400:kworker.0 Request processed in 96us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758678.450173:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1782758678.450308:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211721472:0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.451523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758678.451601:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211721600:0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.451657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758678.451713:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721088 00000100:00100000:1.0:1782758678.451719:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721088 00000100:00100000:1.0:1782758678.451760:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1782758678.451767:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211721088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.451811:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211721088:12345-0@lo:400:kworker.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758678.453528:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1782758678.455761:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721600 00000100:00100000:1.0:1782758678.455774:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721600 00000100:00100000:1.0:1782758678.455899:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1782758678.455915:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211721600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.456132:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211721600:12345-0@lo:400:kworker.0 Request processed in 224us (4476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758678.456140:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1782758678.456202:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211721088:0@lo:400:kworker.0 00000100:00100000:1.0:1782758678.456216:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211721600:0@lo:400:kworker.0 00000100:00080000:3.0:1782758678.456890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758678.456897:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758678.456900:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758678.458273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758678.458369:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211721344:0@lo:400:kworker.0 00000100:00100000:2.0:1782758678.461687:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721216 00000100:00100000:2.0:1782758678.461702:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721216 00000100:00100000:2.0:1782758678.461946:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1782758678.461958:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211721216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758678.462190:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211721216:12345-0@lo:400:kworker.0 Request processed in 234us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758678.462199:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1782758678.462449:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211721216:0@lo:400:kworker.0 00000100:00080000:3.0:1782758678.464279:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758678.959681:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211721728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758678.959772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758678.960042:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721728 00000100:00100000:1.0:1782758678.960051:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721728 00000100:00100000:1.0:1782758678.960097:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1782758678.960106:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211721728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758678.960142:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758678.960194:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211721728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758678.960201:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1782758678.960253:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211721728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758679.085013:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758679.467975:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758679.467984:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758679.467989:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758679.468032:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758679.468045:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758679.468055:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758679.468082:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211721856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758679.468151:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758679.468204:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181377840 going to sleep for 11 seconds 00000100:00100000:1.0:1782758679.468262:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721856 00000100:00100000:1.0:1782758679.468269:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721856 00000100:00100000:1.0:1782758679.468320:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1782758679.468329:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211721856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758679.468345:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758679.468358:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc224 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758679.468380:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758679.468389:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758679.468398:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758679.468470:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211721856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758679.468479:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1782758679.468704:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211721856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758679.468720:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758679.468741:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758679.468763:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758679.468769:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758679.468776:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758680.108642:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758681.131962:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758681.517453:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211721984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758681.517522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758681.517636:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211721984 00000100:00100000:3.0:1782758681.517644:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211721984 00000100:00100000:3.0:1782758681.517710:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00080000:0.0:1782758681.517719:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758681.517721:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211721984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758681.517755:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758681.517811:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211721984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758681.517819:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1782758681.517901:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211721984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758682.156527:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758682.361483:0:101396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4b81f1d0 20000000:00000080:2.0:1782758682.361500:0:101396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb1800 uarg=0000000000000000 00010000:00010000:2.0:1782758682.367385:0:101396:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758682.367434:0:101396:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758682.367478:0:101396:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758682.367504:0:101396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.367521:0:101396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.367530:0:101396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.367568:0:101396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.367582:0:101396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 18 pid: 5793 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758682.367597:0:101396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101396:1869355211722112:0@lo:104: 00000100:00100000:2.0:1782758682.367662:0:101396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758682.367719:0:101396:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719182ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758682.367959:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722112 00000100:00100000:3.0:1782758682.367967:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722112 00000100:00100000:3.0:1782758682.368012:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1782758682.368022:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101396:x1869355211722112:12345-0@lo:104: 00010000:00010000:3.0:1782758682.368036:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758682.368102:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758682.368108:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:101396:x1869355211722112:12345-0@lo:104: Request processed in 88us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758682.368116:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1782758682.368180:0:101396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101396:1869355211722112:0@lo:104: 00010000:00010000:0.0:1782758682.368203:0:101396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369083:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758682.369091:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369100:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758682.369104:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369113:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758682.369121:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758682.369131:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758682.369167:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369174:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758682.369204:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369211:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc224 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc22b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758682.369226:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758682.369228:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758682.369229:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758682.369237:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758682.369250:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211722240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758682.369291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758682.369341:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722240 00000100:00100000:1.0:1782758682.369347:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722240 00010000:00010000:2.0:1782758682.370349:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758682.370399:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1782758682.370409:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211722240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758682.370422:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758682.370427:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370440:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370456:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc22b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc224 expref: 19 pid: 5793 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370477:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370485:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370502:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370509:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370516:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370523:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370534:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758682.370539:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370547:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370559:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758682.370574:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758682.370759:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211722240:12345-0@lo:103:ldlm_bl.0 Request processed in 352us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758682.370767:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00010000:0.0:1782758682.372464:0:101396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758682.372480:0:101396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758682.372487:0:101396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777dc232 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758682.382936:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211722240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758682.806241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758682.806288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758682.806325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758682.806380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758682.806418:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885632 00000100:00100000:2.0:1782758682.806430:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885632 00000100:00100000:2.0:1782758682.806500:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885504 00000100:00100000:2.0:1782758682.806504:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885504 00000100:00100000:2.0:1782758682.806652:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1553 00000100:00100000:2.0:1782758682.806727:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758682.806878:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 214us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758682.806888:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1553 00000100:00100000:2.0:1782758682.806909:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1554 00000100:00100000:2.0:1782758682.806916:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758682.806943:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758682.806948:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1554 00000100:00080000:2.0:1782758682.806965:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758682.806969:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758682.808082:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885376 00000100:00100000:1.0:1782758682.808094:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885376 00000100:00100000:1.0:1782758682.808178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1977 00000100:00100000:1.0:1782758682.808188:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758682.808249:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196885376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 63us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758682.808257:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1977 00000100:00080000:0.0:1782758682.808363:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758682.811292:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885248 00000100:00100000:3.0:1782758682.811312:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885248 00000100:00100000:3.0:1782758682.811924:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1485 00000100:00100000:3.0:1782758682.811938:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196885248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758682.812058:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196885248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 122us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758682.812066:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1485 00010000:00010000:3.0:1782758683.180317:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758683.564384:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211722496:0@lo:400:kworker.0 00000100:00100000:1.0:1782758683.564470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758683.564641:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758683.564666:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211722368:0@lo:400:kworker.0 00000100:00100000:0.0:1782758683.564707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758683.564753:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722368 00000100:00100000:0.0:1782758683.564760:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722368 00000100:00100000:0.0:1782758683.564804:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1782758683.564813:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211722368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758683.564904:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211722368:12345-0@lo:400:kworker.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758683.564918:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1782758683.564970:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211722368:0@lo:400:kworker.0 00000100:00100000:0.0:1782758683.565009:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722496 00000100:00100000:0.0:1782758683.565012:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722496 00000100:00100000:0.0:1782758683.565062:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:0.0:1782758683.565513:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211722496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.567600:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211722624:0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.567671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758683.567739:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722624 00000100:00100000:3.0:1782758683.567746:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722624 00000100:00100000:3.0:1782758683.567806:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1782758683.567815:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211722624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.567900:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211722624:12345-0@lo:400:kworker.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758683.567906:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1782758683.567944:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211722624:0@lo:400:kworker.0 00000100:00080000:3.0:1782758683.567971:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758683.574487:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211722496:0@lo:400:kworker.0 00000100:00100000:0.0:1782758683.574724:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211722496:12345-0@lo:400:kworker.0 Request processed in 9584us (10183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758683.574737:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1782758683.574994:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211722880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.575079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758683.575119:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758683.575126:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211722752:0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.575153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758683.575178:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758683.575187:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211723008:0@lo:400:kworker.0 00000100:00100000:3.0:1782758683.575212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758683.575447:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722880 00000100:00100000:2.0:1782758683.575454:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722880 00000100:00100000:2.0:1782758683.575513:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1782758683.575523:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211722880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758683.575579:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211722880:12345-0@lo:400:kworker.0 Request processed in 58us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758683.575586:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1782758683.575608:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211722752 00000100:00100000:2.0:1782758683.575611:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211722752 00000100:00100000:2.0:1782758683.575635:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723008 00000100:00100000:2.0:1782758683.575638:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723008 00000100:00100000:2.0:1782758683.575673:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1782758683.575680:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211722752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758683.575712:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211722752:12345-0@lo:400:kworker.0 Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758683.575718:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1782758683.575727:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1782758683.575734:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211723008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758683.575761:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211723008:12345-0@lo:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758683.575770:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1782758683.575807:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211722752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758683.575817:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211722880:0@lo:400:kworker.0 00000100:00080000:3.0:1782758683.576037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758683.576042:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758683.576044:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758683.576063:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211723008:0@lo:400:kworker.0 10000000:01000000:0.0:1782758683.694784:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758683.694793:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758683.694798:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758683.694882:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758683.694895:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758683.694906:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758683.694933:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211723136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758683.695003:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758683.695073:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182c180 going to sleep for 11 seconds 00000100:00100000:1.0:1782758683.695168:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723136 00000100:00100000:1.0:1782758683.695176:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723136 00000100:00100000:1.0:1782758683.695230:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1782758683.695239:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211723136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758683.695252:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758683.695266:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc239 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758683.695289:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758683.695298:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758683.695308:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782758683.695370:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211723136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758683.695378:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1782758683.696204:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211723136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758683.696222:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758683.696233:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758683.696250:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758683.696255:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758683.696262:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758684.076473:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758684.076570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758684.076705:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723264 00000100:00100000:2.0:1782758684.076715:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723264 00000100:00100000:2.0:1782758684.076778:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1782758684.076789:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758684.076875:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758684.076933:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758684.076941:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1782758684.076994:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211723264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758684.205609:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758685.228582:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758686.252588:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758686.638169:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211723392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758686.638249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758686.638444:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723392 00000100:00100000:3.0:1782758686.638453:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723392 00000100:00100000:3.0:1782758686.638520:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1782758686.638529:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211723392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758686.638568:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758686.638629:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211723392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758686.638636:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00080000:2.0:1782758686.638963:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758686.639018:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211723392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758687.281907:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758687.925797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758687.925876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758687.925917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758687.925941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758687.925969:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886016 00000100:00100000:2.0:1782758687.925978:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886016 00000100:00100000:2.0:1782758687.926039:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886144 00000100:00100000:2.0:1782758687.926042:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886144 00000100:00100000:2.0:1782758687.926067:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1557 00000100:00100000:2.0:1782758687.926077:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196886016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758687.926147:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196886016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758687.926155:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1557 00000100:00100000:2.0:1782758687.926172:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1558 00000100:00100000:2.0:1782758687.926179:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196886144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758687.926203:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196886144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758687.926209:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1558 00000100:00080000:2.0:1782758687.926225:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758687.926229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758687.926307:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885888 00000100:00100000:1.0:1782758687.926313:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885888 00000100:00100000:1.0:1782758687.926357:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1981 00000100:00100000:1.0:1782758687.926365:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196885888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782758687.926370:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758687.926422:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196885888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758687.926428:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1981 00000100:00100000:0.0:1782758687.929873:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196885760 00000100:00100000:0.0:1782758687.929887:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196885760 00000100:00100000:1.0:1782758687.930000:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1488 00000100:00100000:1.0:1782758687.930013:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196885760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758687.930169:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196885760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 159us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758687.930176:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1488 00010000:00010000:1.0:1782758688.302405:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758688.684261:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211723648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758688.684388:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211724160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758688.684438:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758688.684443:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211723776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758688.684496:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723648 00000100:00100000:0.0:1782758688.684503:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723648 00000100:00100000:0.0:1782758688.684569:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723776 00000100:00100000:0.0:1782758688.684573:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723776 00000100:00100000:0.0:1782758688.684603:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1782758688.684611:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211723648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684662:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211723648:12345-0@lo:400:kworker.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758688.684670:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1782758688.684688:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1782758688.684694:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211723776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684730:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211723776:12345-0@lo:400:kworker.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758688.684736:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1782758688.684754:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724160 00000100:00100000:0.0:1782758688.684757:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724160 00000100:00100000:0.0:1782758688.684784:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1782758688.684791:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211724160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684853:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211724160:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758688.684859:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00080000:0.0:1782758688.684882:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758688.684886:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758688.684920:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211723776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684931:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211723648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.684940:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211724160:0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685046:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211723904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758688.685100:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758688.685106:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211723520:0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758688.685157:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211724032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758688.685202:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723904 00000100:00100000:3.0:1782758688.685207:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723904 00000100:00100000:3.0:1782758688.685249:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1782758688.685256:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685291:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211723904:12345-0@lo:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758688.685297:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1782758688.685315:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724032 00000100:00100000:3.0:1782758688.685318:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724032 00000100:00100000:3.0:1782758688.685338:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1782758688.685344:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211724032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685368:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211724032:12345-0@lo:400:kworker.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758688.685375:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1782758688.685399:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211724032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758688.685408:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211723904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.685734:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211723520 00000100:00100000:0.0:1782758688.685739:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211723520 00000100:00100000:0.0:1782758688.685775:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1782758688.685781:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211723520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758688.685846:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211723520:12345-0@lo:400:kworker.0 Request processed in 65us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758688.685853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00080000:0.0:1782758688.685876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758688.685880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758688.686035:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211723520:0@lo:400:kworker.0 00000100:00100000:1.0:1782758689.197015:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758689.197039:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211724288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758689.197107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758689.197260:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724288 00000100:00100000:3.0:1782758689.197269:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724288 00000100:00100000:3.0:1782758689.197327:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1782758689.197336:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211724288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758689.197374:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758689.197432:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211724288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758689.197440:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1782758689.197577:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211724288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758689.324080:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758690.348106:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758691.372598:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758691.756761:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211724416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758691.756851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758691.756925:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724416 00000100:00100000:3.0:1782758691.756932:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724416 00000100:00100000:3.0:1782758691.756991:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1782758691.756999:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211724416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758691.757030:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758691.757067:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211724416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758691.757074:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:3.0:1782758691.757091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758691.757137:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211724416:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782758691.831156:0:101740:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23a: test mapped regular ACLs ========= 14:44:49 (1782758689) 00010000:00010000:3.0:1782758692.396671:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758693.055886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758693.055926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758693.055961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758693.056042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758693.056065:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886400 00000100:00100000:0.0:1782758693.056070:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886656 00000100:00100000:1.0:1782758693.056077:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886400 00000100:00100000:0.0:1782758693.056077:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886656 00000100:00100000:0.0:1782758693.056134:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886528 00000100:00100000:0.0:1782758693.056138:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886528 00000100:00100000:3.0:1782758693.056190:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886272 00000100:00100000:3.0:1782758693.056196:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886272 00000100:00100000:3.0:1782758693.056231:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1490 00000100:00100000:3.0:1782758693.056242:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196886272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758693.056320:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196886272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758693.056329:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1490 00000100:00100000:1.0:1782758693.063643:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1985 00000100:00100000:1.0:1782758693.063660:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758693.063749:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (7872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758693.063757:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1985 00000100:00100000:0.0:1782758693.063776:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1561 00000100:00100000:0.0:1782758693.063800:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758693.063857:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (7893us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.063864:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1561 00000100:00080000:0.0:1782758693.063887:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758693.063893:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758693.063896:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758693.063951:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1562 00000100:00100000:0.0:1782758693.063959:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196886528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758693.063988:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196886528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (7946us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.064007:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1562 00000001:02000400:3.0:1782758693.322278:0:101788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23a Need 2 clients at least 00010000:00010000:2.0:1782758693.420512:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758693.804036:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211724928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.804062:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211724800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.804112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758693.804113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758693.804185:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758693.804191:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211724672:0@lo:400:kworker.0 00000100:00100000:2.0:1782758693.804277:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724928 00000100:00100000:2.0:1782758693.804286:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724928 00000100:00100000:2.0:1782758693.804339:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1782758693.804347:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211724928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758693.804417:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211724544:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.806453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758693.806510:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211725184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.806547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782758693.806579:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758693.806596:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725184 00000100:00100000:0.0:1782758693.806602:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725184 00000100:00100000:0.0:1782758693.806656:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1782758693.806671:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211725184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.806717:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211725184:12345-0@lo:400:kworker.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.806723:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00080000:0.0:1782758693.806859:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758693.806887:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211725184:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.806928:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724800 00000100:00100000:0.0:1782758693.806931:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724800 00000100:00100000:0.0:1782758693.806957:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724672 00000100:00100000:0.0:1782758693.806959:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724672 00000100:00100000:0.0:1782758693.807130:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1782758693.807147:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211724800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.807183:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211724800:12345-0@lo:400:kworker.0 Request processed in 38us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.807189:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1782758693.807199:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1782758693.807204:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211724672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.807224:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211724672:12345-0@lo:400:kworker.0 Request processed in 21us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.807230:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00080000:0.0:1782758693.807243:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758693.807260:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211724672:0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.807270:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211724800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758693.816489:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211724928:12345-0@lo:400:kworker.0 Request processed in 12133us (12370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758693.816506:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1782758693.817324:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211724928:0@lo:400:kworker.0 00000100:00100000:3.0:1782758693.819206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758693.819354:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211725056:0@lo:400:kworker.0 00000100:00100000:3.0:1782758693.819396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758693.819656:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725056 00000100:00100000:0.0:1782758693.819663:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725056 00000100:00100000:0.0:1782758693.819784:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1782758693.819793:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211725056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758693.819863:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211725056:12345-0@lo:400:kworker.0 Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758693.819869:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1782758693.819959:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211724544 00000100:00100000:2.0:1782758693.819965:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211724544 00000100:00100000:3.0:1782758693.819975:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211725056:0@lo:400:kworker.0 00000100:00100000:2.0:1782758693.820053:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:2.0:1782758693.820062:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211724544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758693.820111:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211724544:12345-0@lo:400:kworker.0 Request processed in 50us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758693.820118:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00080000:1.0:1782758693.820636:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758693.820850:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211724544:0@lo:400:kworker.0 00000100:00100000:1.0:1782758694.316090:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758694.316115:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211725312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758694.316218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758694.316726:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725312 00000100:00100000:2.0:1782758694.316736:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725312 00000100:00100000:2.0:1782758694.316796:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1782758694.316806:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211725312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758694.316868:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758694.316975:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211725312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758694.316982:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1782758694.319191:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211725312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758694.444117:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782758695.284135:0:101837:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23b: test mapped default ACLs ========= 14:44:52 (1782758692) 00010000:00010000:3.0:1782758695.468389:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758696.492973:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758696.876279:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211725440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758696.876468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758696.876870:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725440 00000100:00100000:3.0:1782758696.876882:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725440 00000100:00100000:3.0:1782758696.876949:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1782758696.876960:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211725440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758696.878875:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758696.879578:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211725440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2614us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758696.879593:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00080000:3.0:1782758696.879937:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758696.881571:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211725440:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782758697.217016:0:101885:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23b Need 2 clients at least 00010000:00010000:0.0:1782758697.516158:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758698.166766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758698.166818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758698.166935:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887040 00000100:00100000:3.0:1782758698.166946:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887040 00000100:00100000:3.0:1782758698.167017:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 698 00000100:00100000:3.0:1782758698.167075:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196887040:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782758698.167110:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dbaf3 00000100:00080000:3.0:1782758698.167120:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917082b42000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782758698.167163:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00080000:0.0:1782758698.167312:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758698.167326:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887168 00000100:00100000:0.0:1782758698.167330:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887168 00000100:00100000:0.0:1782758698.167365:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 699 00000100:00100000:0.0:1782758698.167373:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2360:x1869355196887168:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782758698.167386:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dbba2 00000100:00080000:0.0:1782758698.167391:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917186a5e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758698.167632:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1782758698.167898:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196887168:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 523us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758698.167906:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 699 00010000:00010000:0.0:1782758698.167930:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782758698.167937:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758698.167961:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758698.168965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758698.169062:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886912 00000100:00100000:2.0:1782758698.169070:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886912 00000100:00100000:0.0:1782758698.169171:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7285eadf-a700-4e2b-8948-9c4e88301f08+2:2360:x1869355196887040:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 2144us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758698.169190:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 698 00000100:00080000:0.0:1782758698.169240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758698.169267:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1989 00000100:00100000:2.0:1782758698.169278:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758698.169322:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196886912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758698.169331:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1989 00000100:00100000:2.0:1782758698.169981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758698.170667:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196886784 00000100:00100000:0.0:1782758698.170677:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196886784 00000100:00100000:0.0:1782758698.171044:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1492 00000100:00100000:0.0:1782758698.171067:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196886784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758698.171955:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196886784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 886us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758698.171967:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1492 00010000:00010000:0.0:1782758698.543906:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782758698.868587:0:101933:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 14:44:56 (1782758696) 00000100:00100000:3.0:1782758698.930480:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211725952:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930628:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758698.930634:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211725568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930683:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211726080:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930722:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211725696:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930753:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211726208:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758698.930790:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211725824:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758698.930859:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725952 00000100:00100000:3.0:1782758698.930868:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725952 00000100:00100000:3.0:1782758698.930913:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726208 00000100:00100000:3.0:1782758698.930915:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726208 00000100:00100000:3.0:1782758698.930934:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1782758698.930940:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211725952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.930985:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211725952:12345-0@lo:400:kworker.0 Request processed in 45us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.930991:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1782758698.931005:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1782758698.931010:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931047:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211726208:12345-0@lo:400:kworker.0 Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.931052:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1782758698.931068:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725568 00000100:00100000:3.0:1782758698.931070:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725568 00000100:00100000:3.0:1782758698.931090:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1782758698.931094:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211725568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931117:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211725568:12345-0@lo:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.931123:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1782758698.931147:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726080 00000100:00100000:3.0:1782758698.931150:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726080 00000100:00100000:3.0:1782758698.931176:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725696 00000100:00100000:3.0:1782758698.931179:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725696 00000100:00100000:3.0:1782758698.931193:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211725824 00000100:00100000:3.0:1782758698.931196:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211725824 00000100:00100000:3.0:1782758698.931210:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1782758698.931215:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931248:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211726080:12345-0@lo:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.931254:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1782758698.931265:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1782758698.931270:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211725696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931293:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211725696:12345-0@lo:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.931299:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1782758698.931309:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1782758698.931314:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211725824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931340:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211725824:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758698.931346:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00080000:3.0:1782758698.931368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758698.931373:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758698.931375:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758698.931403:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211725568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931416:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211726080:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931424:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211725952:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931455:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211725824:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931464:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211725696:0@lo:400:kworker.0 00000100:00100000:3.0:1782758698.931473:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211726208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758699.436497:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758699.436518:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211726336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758699.436591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758699.436775:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726336 00000100:00100000:2.0:1782758699.436785:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726336 00000100:00100000:2.0:1782758699.437067:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1782758699.437078:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211726336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758699.437119:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758699.437167:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211726336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758699.437175:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1782758699.437304:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211726336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758699.564283:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1782758699.945739:0:101981:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782758699.960141:0:101981:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1782758700.588571:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758700.984609:0:102029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd737fce50 20000000:00000080:1.0:1782758700.984628:0:102029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312e400 uarg=0000000000000000 10000000:01000000:1.0:1782758700.985257:0:102029:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758700.985276:0:102029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.985293:0:102029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.985302:0:102029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.985468:0:102029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.985483:0:102029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 18 pid: 5793 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758700.985498:0:102029:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102029:1869355211726464:0@lo:104: 00000100:00100000:1.0:1782758700.985560:0:102029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758700.985687:0:102029:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782758700.985737:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726464 00000100:00100000:3.0:1782758700.985744:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726464 00000100:00100000:3.0:1782758700.985924:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1782758700.985934:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102029:x1869355211726464:12345-0@lo:104: 00010000:00010000:3.0:1782758700.985946:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758700.986022:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758700.986027:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102029:x1869355211726464:12345-0@lo:104: Request processed in 96us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758700.986034:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00010000:00010000:0.0:1782758700.986092:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758700.986099:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986106:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758700.986110:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986119:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758700.986126:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758700.986132:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758700.986168:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986174:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758700.986193:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986199:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc239 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc240 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986217:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758700.986219:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758700.986220:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758700.986240:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211726592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758700.986275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758700.986342:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726592 00000100:00100000:0.0:1782758700.986347:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726592 00010000:00010000:0.0:1782758700.986366:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 19 pid: 5793 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758700.986387:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1782758700.986393:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211726592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758700.986404:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758700.986408:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 19 pid: 5793 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986418:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 19 pid: 5793 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986437:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986446:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986461:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986468:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986475:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986480:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986485:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758700.986489:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986496:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986504:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758700.986513:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758700.986540:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211726592:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758700.986547:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1782758700.986609:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211726592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758700.986682:0:102029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc240 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc239 expref: 18 pid: 5793 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758700.986692:0:102029:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102029:1869355211726464:0@lo:104: 00010000:00010000:1.0:1782758700.986709:0:102029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.986716:0:102029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.986722:0:102029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758700.986728:0:102029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc247 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758701.614234:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758701.996262:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758701.996333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758701.996405:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726720 00000100:00100000:3.0:1782758701.996413:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726720 00000100:00100000:3.0:1782758701.996576:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1782758701.996585:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211726720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758701.996656:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758701.996704:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211726720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758701.996711:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00080000:3.0:1782758701.996733:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758701.996861:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211726720:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782758702.016589:0:102079:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe97c136b0 20000000:00000080:2.0:1782758702.016608:0:102079:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2b9e800 uarg=0000000000000000 10000000:01000000:2.0:1782758702.018008:0:102079:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758702.018035:0:102079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018052:0:102079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018062:0:102079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018068:0:102079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018076:0:102079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018083:0:102079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018090:0:102079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758702.018094:0:102079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018102:0:102079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018114:0:102079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018121:0:102079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758702.018126:0:102079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777dc24e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1782758702.102985:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758702.102997:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082b41000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758702.103064:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082b41000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0000 00000020:00000080:2.0:1782758702.103124:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082b42000 for lustre-OST0000 00000001:00100000:3.0:1782758702.106597:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:3.0:1782758702.106608:0:7507:0:(genops.c:906:class_export_put()) final put ffff917186a5c000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:2.0:1782758702.106714:0:64700:0:(genops.c:865:class_export_destroy()) destroying export ffff917186a5c000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-OST0001 00000020:00000080:2.0:1782758702.107130:0:64700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917186a5e800 for lustre-OST0001 10000000:01000000:0.0:1782758702.380975:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758702.380985:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758702.380991:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758702.381052:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758702.381063:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758702.381074:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758702.381100:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211726848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758702.381170:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758702.381228:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758702.381930:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726848 00000100:00100000:1.0:1782758702.381938:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726848 00000100:00100000:1.0:1782758702.381999:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1782758702.382010:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211726848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758702.382026:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758702.382043:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc255 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758702.382070:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758702.382083:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758702.382091:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782758702.382193:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211726848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758702.382199:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1782758702.389816:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211726848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758702.389866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758702.389879:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758702.389904:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758702.389910:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758702.389922:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758702.643396:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758703.174692:0:102130:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd2b208a0 20000000:00000080:1.0:1782758703.174711:0:102130:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312dc00 uarg=0000000000000000 10000000:01000000:1.0:1782758703.174969:0:102130:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758703.174991:0:102130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.175011:0:102130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.175020:0:102130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.175065:0:102130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.175079:0:102130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 18 pid: 5794 timeout: 2871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758703.175094:0:102130:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102130:1869355211726976:0@lo:104: 00000100:00100000:1.0:1782758703.175163:0:102130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758703.175211:0:102130:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182c900 going to sleep for 11 seconds 00000100:00100000:2.0:1782758703.175416:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211726976 00000100:00100000:2.0:1782758703.175425:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211726976 00000100:00100000:2.0:1782758703.175482:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1782758703.175491:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102130:x1869355211726976:12345-0@lo:104: 00010000:00010000:2.0:1782758703.175504:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175563:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758703.175570:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102130:x1869355211726976:12345-0@lo:104: Request processed in 80us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758703.175578:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00010000:2.0:1782758703.175599:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758703.175604:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175611:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758703.175616:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175626:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758703.175633:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758703.175638:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758703.175666:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175673:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758703.175694:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175705:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc255 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc25c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175720:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758703.175722:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758703.175723:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758703.175742:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211727104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758703.175787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758703.175848:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727104 00000100:00100000:2.0:1782758703.175852:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727104 00010000:00010000:2.0:1782758703.175871:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 19 pid: 5794 timeout: 2871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758703.175894:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1782758703.175900:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211727104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758703.175910:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758703.175915:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 19 pid: 5794 timeout: 2871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175925:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 19 pid: 5794 timeout: 2871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175940:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175959:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175977:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175984:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175991:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.175996:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.176001:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758703.176005:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.176011:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.176019:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758703.176027:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758703.176054:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211727104:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758703.176060:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1782758703.176098:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211727104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758703.176191:0:102130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc25c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc255 expref: 18 pid: 5794 timeout: 2871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758703.176202:0:102130:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102130:1869355211726976:0@lo:104: 00010000:00010000:1.0:1782758703.176213:0:102130:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.176226:0:102130:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.176232:0:102130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758703.176240:0:102130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc263 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758703.298185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758703.298244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758703.298287:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887424 00000100:00100000:3.0:1782758703.298296:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887424 00000100:00100000:3.0:1782758703.298353:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1993 00000100:00100000:3.0:1782758703.298363:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196887424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758703.298444:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196887424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758703.298451:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1993 00000100:00080000:3.0:1782758703.298473:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758703.303152:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887296 00000100:00100000:0.0:1782758703.303165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887296 00000100:00100000:0.0:1782758703.303224:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1495 00000100:00100000:0.0:1782758703.303233:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196887296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758703.304990:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196887296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1744us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758703.305005:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1495 00010000:00010000:0.0:1782758703.661048:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758704.044859:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211727616:0@lo:400:kworker.0 00000100:00100000:1.0:1782758704.044953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758704.045011:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782758704.045018:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211727232:0@lo:400:kworker.0 00000100:00100000:1.0:1782758704.045046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758704.045071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211727744:0@lo:400:kworker.0 00000100:00100000:1.0:1782758704.045095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758704.045126:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727232 00000100:00100000:1.0:1782758704.045133:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727232 00000100:00100000:1.0:1782758704.045180:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1782758704.045189:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211727232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758704.045240:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211727232:12345-0@lo:400:kworker.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758704.045247:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1782758704.045296:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211727232:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045449:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211727360:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758704.045569:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211727872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758704.045623:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758704.045630:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211727488:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758704.045698:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727616 00000100:00100000:3.0:1782758704.045705:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727616 00000100:00100000:3.0:1782758704.045759:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727872 00000100:00100000:3.0:1782758704.045762:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727872 00000100:00100000:3.0:1782758704.045787:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:3.0:1782758704.045795:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045890:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211727616:12345-0@lo:400:kworker.0 Request processed in 95us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758704.045897:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:3.0:1782758704.045914:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:3.0:1782758704.045920:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211727872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.045966:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211727872:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758704.045972:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:3.0:1782758704.045994:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727744 00000100:00100000:3.0:1782758704.045998:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727744 00000100:00100000:3.0:1782758704.046027:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727360 00000100:00100000:3.0:1782758704.046029:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727360 00000100:00100000:3.0:1782758704.046044:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211727488 00000100:00100000:3.0:1782758704.046047:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211727488 00000100:00100000:3.0:1782758704.046064:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1782758704.046070:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211727744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.046103:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211727744:12345-0@lo:400:kworker.0 Request processed in 33us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758704.046109:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1782758704.046121:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:3.0:1782758704.046127:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211727360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.046154:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211727360:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758704.046160:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1782758704.046503:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1782758704.046523:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758704.046591:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211727488:12345-0@lo:400:kworker.0 Request processed in 77us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758704.046598:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00080000:3.0:1782758704.049149:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758704.049165:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758704.049625:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758704.049969:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211727488:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.049995:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211727360:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.050010:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211727872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.050075:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211727744:0@lo:400:kworker.0 00000100:00100000:3.0:1782758704.050089:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211727616:0@lo:400:kworker.0 00000020:00000080:1.0:1782758704.358999:0:102178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1beb52f0 20000000:00000080:1.0:1782758704.359029:0:102178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312c800 uarg=0000000000000000 10000000:01000000:1.0:1782758704.359336:0:102178:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758704.359366:0:102178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359389:0:102178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359402:0:102178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359410:0:102178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359418:0:102178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359427:0:102178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359433:0:102178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758704.359438:0:102178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359448:0:102178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359771:0:102178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359781:0:102178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758704.359788:0:102178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc26a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758704.558554:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758704.558688:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758704.558790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758704.561385:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728000 00000100:00100000:0.0:1782758704.561406:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728000 00000100:00100000:0.0:1782758704.561488:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1782758704.561500:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211728000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758704.561552:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758704.561663:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211728000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758704.561671:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1782758704.561755:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211728000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758704.692843:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758705.137035:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758705.137043:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758705.137048:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758705.138239:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758705.138254:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758705.138266:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758705.138292:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211728128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758705.138364:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758705.138418:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4c780 going to sleep for 11 seconds 00000100:00100000:0.0:1782758705.138503:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728128 00000100:00100000:0.0:1782758705.138511:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728128 00000100:00100000:0.0:1782758705.138566:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1782758705.138575:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211728128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758705.138588:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758705.138602:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc271 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.138626:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.138637:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.138646:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782758705.138687:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211728128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758705.138694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1782758705.138795:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211728128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758705.138814:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758705.138888:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758705.138909:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758705.138925:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758705.138932:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782758705.530376:0:102226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccd0cc100 20000000:00000080:0.0:1782758705.530400:0:102226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc0c00 uarg=0000000000000000 10000000:01000000:0.0:1782758705.530668:0:102226:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758705.530696:0:102226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.530718:0:102226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.530728:0:102226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.530778:0:102226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.530795:0:102226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 18 pid: 5796 timeout: 2873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758705.530818:0:102226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102226:1869355211728256:0@lo:104: 00000100:00100000:0.0:1782758705.531439:0:102226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758705.531572:0:102226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a04df9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758705.531631:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728256 00000100:00100000:1.0:1782758705.531641:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728256 00000100:00100000:1.0:1782758705.531735:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1782758705.531745:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102226:x1869355211728256:12345-0@lo:104: 00010000:00010000:1.0:1782758705.531764:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.531864:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758705.531871:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102226:x1869355211728256:12345-0@lo:104: Request processed in 127us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758705.531879:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782758705.531991:0:102226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102226:1869355211728256:0@lo:104: 00010000:00010000:0.0:1782758705.532015:0:102226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532136:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758705.532143:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532151:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758705.532156:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532165:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758705.532173:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758705.532179:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758705.532318:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532326:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758705.532364:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532372:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc271 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc278 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532392:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758705.532394:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758705.532396:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758705.532404:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758705.532419:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211728384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758705.532457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758705.532501:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728384 00000100:00100000:1.0:1782758705.532506:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728384 00010000:00010000:1.0:1782758705.532527:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 2873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758705.532560:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1782758705.532567:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211728384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758705.532582:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758705.532589:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 2873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532600:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 2873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532615:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc278 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc271 expref: 19 pid: 5796 timeout: 2873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532629:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532640:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532653:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532661:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532668:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532674:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532683:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758705.532688:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532695:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532708:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758705.532718:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758705.532746:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211728384:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758705.532753:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1782758705.532786:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211728384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758705.533067:0:102226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.533076:0:102226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758705.533082:0:102226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc27f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758705.712044:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758706.649411:0:102275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3e24e1f0 20000000:00000080:0.0:1782758706.649428:0:102275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc2800 uarg=0000000000000000 10000000:01000000:0.0:1782758706.649936:0:102275:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758706.649963:0:102275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.649979:0:102275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.649990:0:102275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.649996:0:102275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650004:0:102275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650011:0:102275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650017:0:102275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758706.650021:0:102275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650029:0:102275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650042:0:102275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650049:0:102275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758706.650056:0:102275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc286 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758706.732948:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758707.128701:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758707.128730:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211728512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758707.128817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758707.132254:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728512 00000100:00100000:3.0:1782758707.132270:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728512 00000100:00100000:3.0:1782758707.132479:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1782758707.132490:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211728512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758707.132531:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758707.132617:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211728512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758707.132625:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00080000:3.0:1782758707.132658:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758707.132700:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211728512:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782758707.510484:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758707.510492:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758707.510497:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758707.510548:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758707.510561:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758707.510574:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758707.510613:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211728640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758707.510684:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758707.510736:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170812abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758707.510955:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728640 00000100:00100000:0.0:1782758707.510964:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728640 00000100:00100000:0.0:1782758707.511010:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1782758707.511019:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211728640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758707.511032:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758707.511045:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc28d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758707.511073:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758707.511084:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758707.511095:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758707.511147:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211728640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758707.511154:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1782758707.511540:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211728640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758707.511557:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758707.511566:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758707.511586:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758707.511592:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758707.511600:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758707.757446:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758708.408520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758708.408568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758708.408597:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887680 00000100:00100000:0.0:1782758708.408606:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887680 00000100:00100000:0.0:1782758708.408673:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1997 00000100:00100000:0.0:1782758708.408683:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196887680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758708.408758:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2364:x1869355196887680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758708.408766:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1997 00000100:00100000:0.0:1782758708.408800:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887552 00000100:00100000:0.0:1782758708.408803:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887552 00000100:00100000:0.0:1782758708.408842:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1499 00000100:00100000:0.0:1782758708.408859:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196887552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758708.408886:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2364:x1869355196887552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758708.408892:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1499 00000100:00080000:0.0:1782758708.408919:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758708.783956:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758709.167609:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211729024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758709.167676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758709.167728:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758709.167734:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211729152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758709.167760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758709.167791:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729024 00000100:00100000:2.0:1782758709.167798:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729024 00000100:00100000:2.0:1782758709.167871:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1782758709.167882:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211729024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758709.167935:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211729024:12345-0@lo:400:kworker.0 Request processed in 56us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758709.167943:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1782758709.167964:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729152 00000100:00100000:2.0:1782758709.167967:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729152 00000100:00100000:2.0:1782758709.167991:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1782758709.167997:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211729152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758709.168026:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211729152:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758709.168031:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1782758709.168067:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211729152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758709.168078:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211729024:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168258:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211728768:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758709.168392:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211729280:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758709.168436:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758709.168442:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211728896:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758709.168479:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211729408:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782758709.168528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758709.168532:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758709.168543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728768 00000100:00100000:0.0:1782758709.168547:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728768 00000100:00100000:0.0:1782758709.168573:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1782758709.168580:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211728768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168611:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211728768:12345-0@lo:400:kworker.0 Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758709.168617:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1782758709.168649:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729280 00000100:00100000:0.0:1782758709.168652:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729280 00000100:00100000:0.0:1782758709.168676:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211728896 00000100:00100000:0.0:1782758709.168678:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211728896 00000100:00100000:0.0:1782758709.168697:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1782758709.168703:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211729280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168733:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211729280:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758709.168740:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1782758709.168752:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1782758709.168757:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211728896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168781:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211728896:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758709.168786:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1782758709.168805:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729408 00000100:00100000:0.0:1782758709.168808:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729408 00000100:00100000:0.0:1782758709.168858:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1782758709.168865:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211729408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168894:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211729408:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758709.168900:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00080000:0.0:1782758709.168923:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758709.168925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758709.168941:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211728896:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168950:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211729408:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168957:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211728768:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.168964:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211729280:0@lo:400:kworker.0 00000100:00100000:0.0:1782758709.677173:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211729536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758709.677247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758709.677337:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729536 00000100:00100000:0.0:1782758709.677346:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729536 00000100:00100000:0.0:1782758709.677407:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1782758709.677418:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211729536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758709.677460:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758709.677513:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211729536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758709.677521:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1782758709.677588:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211729536:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782758709.771784:0:102425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe33d6d00 20000000:00000080:2.0:1782758709.771805:0:102425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2b9e400 uarg=0000000000000000 10000000:01000000:2.0:1782758709.772551:0:102425:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758709.772576:0:102425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.772595:0:102425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.772605:0:102425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.772648:0:102425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.772664:0:102425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 18 pid: 5794 timeout: 2878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758709.772680:0:102425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102425:1869355211729664:0@lo:104: 00000100:00100000:2.0:1782758709.772746:0:102425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758709.772875:0:102425:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a000 going to sleep for 11 seconds 00000100:00100000:1.0:1782758709.778449:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729664 00000100:00100000:1.0:1782758709.778465:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729664 00000100:00100000:2.0:1782758709.778595:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782758709.778608:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102425:x1869355211729664:12345-0@lo:104: 00010000:00010000:2.0:1782758709.778629:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778738:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758709.778744:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102425:x1869355211729664:12345-0@lo:104: Request processed in 140us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758709.778752:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:2.0:1782758709.778773:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758709.778779:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778788:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758709.778793:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778802:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758709.778809:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758709.778816:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758709.778876:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778882:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758709.778899:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778906:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc28d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc294 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.778922:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758709.778924:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758709.778925:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758709.779008:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211729792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758709.779058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758709.779164:0:102425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102425:1869355211729664:0@lo:104: 00010000:00010000:0.0:1782758709.779192:0:102425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758709.779420:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729792 00000100:00100000:2.0:1782758709.779425:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729792 00010000:00010000:2.0:1782758709.779446:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 2878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758709.779470:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1782758709.779479:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211729792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758709.779491:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758709.779496:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 2878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779507:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 2878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779520:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc294 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc28d expref: 19 pid: 5794 timeout: 2878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779534:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779543:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779557:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779563:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779570:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779577:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779583:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758709.779587:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779595:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779616:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758709.779625:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758709.779659:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211729792:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758709.779666:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1782758709.779697:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211729792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758709.779752:0:102425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758709.779760:0:102425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758709.779765:0:102425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc29b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758709.805575:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758710.814023:0:102473:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff38872dc0 20000000:00000080:3.0:1782758710.814044:0:102473:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812ea800 uarg=0000000000000000 10000000:01000000:3.0:1782758710.814288:0:102473:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758710.814328:0:102473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814346:0:102473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814356:0:102473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814364:0:102473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814370:0:102473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814377:0:102473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814383:0:102473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758710.814387:0:102473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814395:0:102473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814407:0:102473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814415:0:102473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758710.814421:0:102473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2a2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758710.836700:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758711.085928:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758711.085945:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758711.085950:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758711.086005:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758711.086019:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758711.086031:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758711.086059:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211729920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758711.086261:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758711.086316:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917184d113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758711.090903:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211729920 00000100:00100000:2.0:1782758711.090918:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211729920 00000100:00100000:2.0:1782758711.090976:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1782758711.090986:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211729920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758711.091003:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758711.091024:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc2a9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758711.091064:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758711.091075:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758711.091084:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758711.091887:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211729920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 900us (5623us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758711.091896:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1782758711.095907:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211729920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758711.095941:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758711.095955:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758711.095980:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758711.095988:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758711.095996:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758711.852045:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758712.237678:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211730048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758712.237757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758712.238817:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730048 00000100:00100000:3.0:1782758712.238845:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730048 00000100:00100000:3.0:1782758712.238902:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1782758712.238988:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211730048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758712.239028:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758712.239217:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211730048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 307us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758712.239226:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1782758712.239286:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211730048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758712.240012:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758712.875996:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758713.525988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758713.526036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758713.527245:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887936 00000100:00100000:2.0:1782758713.527258:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887936 00000100:00100000:2.0:1782758713.527345:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00100000:2.0:1782758713.527357:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196887936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758713.527444:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196887936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758713.527451:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00080000:2.0:1782758713.527474:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758713.529358:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196887808 00000100:00100000:3.0:1782758713.529373:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196887808 00000100:00100000:3.0:1782758713.529492:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1502 00000100:00100000:3.0:1782758713.529501:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196887808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758713.529583:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196887808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758713.529591:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1502 00010000:00010000:2.0:1782758713.903931:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758714.284216:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211730432:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758714.284341:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758714.284347:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211730304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758714.284382:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211730816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758714.284432:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730432 00000100:00100000:0.0:1782758714.284439:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730432 00000100:00100000:0.0:1782758714.284487:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730304 00000100:00100000:0.0:1782758714.284490:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730304 00000100:00100000:0.0:1782758714.284510:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1782758714.284517:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211730432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284567:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211730432:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758714.284574:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1782758714.284600:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1782758714.284606:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284632:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211730304:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758714.284638:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1782758714.284658:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730816 00000100:00100000:0.0:1782758714.284661:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730816 00000100:00100000:0.0:1782758714.284686:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1782758714.284691:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211730816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284718:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211730816:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758714.284723:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00080000:0.0:1782758714.284753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758714.284757:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758714.284793:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211730304:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284802:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211730816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.284811:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211730432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285349:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211730560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758714.285412:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758714.285417:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211730176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758714.285462:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211730688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758714.285744:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730176 00000100:00100000:3.0:1782758714.285749:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730176 00000100:00100000:3.0:1782758714.285780:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1782758714.285787:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211730176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285850:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211730176:12345-0@lo:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758714.285856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1782758714.285884:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730688 00000100:00100000:3.0:1782758714.285887:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730688 00000100:00100000:3.0:1782758714.285915:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:3.0:1782758714.285921:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285950:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211730688:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758714.285956:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00080000:3.0:1782758714.285971:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758714.285987:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211730176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758714.285998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211730688:0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.286076:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730560 00000100:00100000:0.0:1782758714.286080:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730560 00000100:00100000:0.0:1782758714.286112:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1782758714.286118:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758714.286151:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211730560:12345-0@lo:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758714.286156:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00080000:3.0:1782758714.294378:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758714.294443:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211730560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758714.796293:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211730944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758714.796366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758714.796462:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211730944 00000100:00100000:2.0:1782758714.796471:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211730944 00000100:00100000:2.0:1782758714.796523:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1782758714.796534:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211730944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758714.796577:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758714.801296:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211730944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4754us (4920us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758714.801312:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1782758714.801429:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211730944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758714.925034:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758715.292461:0:102671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd863c950 20000000:00000080:3.0:1782758715.292480:0:102671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812ea000 uarg=0000000000000000 00010000:00010000:3.0:1782758715.295759:0:102671:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758715.295779:0:102671:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758715.295792:0:102671:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758715.295993:0:102671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.296012:0:102671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.296021:0:102671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.296064:0:102671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.296079:0:102671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 18 pid: 5794 timeout: 2883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758715.296100:0:102671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102671:1869355211731072:0@lo:104: 00000100:00100000:3.0:1782758715.296165:0:102671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758715.296259:0:102671:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758715.296452:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782758715.296467:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731072 00000100:00100000:1.0:1782758715.296473:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731072 00000100:00100000:1.0:1782758715.296674:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782758715.296684:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b30da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102671:x1869355211731072:12345-0@lo:104: 00010000:00010000:1.0:1782758715.296699:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758715.296809:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758715.296815:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b30da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102671:x1869355211731072:12345-0@lo:104: Request processed in 133us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758715.296841:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1782758715.296962:0:102671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102671:1869355211731072:0@lo:104: 00010000:00010000:3.0:1782758715.296980:0:102671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297126:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758715.297134:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297143:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758715.297147:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297157:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758715.297166:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758715.297172:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758715.297239:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297246:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758715.297273:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297280:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dc2a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297306:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758715.297308:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758715.297309:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758715.297398:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211731200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758715.297431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758715.297549:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731200 00000100:00100000:0.0:1782758715.297554:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731200 00010000:00010000:0.0:1782758715.297574:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 2883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758715.297603:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1782758715.297610:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211731200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758715.297620:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758715.297625:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 2883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297634:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 2883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297648:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc2a9 expref: 19 pid: 5794 timeout: 2883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297660:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297669:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297681:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297688:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297695:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297701:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297706:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758715.297710:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297728:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297739:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758715.297747:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758715.297779:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211731200:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758715.297786:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1782758715.297936:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211731200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758715.298000:0:102671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.298008:0:102671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.298015:0:102671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2b7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758715.948764:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758716.715971:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758716.715980:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758716.715985:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758716.716058:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758716.716070:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758716.716082:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758716.716108:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211731328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758716.716173:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758716.716246:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758716.716757:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731328 00000100:00100000:3.0:1782758716.716767:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731328 00000100:00100000:0.0:1782758716.716920:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1782758716.716933:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211731328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758716.716951:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758716.716969:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc2be expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758716.717011:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758716.717023:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758716.717032:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50200, rc 0) 00000100:00100000:0.0:1782758716.717099:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211731328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758716.717106:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1782758716.717373:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211731328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758716.717391:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758716.717400:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758716.717423:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758716.717428:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758716.717434:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758716.975175:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758717.363547:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211731456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758717.364466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758717.365801:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731456 00000100:00100000:2.0:1782758717.365814:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731456 00000100:00100000:2.0:1782758717.365927:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1782758717.365946:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211731456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758717.366183:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782758717.367131:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758717.367245:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211731456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1299us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758717.367255:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1782758717.367848:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211731456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758717.999023:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758718.658438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758718.658483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758718.658486:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888064 00000100:00100000:3.0:1782758718.658504:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888064 00000100:00100000:1.0:1782758718.658566:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888192 00000100:00100000:1.0:1782758718.658573:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888192 00000100:00100000:3.0:1782758718.658580:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1505 00000100:00100000:3.0:1782758718.658597:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758718.658629:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2005 00000100:00100000:1.0:1782758718.658637:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758718.658726:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758718.658734:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758718.658741:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1505 00000100:00100000:1.0:1782758718.658750:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2005 00000100:00080000:3.0:1782758718.658792:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758719.021173:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758719.406744:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211731584:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.406874:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.406955:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211732096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.406985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.407031:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758719.407037:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211731712:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.407062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.407083:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211732224:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.407110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.407404:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211731840:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.407438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.407464:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758719.407470:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211731968:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.407494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.407535:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731584 00000100:00100000:0.0:1782758719.407677:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731584 00000100:00100000:0.0:1782758719.407753:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1782758719.407764:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.407863:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211731584:12345-0@lo:400:kworker.0 Request processed in 99us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.407870:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1782758719.407918:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732096 00000100:00100000:0.0:1782758719.407923:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732096 00000100:00100000:0.0:1782758719.407971:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731712 00000100:00100000:0.0:1782758719.407975:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731712 00000100:00100000:0.0:1782758719.407993:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731840 00000100:00100000:0.0:1782758719.408007:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731840 00000100:00100000:0.0:1782758719.408029:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1782758719.408036:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211732096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.408076:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211732096:12345-0@lo:400:kworker.0 Request processed in 40us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.408082:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1782758719.408096:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1782758719.408101:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211731712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.408130:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211731712:12345-0@lo:400:kworker.0 Request processed in 29us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.408147:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1782758719.408158:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1782758719.408164:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211731840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.408205:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211731840:12345-0@lo:400:kworker.0 Request processed in 41us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.408211:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1782758719.408235:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732224 00000100:00100000:0.0:1782758719.408238:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732224 00000100:00100000:0.0:1782758719.408264:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211731968 00000100:00100000:0.0:1782758719.408267:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211731968 00000100:00100000:0.0:1782758719.408285:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:0.0:1782758719.408291:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.408322:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211732224:12345-0@lo:400:kworker.0 Request processed in 31us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.408327:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:0.0:1782758719.408338:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:0.0:1782758719.408343:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211731968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782758719.408592:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758719.408597:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758719.408601:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758719.415651:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211731840:0@lo:400:kworker.0 00000100:00100000:1.0:1782758719.416450:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211731712:0@lo:400:kworker.0 00000100:00100000:1.0:1782758719.416471:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211732224:0@lo:400:kworker.0 00000100:00100000:1.0:1782758719.416491:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211731584:0@lo:400:kworker.0 00000100:00100000:1.0:1782758719.416510:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211732096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758719.416600:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211731968:12345-0@lo:400:kworker.0 Request processed in 8249us (9098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.416616:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1782758719.416746:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211731968:0@lo:400:kworker.0 00000100:00100000:1.0:1782758719.916512:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211732352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758719.916621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758719.916912:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732352 00000100:00100000:0.0:1782758719.916927:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732352 00000100:00100000:0.0:1782758719.916995:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1782758719.917007:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211732352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758719.917055:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758719.917129:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211732352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758719.917137:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1782758719.917290:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211732352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758720.045957:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758721.068069:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758721.184947:0:102918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8fd8f900 20000000:00000080:0.0:1782758721.184968:0:102918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb934000 uarg=0000000000000000 00010000:00010000:1.0:1782758721.191183:0:102918:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758721.191202:0:102918:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758721.191229:0:102918:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758721.191247:0:102918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758721.191263:0:102918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758721.191272:0:102918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758721.191313:0:102918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758721.191332:0:102918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 18 pid: 5796 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758721.191347:0:102918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102918:1869355211732480:0@lo:104: 00000100:00100000:1.0:1782758721.191413:0:102918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758721.191957:0:102918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c300 going to sleep for 11 seconds 00000100:00100000:2.0:1782758721.192816:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732480 00000100:00100000:2.0:1782758721.193011:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732480 00000100:00100000:2.0:1782758721.193120:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1782758721.193131:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102918:x1869355211732480:12345-0@lo:104: 00010000:00010000:2.0:1782758721.193148:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758721.193238:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758721.193245:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:102918:x1869355211732480:12345-0@lo:104: Request processed in 117us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758721.193251:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1782758721.193324:0:102918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102918:1869355211732480:0@lo:104: 00010000:00010000:0.0:1782758721.193349:0:102918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193459:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758721.193469:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193477:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758721.193481:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193490:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758721.193497:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758721.193502:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758721.193584:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193591:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758721.193634:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193643:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2c5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193659:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758721.193661:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758721.193662:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758721.193670:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758721.193683:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211732608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758721.193720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758721.193763:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732608 00000100:00100000:3.0:1782758721.193768:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732608 00010000:00010000:3.0:1782758721.193791:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758721.193818:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1782758721.193850:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211732608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758721.193861:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758721.193867:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193881:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193895:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50200/0xdd99f5c4777dc2c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc2be expref: 19 pid: 5796 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193910:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193924:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193941:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193948:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193956:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193963:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193968:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758721.193973:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193980:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.193995:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758721.194005:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758721.194034:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211732608:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758721.194040:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1782758721.194074:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211732608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758721.194679:0:102918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758721.194688:0:102918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758721.194695:0:102918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc2cc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758722.098654:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758722.421462:0:102967:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc2908d00 20000000:00000080:3.0:1782758722.421486:0:102967:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812eac00 uarg=0000000000000000 00010000:00010000:3.0:1782758722.422641:0:102967:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782758722.422664:0:102967:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782758722.422684:0:102967:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758722.422706:0:102967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422723:0:102967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422735:0:102967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422743:0:102967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422750:0:102967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422756:0:102967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422762:0:102967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758722.422767:0:102967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422775:0:102967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422790:0:102967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422799:0:102967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758722.422806:0:102967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc2d3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758722.481772:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758722.481811:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211732736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758722.481917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758722.482817:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732736 00000100:00100000:2.0:1782758722.483053:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732736 00000100:00100000:2.0:1782758722.483134:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1782758722.483144:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211732736:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758722.483451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782758722.483998:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758722.484082:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211732736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 939us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758722.484091:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1782758722.484482:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211732736:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782758722.676416:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758722.676424:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758722.676429:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758722.676478:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758722.676490:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758722.676500:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758722.676525:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211732864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758722.676600:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758722.676655:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758722.684062:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732864 00000100:00100000:0.0:1782758722.684080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732864 00000100:00100000:0.0:1782758722.684151:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1782758722.684161:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211732864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758722.684179:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758722.684202:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc2da expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758722.684233:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758722.684244:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758722.684253:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758722.684337:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211732864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (7735us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758722.684343:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1782758722.691651:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211732864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758722.691683:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758722.691695:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758722.691725:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758722.691731:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758722.691738:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.118326:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758723.764487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758723.764583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758723.764686:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888448 00000100:00100000:1.0:1782758723.764699:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888448 00000100:00100000:1.0:1782758723.764790:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2009 00000100:00100000:1.0:1782758723.764801:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196888448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758723.764922:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2362:x1869355196888448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 123us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758723.764930:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2009 00000100:00080000:3.0:1782758723.764997:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758723.766428:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888320 00000100:00100000:2.0:1782758723.766440:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888320 00000100:00100000:2.0:1782758723.766512:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1508 00000100:00100000:2.0:1782758723.766523:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196888320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758723.767838:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2362:x1869355196888320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 125us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758723.767854:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1508 00000020:00000080:2.0:1782758723.832228:0:103016:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff34401470 20000000:00000080:2.0:1782758723.832248:0:103016:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a2400 uarg=0000000000000000 00010000:00010000:2.0:1782758723.832476:0:103016:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758723.832490:0:103016:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758723.832506:0:103016:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758723.832523:0:103016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.832540:0:103016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.832560:0:103016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.832601:0:103016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.832615:0:103016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 18 pid: 5793 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758723.832629:0:103016:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103016:1869355211732992:0@lo:104: 00000100:00100000:2.0:1782758723.832692:0:103016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758723.832753:0:103016:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758723.833789:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211732992 00000100:00100000:1.0:1782758723.833804:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211732992 00000100:00100000:1.0:1782758723.834051:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782758723.834062:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103016:x1869355211732992:12345-0@lo:104: 00010000:00010000:1.0:1782758723.834079:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758723.834169:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758723.834175:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103016:x1869355211732992:12345-0@lo:104: Request processed in 117us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758723.834183:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:0.0:1782758723.834294:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758723.834303:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834311:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758723.834316:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834327:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758723.834335:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758723.834340:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758723.834386:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834395:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758723.834424:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834431:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc2da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2e1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834450:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758723.834452:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758723.834453:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758723.834460:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758723.834472:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211733120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758723.834510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758723.834565:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733120 00000100:00100000:0.0:1782758723.834569:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733120 00010000:00010000:0.0:1782758723.834592:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 19 pid: 5793 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758723.834613:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1782758723.834619:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211733120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758723.834631:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758723.834636:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 19 pid: 5793 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834647:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 19 pid: 5793 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834669:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834680:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834695:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834702:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834710:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834716:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834721:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758723.834726:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834732:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834741:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758723.834749:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758723.834778:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211733120:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758723.834785:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1782758723.835389:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211733120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758723.836082:0:103016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc2e1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc2da expref: 18 pid: 5793 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758723.836100:0:103016:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103016:1869355211732992:0@lo:104: 00010000:00010000:2.0:1782758723.836125:0:103016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.836136:0:103016:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.836142:0:103016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758723.836149:0:103016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc2e8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.140277:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758724.526296:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211733248:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.526429:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211733760:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.526479:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758724.526485:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211733376:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.526546:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211733504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.526586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758724.526592:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211733632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.526643:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733760 00000100:00100000:2.0:1782758724.526650:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733760 00000100:00100000:2.0:1782758724.526700:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733504 00000100:00100000:2.0:1782758724.526702:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733504 00000100:00100000:2.0:1782758724.526722:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1782758724.526729:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211733760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.526781:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211733760:12345-0@lo:400:kworker.0 Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758724.526788:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1782758724.526803:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1782758724.526809:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211733504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.527348:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211733504:12345-0@lo:400:kworker.0 Request processed in 537us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758724.527356:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1782758724.527380:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733248 00000100:00100000:2.0:1782758724.527385:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733248 00000100:00100000:2.0:1782758724.527413:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733376 00000100:00100000:2.0:1782758724.527417:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733376 00000100:00100000:2.0:1782758724.527438:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733632 00000100:00100000:2.0:1782758724.527441:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733632 00000100:00100000:2.0:1782758724.527455:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1782758724.527461:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211733248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.527500:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211733248:12345-0@lo:400:kworker.0 Request processed in 40us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758724.527506:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1782758724.527517:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1782758724.527523:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211733376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758724.528110:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1782758724.528122:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758724.528167:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211733632:12345-0@lo:400:kworker.0 Request processed in 48us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758724.528173:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1782758724.533300:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211733376:12345-0@lo:400:kworker.0 Request processed in 5764us (6779us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758724.533318:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:2.0:1782758724.533371:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758724.533377:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758724.533380:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758724.533435:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211733632:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.533450:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211733504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.533508:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211733376:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.533523:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211733248:0@lo:400:kworker.0 00000100:00100000:2.0:1782758724.533548:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211733760:0@lo:400:kworker.0 10000000:01000000:2.0:1782758724.912108:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758724.912116:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758724.912121:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758724.912176:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912191:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912202:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758724.912229:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211733888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758724.912301:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758724.912349:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758724.912372:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211733888 00000100:00100000:2.0:1782758724.912379:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211733888 00000100:00100000:2.0:1782758724.912425:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1782758724.912434:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211733888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758724.912448:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758724.912464:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc2ef expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912485:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912507:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912517:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782758724.912568:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211733888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758724.912574:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1782758724.912622:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211733888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758724.912635:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912644:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758724.912662:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758724.912667:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758724.912674:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758725.039621:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211734016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758725.039700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758725.039800:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734016 00000100:00100000:1.0:1782758725.039809:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734016 00000100:00100000:1.0:1782758725.039898:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1782758725.039908:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211734016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758725.039944:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758725.062786:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211734016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 22869us (23075us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758725.062800:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1782758725.081257:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211734016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758725.167754:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758726.188387:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758727.213952:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758727.602009:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758727.602121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758727.602276:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734144 00000100:00100000:0.0:1782758727.602296:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734144 00000100:00100000:0.0:1782758727.602375:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1782758727.602387:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211734144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758727.602438:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758727.602517:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211734144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758727.602527:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00080000:2.0:1782758727.602947:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758727.603003:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211734144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758728.236966:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758728.887782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758728.887860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758728.887896:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888576 00000100:00100000:3.0:1782758728.887909:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888576 00000100:00100000:3.0:1782758728.887971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1510 00000100:00100000:3.0:1782758728.889122:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758728.890345:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2355us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758728.890362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1510 00000100:00100000:3.0:1782758728.890434:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888704 00000100:00100000:3.0:1782758728.890443:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888704 00000100:00100000:3.0:1782758728.890526:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2013 00000100:00100000:3.0:1782758728.890536:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758728.890578:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758728.890585:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2013 00000100:00080000:3.0:1782758728.890611:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758729.260468:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758729.471519:0:103214:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe51a1eb0 20000000:00000080:1.0:1782758729.471548:0:103214:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2f800 uarg=0000000000000000 00010000:00010000:1.0:1782758729.474573:0:103214:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758729.474598:0:103214:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758729.474621:0:103214:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758729.474646:0:103214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758729.474669:0:103214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758729.474679:0:103214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758729.474730:0:103214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758729.474748:0:103214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 18 pid: 5794 timeout: 2897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758729.475190:0:103214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103214:1869355211734272:0@lo:104: 00000100:00100000:1.0:1782758729.475336:0:103214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758729.475468:0:103214:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758729.475580:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734272 00000100:00100000:2.0:1782758729.475588:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734272 00000100:00100000:2.0:1782758729.475690:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1782758729.475700:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103214:x1869355211734272:12345-0@lo:104: 00010000:00010000:2.0:1782758729.475715:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758729.475795:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758729.475801:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103214:x1869355211734272:12345-0@lo:104: Request processed in 103us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.475807:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00010000:3.0:1782758729.475890:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758729.475899:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.475907:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758729.475922:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.475932:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758729.475941:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758729.475947:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758729.475983:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.475989:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758729.476023:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476030:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc2ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc2f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476049:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758729.476051:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758729.476052:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758729.476073:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211734400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758729.476130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758729.476179:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734400 00000100:00100000:3.0:1782758729.476184:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734400 00010000:00010000:3.0:1782758729.476205:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 2897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758729.476240:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1782758729.476247:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211734400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758729.476261:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758729.476267:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 2897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476277:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 2897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476295:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476304:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476320:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476327:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476332:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476338:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.476347:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758729.476484:0:103214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777dc2f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc2ef expref: 19 pid: 5794 timeout: 2897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758729.476499:0:103214:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103214:1869355211734272:0@lo:104: 00010000:00010000:0.0:1782758729.476520:0:103214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758729.476530:0:103214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758729.476537:0:103214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.481296:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.481332:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.481355:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.481434:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc2fd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758729.481473:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758729.481646:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211734400:12345-0@lo:103:ldlm_bl.0 Request processed in 5394us (5510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758729.481659:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1782758729.482415:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211734400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758729.645410:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211734784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758729.645527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758729.645632:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758729.645639:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211734912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758729.645672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758729.645947:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211734656:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.645985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758729.646024:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211735168:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758729.646072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782758729.646078:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211734528:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758729.646134:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211735040:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758729.646194:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734784 00000100:00100000:2.0:1782758729.646204:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734784 00000100:00100000:2.0:1782758729.646289:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734656 00000100:00100000:2.0:1782758729.646293:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734656 00000100:00100000:2.0:1782758729.646313:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735040 00000100:00100000:2.0:1782758729.646316:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735040 00000100:00100000:2.0:1782758729.646335:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:2.0:1782758729.646345:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211734784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646418:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211734784:12345-0@lo:400:kworker.0 Request processed in 73us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646428:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:2.0:1782758729.646458:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1782758729.646464:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211734656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646497:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211734656:12345-0@lo:400:kworker.0 Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646504:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1782758729.646514:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1782758729.646519:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646542:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211735040:12345-0@lo:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1782758729.646565:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734912 00000100:00100000:2.0:1782758729.646568:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734912 00000100:00100000:2.0:1782758729.646591:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735168 00000100:00100000:2.0:1782758729.646593:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735168 00000100:00100000:2.0:1782758729.646608:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1782758729.646613:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646640:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211734912:12345-0@lo:400:kworker.0 Request processed in 27us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646646:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1782758729.646655:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1782758729.646659:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646679:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211735168:12345-0@lo:400:kworker.0 Request processed in 19us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646684:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1782758729.646704:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211734528 00000100:00100000:2.0:1782758729.646707:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211734528 00000100:00100000:2.0:1782758729.646731:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1782758729.646737:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211734528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.646764:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211734528:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758729.646770:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00080000:2.0:1782758729.646807:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758729.646813:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758729.646815:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758729.646988:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211734528:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.647002:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211735040:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.647011:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211734656:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.647019:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211735168:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.647057:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211734912:0@lo:400:kworker.0 00000100:00100000:2.0:1782758729.647066:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211734784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758730.157311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758730.157343:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758730.157446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758730.157561:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735296 00000100:00100000:0.0:1782758730.157571:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735296 00000100:00100000:0.0:1782758730.157635:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1782758730.157646:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758730.157697:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758730.157766:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758730.157774:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1782758730.158302:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211735296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758730.320447:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758730.799014:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758730.799025:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758730.799030:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758730.799095:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799110:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799124:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758730.799156:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211735424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758730.799247:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758730.799310:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758730.799334:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735424 00000100:00100000:0.0:1782758730.799343:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735424 00000100:00100000:0.0:1782758730.799418:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:0.0:1782758730.799429:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211735424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758730.799445:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758730.799459:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc304 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799485:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799510:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799521:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50400, rc 0) 00000100:00100000:0.0:1782758730.799560:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211735424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758730.799578:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:0.0:1782758730.799643:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211735424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758730.799660:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799670:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758730.799689:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758730.799694:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758730.799701:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758731.373295:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758732.396401:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758732.727122:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211735552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758732.727200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758732.727697:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735552 00000100:00100000:0.0:1782758732.727706:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735552 00000100:00100000:0.0:1782758732.727782:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1782758732.727793:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211735552:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758732.727850:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782758732.727851:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758732.728381:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211735552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 572us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758732.728390:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1782758732.729354:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211735552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758733.425570:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758734.009897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758734.010160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758734.010186:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888832 00000100:00100000:3.0:1782758734.010197:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888832 00000100:00100000:3.0:1782758734.010257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1513 00000100:00100000:3.0:1782758734.010267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758734.010360:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2361:x1869355196888832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758734.010367:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1513 00000100:00100000:0.0:1782758734.012206:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196888960 00000100:00100000:0.0:1782758734.012219:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196888960 00000100:00100000:0.0:1782758734.012299:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2017 00000100:00100000:0.0:1782758734.012310:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782758734.012384:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758734.012537:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2361:x1869355196888960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 227us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758734.012545:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2017 00010000:00010000:3.0:1782758734.454978:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758734.764360:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758734.764431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758734.764494:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758734.764501:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211735936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758734.764526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758734.764615:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211735808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.764645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758734.764678:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211736320:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.764701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758734.764720:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782758734.764726:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211735680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.764753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758734.764776:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211736192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.764795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758734.764845:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736064 00000100:00100000:2.0:1782758734.764853:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736064 00000100:00100000:2.0:1782758734.764901:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736320 00000100:00100000:2.0:1782758734.764904:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736320 00000100:00100000:2.0:1782758734.764927:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1782758734.764936:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.764987:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736064:12345-0@lo:400:kworker.0 Request processed in 53us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.764994:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1782758734.765008:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1782758734.765013:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211736320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765043:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211736320:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.765048:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1782758734.765063:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735936 00000100:00100000:2.0:1782758734.765066:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735936 00000100:00100000:2.0:1782758734.765086:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735808 00000100:00100000:2.0:1782758734.765088:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735808 00000100:00100000:2.0:1782758734.765099:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736192 00000100:00100000:2.0:1782758734.765101:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736192 00000100:00100000:2.0:1782758734.765111:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1782758734.765115:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211735936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765139:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211735936:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.765144:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1782758734.765160:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1782758734.765164:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211735808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765186:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211735808:12345-0@lo:400:kworker.0 Request processed in 22us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.765194:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1782758734.765203:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1782758734.765207:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211736192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765228:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211736192:12345-0@lo:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.765240:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1782758734.765261:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211735680 00000100:00100000:2.0:1782758734.765264:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211735680 00000100:00100000:2.0:1782758734.765283:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1782758734.765288:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211735680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765316:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211735680:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758734.765322:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1782758734.765392:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211735680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765405:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211736192:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765414:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211735808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765423:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211736320:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765457:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211735936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758734.765466:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736064:0@lo:400:kworker.0 00000100:00080000:3.0:1782758734.765798:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758734.765804:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758734.765806:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758735.277062:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758735.277087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758735.277154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758735.277228:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736448 00000100:00100000:0.0:1782758735.277244:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736448 00000100:00100000:0.0:1782758735.277287:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1782758735.277296:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758735.277350:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758735.277394:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758735.277400:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1782758735.277456:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758735.469862:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758736.500567:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758737.517855:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758737.840978:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758737.841049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758737.841117:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736576 00000100:00100000:1.0:1782758737.841125:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736576 00000100:00100000:1.0:1782758737.841174:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1782758737.841183:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758737.841220:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758737.841264:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211736576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758737.841290:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1782758737.841342:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211736576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758737.843901:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758738.541936:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758739.129967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758739.130121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758739.130299:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889216 00000100:00100000:0.0:1782758739.130310:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889216 00000100:00100000:0.0:1782758739.130404:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2021 00000100:00100000:0.0:1782758739.130414:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196889216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758739.130499:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196889216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758739.130507:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2021 00000100:00100000:3.0:1782758739.130509:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889088 00000100:00100000:3.0:1782758739.130513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889088 00000100:00100000:3.0:1782758739.130542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00100000:3.0:1782758739.130550:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196889088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758739.130587:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196889088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758739.130594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1515 00000100:00080000:1.0:1782758739.130640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758739.564039:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758739.886322:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737088:0@lo:400:kworker.0 00000100:00100000:1.0:1782758739.886400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758739.886461:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758739.886467:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211736960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758739.886492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758739.886710:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211736832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.886754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758739.886782:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211737344:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.886806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758739.886848:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782758739.886855:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211736704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.886885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758739.886905:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211737216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.886926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758739.886960:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737088 00000100:00100000:2.0:1782758739.886969:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737088 00000100:00100000:2.0:1782758739.887028:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737344 00000100:00100000:2.0:1782758739.887031:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737344 00000100:00100000:2.0:1782758739.887057:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:2.0:1782758739.887066:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887140:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737088:12345-0@lo:400:kworker.0 Request processed in 74us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758739.887147:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00100000:2.0:1782758739.887164:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1782758739.887170:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211737344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887203:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211737344:12345-0@lo:400:kworker.0 Request processed in 33us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758739.887208:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1782758739.887227:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736960 00000100:00100000:2.0:1782758739.887230:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736960 00000100:00100000:2.0:1782758739.887311:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736832 00000100:00100000:2.0:1782758739.887315:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736832 00000100:00100000:2.0:1782758739.887332:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737216 00000100:00100000:2.0:1782758739.887335:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737216 00000100:00100000:2.0:1782758739.887350:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1782758739.887357:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887390:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211736960:12345-0@lo:400:kworker.0 Request processed in 33us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758739.887397:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1782758739.887410:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1782758739.887416:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211736832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887442:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211736832:12345-0@lo:400:kworker.0 Request processed in 27us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758739.887448:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1782758739.887459:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1782758739.887466:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211737216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887490:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211737216:12345-0@lo:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758739.887496:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1782758739.887542:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211737216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887555:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211736832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758739.887564:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211737344:0@lo:400:kworker.0 00000100:00100000:1.0:1782758739.887865:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211736704 00000100:00100000:1.0:1782758739.887870:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211736704 00000100:00100000:1.0:1782758739.887909:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782758739.887916:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758739.887959:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211736704:12345-0@lo:400:kworker.0 Request processed in 43us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758739.887966:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782758739.888012:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211736960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758739.888023:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737088:0@lo:400:kworker.0 00000100:00080000:1.0:1782758739.888046:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758739.888051:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758739.888053:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758739.888128:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211736704:0@lo:400:kworker.0 00000100:00100000:1.0:1782758740.399837:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758740.399859:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758740.399924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758740.399984:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737472 00000100:00100000:1.0:1782758740.399990:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737472 00000100:00100000:1.0:1782758740.400029:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1782758740.400037:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758740.400072:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758740.400109:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758740.400116:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1782758740.400160:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758740.590083:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758741.613743:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758742.636213:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758742.956903:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758742.956988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758742.958000:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737600 00000100:00100000:1.0:1782758742.958012:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737600 00000100:00100000:1.0:1782758742.958121:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1782758742.958132:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758742.958170:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758742.958243:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211737600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758742.958250:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:2.0:1782758742.958518:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758742.958563:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211737600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758743.662090:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758744.247049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758744.247092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758744.247279:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889472 00000100:00100000:0.0:1782758744.247288:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889472 00000100:00100000:0.0:1782758744.247360:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2025 00000100:00100000:0.0:1782758744.247372:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196889472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758744.247464:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+5:2363:x1869355196889472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758744.247472:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2025 00000100:00100000:3.0:1782758744.247867:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889344 00000100:00100000:3.0:1782758744.247872:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889344 00000100:00100000:3.0:1782758744.247904:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1517 00000100:00100000:3.0:1782758744.247910:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196889344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758744.247943:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196889344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758744.247949:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1517 00000100:00080000:2.0:1782758744.248971:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758744.686381:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782758744.795177:0:103559:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25a: test save and reload nodemap config ========================================================== 14:45:41 (1782758741) 00000100:00100000:0.0:1782758745.005880:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211737856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.009231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758745.009307:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211738368:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.009372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758745.009404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758745.009412:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211737728:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.009441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758745.009904:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737856 00000100:00100000:3.0:1782758745.009913:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737856 00000100:00100000:3.0:1782758745.009992:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1782758745.010002:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758745.010061:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211737856:12345-0@lo:400:kworker.0 Request processed in 61us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758745.010068:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:1.0:1782758745.020053:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.020142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758745.020193:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758745.020200:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211737984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.020231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758745.020282:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738368 00000100:00100000:1.0:1782758745.020290:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738368 00000100:00100000:1.0:1782758745.020342:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738112 00000100:00100000:1.0:1782758745.020346:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738112 00000100:00100000:1.0:1782758745.020371:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:1.0:1782758745.020380:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211738368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.021210:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211738368:12345-0@lo:400:kworker.0 Request processed in 828us (11834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758745.021219:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:1.0:1782758745.021246:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1782758745.021254:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.021303:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738112:12345-0@lo:400:kworker.0 Request processed in 51us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758745.021309:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1782758745.021330:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737984 00000100:00100000:1.0:1782758745.021334:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737984 00000100:00100000:1.0:1782758745.021366:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1782758745.021372:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211737984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.021405:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211737984:12345-0@lo:400:kworker.0 Request processed in 34us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758745.021411:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00080000:1.0:1782758745.021440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782758745.021444:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758745.021446:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758745.028763:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211737984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758745.028784:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738112:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.029288:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211738240:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.029343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758745.029374:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211737856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758745.029387:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211738368:0@lo:400:kworker.0 00000100:00100000:2.0:1782758745.029664:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738240 00000100:00100000:2.0:1782758745.029671:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738240 00000100:00100000:2.0:1782758745.029744:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:2.0:1782758745.029755:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211738240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758745.029810:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211738240:12345-0@lo:400:kworker.0 Request processed in 56us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758745.029817:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00080000:0.0:1782758745.030322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758745.031042:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211738240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.038169:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211737728 00000100:00100000:1.0:1782758745.038183:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211737728 00000100:00100000:1.0:1782758745.038256:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1782758745.038267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211737728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758745.039037:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211737728:12345-0@lo:400:kworker.0 Request processed in 770us (29591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758745.039047:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1782758745.050705:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211737728:0@lo:400:kworker.0 00000100:00100000:2.0:1782758745.521152:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758745.521177:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758745.521248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758745.521450:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738496 00000100:00100000:1.0:1782758745.521459:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738496 00000100:00100000:1.0:1782758745.521515:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1782758745.521525:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758745.521561:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758745.521614:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758745.521622:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1782758745.521865:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758745.712729:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758746.732385:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758747.427131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758747.427298:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889600 00000100:00100000:0.0:1782758747.427309:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889600 00000100:00100000:0.0:1782758747.427401:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1260 00000100:00100000:0.0:1782758747.427411:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+5:62089:x1869355196889600:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:0.0:1782758747.427430:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758747.427452:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dc312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f68 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427517:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427530:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427542:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782758747.427719:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782758747.427723:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782758747.427820:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427897:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dc312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f68 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427912:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f68 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758747.427921:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70700) 00010000:00010000:0.0:1782758747.427923:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758747.427927:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00080000:1.0:1782758747.427935:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758747.427998:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7285eadf-a700-4e2b-8948-9c4e88301f08+6:62089:x1869355196889600:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 588us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758747.428005:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1260 00010000:00010000:3.0:1782758747.759212:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758748.081437:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758748.081524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758748.085433:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738624 00000100:00100000:1.0:1782758748.085447:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738624 00000100:00100000:1.0:1782758748.085528:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1782758748.085538:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758748.085589:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758748.085671:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211738624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758748.085678:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:3.0:1782758748.085910:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758748.086378:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211738624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758748.780323:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758749.202317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758749.202363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758749.202418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758749.202452:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889728 00000100:00100000:3.0:1782758749.202462:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889728 00000100:00100000:1.0:1782758749.202478:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889984 00000100:00100000:1.0:1782758749.202483:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889984 00000100:00100000:2.0:1782758749.203119:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196889856 00000100:00100000:2.0:1782758749.203125:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196889856 00000100:00100000:1.0:1782758749.205509:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1782758749.205896:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+12:2363:x1869355196889728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758749.205915:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758749.206008:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171814a8200/0xdd99f5c4777d5c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf63ec1 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758749.206024:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758749.206081:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1782758749.206094:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+11:2363:x1869355196889984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782758749.206104:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+11:2363:x1869355196889728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 214us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758749.206112:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1782758749.206133:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1782758749.206139:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+10:2363:x1869355196889856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758749.206147:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758749.206156:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917193146600/0xdd99f5c4777d5c5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf63e89 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758749.206165:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758749.206178:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+9:2363:x1869355196889856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758749.206184:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00010000:00010000:3.0:1782758749.208611:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758749.208650:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695a00/0xdd99f5c4777d5d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf63ed6 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758749.208669:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758749.208768:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+7:2363:x1869355196889984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2668us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758749.208779:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1782758749.267159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758749.269158:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196890240 00000100:00100000:0.0:1782758749.269172:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196890240 00000100:00080000:3.0:1782758749.269252:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758749.269277:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1261 00000100:00100000:0.0:1782758749.269289:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+6:2360:x1869355196890240:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782758749.269359:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d5c6c 00000020:00010000:0.0:1782758749.269368:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91708243f000: total 0 00000100:00080000:0.0:1782758749.269372:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917186a5b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758749.269403:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967783 00000020:00010000:1.0:1782758749.269474:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91708243f000: total 0 00010000:00010000:1.0:1782758749.269518:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758749.269549:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70700) 00010000:00010000:1.0:1782758749.269553:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758749.269562:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f68 expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758749.269605:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243f000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782758749.269616:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758749.269618:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758749.269620:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758749.272588:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7285eadf-a700-4e2b-8948-9c4e88301f08+3:2360:x1869355196890240:12345-192.168.204.31@tcp:39:umount.0 Request processed in 3289us (5428us total) trans 4294967784 rc 0/0 00000100:00100000:0.0:1782758749.272603:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1261 00000100:00100000:1.0:1782758749.326218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758749.326759:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196890496 00000100:00100000:0.0:1782758749.326773:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196890496 00000100:00100000:0.0:1782758749.326877:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000100:00100000:0.0:1782758749.326888:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+7:2360:x1869355196890496:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1782758749.326948:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777d5c49 00000020:00010000:0.0:1782758749.326956:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917186a5a000: total 0 00000100:00080000:0.0:1782758749.326962:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917186a59000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782758749.327041:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf+3:2360:x1869355196890496:12345-192.168.204.31@tcp:251:umount.0 Request processed in 154us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758749.327058:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1519 00000020:00010000:1.0:1782758749.327237:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917186a5a000: total 0 00010000:00010000:1.0:1782758749.327284:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917186a5a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758749.327331:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171814a8000/0xdd99f5c4777d5c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf63ec8 expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758749.327346:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917186a5a000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782758749.327662:0:5788:0:(genops.c:906:class_export_put()) final put ffff917186a5a000/b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf 00010000:00010000:1.0:1782758749.327681:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758749.327684:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758749.327686:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758749.327726:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff917186a5a000/b3e3b3da-dde1-4526-9a1c-6b9df15a0dcf for MGS 00000020:00000080:0.0:1782758749.329238:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917186a59000 for MGS 00010000:00010000:0.0:1782758749.807702:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758750.127663:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211738880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.127743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.127811:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211739392:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.127863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.127894:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782758750.127901:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211738752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.127948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.127970:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211739264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.127992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.128020:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211739136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.128072:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758750.128078:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211739008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758750.128127:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739392 00000100:00100000:2.0:1782758750.128134:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739392 00000100:00100000:2.0:1782758750.128182:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739136 00000100:00100000:2.0:1782758750.128186:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739136 00000100:00100000:2.0:1782758750.128207:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1782758750.128215:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211739392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128266:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211739392:12345-0@lo:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128273:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1782758750.128288:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:2.0:1782758750.128294:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211739136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128339:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211739136:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128345:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:2.0:1782758750.128362:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738752 00000100:00100000:2.0:1782758750.128366:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738752 00000100:00100000:2.0:1782758750.128389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:2.0:1782758750.128395:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211738752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128425:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211738752:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128431:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:2.0:1782758750.128458:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211738880 00000100:00100000:2.0:1782758750.128461:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211738880 00000100:00100000:2.0:1782758750.128482:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739264 00000100:00100000:2.0:1782758750.128485:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739264 00000100:00100000:2.0:1782758750.128502:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739008 00000100:00100000:2.0:1782758750.128505:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739008 00000100:00100000:2.0:1782758750.128520:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1782758750.128525:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211738880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128554:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211738880:12345-0@lo:400:kworker.0 Request processed in 29us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128560:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1782758750.128570:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:2.0:1782758750.128575:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211739264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128599:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211739264:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128604:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:2.0:1782758750.128614:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1782758750.128620:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211739008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128643:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211739008:12345-0@lo:400:kworker.0 Request processed in 24us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758750.128649:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1782758750.128724:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211739008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128736:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211739136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128770:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211738752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128780:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211739264:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128788:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211738880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758750.128797:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211739392:0@lo:400:kworker.0 00000100:00080000:3.0:1782758750.132243:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758750.132255:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758750.132258:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758750.637142:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211739520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758750.637215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758750.637331:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739520 00000100:00100000:1.0:1782758750.637339:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739520 00000100:00100000:1.0:1782758750.637401:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1782758750.637410:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211739520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758750.637446:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758750.637492:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211739520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758750.637500:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1782758750.637643:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211739520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758750.842679:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1782758751.401173:0:103608:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1782758751.401179:0:103608:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1782758751.854647:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782758752.849586:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7285eadf-a700-4e2b-8948-9c4e88301f08 00000001:00080000:2.0:1782758752.849607:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967784 is committed 00000020:00000080:2.0:1782758752.849613:0:5824:0:(genops.c:906:class_export_put()) final put ffff91708243f000/7285eadf-a700-4e2b-8948-9c4e88301f08 00000020:00000080:1.0:1782758752.849764:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff91708243f000/7285eadf-a700-4e2b-8948-9c4e88301f08 for lustre-MDT0000 00000020:00000080:1.0:1782758752.849854:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917186a5b800 for lustre-MDT0000 00010000:00010000:1.0:1782758752.878724:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758753.204583:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758753.204605:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211739648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758753.204675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758753.204738:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739648 00000100:00100000:3.0:1782758753.204745:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739648 00000100:00100000:3.0:1782758753.204802:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1782758753.204810:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211739648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758753.204917:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758753.204963:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211739648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758753.204970:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:3.0:1782758753.205004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758753.205039:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211739648:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782758753.228812:0:103658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe65218c00 20000000:00000080:1.0:1782758753.228860:0:103658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbcffc00 uarg=0000000000000000 10000000:01000000:1.0:1782758753.230725:0:103658:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758753.230745:0:103658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.230763:0:103658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.230773:0:103658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.230812:0:103658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.232394:0:103658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 18 pid: 5794 timeout: 2921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758753.232418:0:103658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103658:1869355211739776:0@lo:104: 00000100:00100000:1.0:1782758753.232497:0:103658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758753.232606:0:103658:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758753.242053:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739776 00000100:00100000:3.0:1782758753.242070:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739776 00000100:00100000:0.0:1782758753.242515:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1782758753.242527:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103658:x1869355211739776:12345-0@lo:104: 00010000:00010000:0.0:1782758753.242545:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758753.242663:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758753.242670:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103658:x1869355211739776:12345-0@lo:104: Request processed in 147us (10173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758753.242678:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:3.0:1782758753.242745:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758753.242754:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.242763:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758753.242768:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.242779:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758753.242786:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758753.242794:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1782758753.244563:0:103658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103658:1869355211739776:0@lo:104: 00010000:00010000:1.0:1782758753.244590:0:103658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.245221:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.245231:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758753.245265:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.245273:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc304 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc30b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.245414:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758753.245417:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758753.245419:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758753.245437:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211739904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758753.245514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758753.245991:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211739904 00000100:00100000:3.0:1782758753.245999:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211739904 00010000:00010000:3.0:1782758753.246037:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 2921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758753.246076:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1782758753.246085:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211739904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758753.246098:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758753.246104:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 2921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246217:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 2921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246235:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50400/0xdd99f5c4777dc30b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc304 expref: 19 pid: 5794 timeout: 2921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246248:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246257:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246272:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246280:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246286:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246362:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246369:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758753.246374:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246382:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246395:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758753.246404:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758753.246454:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211739904:12345-0@lo:103:ldlm_bl.0 Request processed in 370us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758753.246462:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1782758753.246501:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211739904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758753.246802:0:103658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.246811:0:103658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758753.246819:0:103658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc320 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758753.901249:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758754.286801:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758754.286811:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758754.286816:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758754.286905:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.286918:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.286930:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758754.286967:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211740032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758754.287045:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758754.287111:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758754.287301:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740032 00000100:00100000:3.0:1782758754.287310:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740032 00000100:00100000:3.0:1782758754.287371:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1782758754.287381:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211740032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758754.287396:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758754.287412:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc327 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758754.287439:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758754.287449:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758754.287458:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758754.287513:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211740032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758754.287521:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1782758754.287882:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211740032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758754.287902:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758754.287911:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758754.287931:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758754.287937:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758754.287944:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.924759:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758754.956779:0:103706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc691511c0 20000000:00000080:1.0:1782758754.956802:0:103706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317f000 uarg=0000000000000000 10000000:01000000:1.0:1782758754.957377:0:103706:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758754.957399:0:103706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.957604:0:103706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.957616:0:103706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.957658:0:103706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.957675:0:103706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 18 pid: 5793 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758754.957693:0:103706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103706:1869355211740160:0@lo:104: 00000100:00100000:1.0:1782758754.957770:0:103706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758754.957916:0:103706:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758754.957975:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740160 00000100:00100000:3.0:1782758754.957985:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740160 00000100:00100000:3.0:1782758754.958104:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1782758754.958116:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103706:x1869355211740160:12345-0@lo:104: 00010000:00010000:3.0:1782758754.958133:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758754.958739:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758754.958750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103706:x1869355211740160:12345-0@lo:104: Request processed in 635us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758754.958913:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1782758754.959021:0:103706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103706:1869355211740160:0@lo:104: 00010000:00010000:1.0:1782758754.959047:0:103706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.959981:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758754.959993:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.960003:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758754.960008:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.960020:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758754.960029:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758754.960035:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758754.960085:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.960092:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758754.960131:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.960139:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc327 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc32e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.960161:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758754.960162:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758754.960164:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758754.960235:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758754.960266:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211740288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758754.960787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758754.961959:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740288 00000100:00100000:2.0:1782758754.961972:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740288 00010000:00010000:2.0:1782758754.962025:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758754.962067:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1782758754.962077:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211740288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758754.962094:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758754.962100:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962113:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962135:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc32e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc327 expref: 19 pid: 5793 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962155:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962170:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962204:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962212:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962219:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962225:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962231:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758754.962235:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962244:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962259:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758754.962273:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758754.962349:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211740288:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758754.962357:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1782758754.962408:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211740288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758754.963209:0:103706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.963224:0:103706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758754.963231:0:103706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc335 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758755.251214:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211740544:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758755.251368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782758755.251376:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211740416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758755.251415:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211740928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758755.251468:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211740672:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758755.251509:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758755.251515:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211740800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758755.251568:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740544 00000100:00100000:2.0:1782758755.251576:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740544 00000100:00100000:2.0:1782758755.251625:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740416 00000100:00100000:2.0:1782758755.251628:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740416 00000100:00100000:2.0:1782758755.251645:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740800 00000100:00100000:2.0:1782758755.251648:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740800 00000100:00100000:2.0:1782758755.251663:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1782758755.251670:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211740544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251721:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211740544:12345-0@lo:400:kworker.0 Request processed in 51us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758755.251728:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1782758755.251744:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1782758755.251748:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211740416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251774:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211740416:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758755.251780:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1782758755.251791:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1782758755.251797:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211740800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251840:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211740800:12345-0@lo:400:kworker.0 Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758755.251846:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1782758755.251867:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740928 00000100:00100000:2.0:1782758755.251870:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740928 00000100:00100000:2.0:1782758755.251891:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211740672 00000100:00100000:2.0:1782758755.251894:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211740672 00000100:00100000:2.0:1782758755.251913:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:2.0:1782758755.251918:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211740928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.251960:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211740928:12345-0@lo:400:kworker.0 Request processed in 42us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758755.251966:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:2.0:1782758755.251977:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:2.0:1782758755.251982:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211740672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.252009:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211740672:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758755.252015:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00080000:2.0:1782758755.252037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758755.252040:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758755.252043:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758755.252075:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211740416:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.252085:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211740928:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.252096:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211740544:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.252128:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211740800:0@lo:400:kworker.0 00000100:00100000:2.0:1782758755.252136:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211740672:0@lo:400:kworker.0 00000100:00100000:0.0:1782758755.758586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758755.758611:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211741056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758755.758683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758755.758766:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741056 00000100:00100000:0.0:1782758755.758774:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741056 00000100:00100000:0.0:1782758755.758850:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1782758755.758860:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211741056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758755.758894:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758755.759742:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211741056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 880us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758755.759751:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1782758755.760938:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211741056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758755.948197:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758756.204463:0:103754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7487c750 20000000:00000080:1.0:1782758756.204481:0:103754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317dc00 uarg=0000000000000000 10000000:01000000:1.0:1782758756.204682:0:103754:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758756.204704:0:103754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204721:0:103754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204732:0:103754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204739:0:103754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204746:0:103754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204752:0:103754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204759:0:103754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758756.204764:0:103754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204772:0:103754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204784:0:103754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204791:0:103754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758756.204797:0:103754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc33c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758756.526395:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758756.526404:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758756.526408:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758756.526454:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758756.526467:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758756.526478:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758756.526504:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211741184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758756.526574:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758756.526625:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171833440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782758756.526810:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741184 00000100:00100000:2.0:1782758756.526818:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741184 00000100:00100000:2.0:1782758756.526900:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:2.0:1782758756.526920:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211741184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758756.526937:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758756.526954:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc343 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758756.526979:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758756.527001:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758756.527010:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695a00, rc 0) 00000100:00100000:2.0:1782758756.527056:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211741184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758756.527062:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:2.0:1782758756.527109:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211741184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758756.527124:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758756.527133:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758756.527155:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758756.527160:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758756.527166:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758756.972862:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758757.728780:0:103802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6fb38f40 20000000:00000080:1.0:1782758757.728795:0:103802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317c400 uarg=0000000000000000 10000000:01000000:1.0:1782758757.729325:0:103802:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758757.729345:0:103802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.729362:0:103802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.729371:0:103802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.729411:0:103802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.729424:0:103802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 18 pid: 5794 timeout: 2926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758757.729439:0:103802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103802:1869355211741312:0@lo:104: 00000100:00100000:1.0:1782758757.729501:0:103802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758757.729791:0:103802:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170824486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758757.729967:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741312 00000100:00100000:0.0:1782758757.729975:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741312 00000100:00100000:0.0:1782758757.730019:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782758757.730027:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103802:x1869355211741312:12345-0@lo:104: 00010000:00010000:0.0:1782758757.730040:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758757.730110:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758757.730116:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103802:x1869355211741312:12345-0@lo:104: Request processed in 90us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758757.730124:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1782758757.730203:0:103802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103802:1869355211741312:0@lo:104: 00010000:00010000:1.0:1782758757.730228:0:103802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.730286:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758757.730293:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.730300:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758757.730312:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.730321:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758757.730328:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758757.730334:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758757.733722:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.733741:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758757.733763:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.733772:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc343 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc34a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758757.733802:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758757.733804:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758757.733806:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758757.734245:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211741440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758757.734323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758757.734447:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741440 00000100:00100000:1.0:1782758757.734455:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741440 00010000:00010000:1.0:1782758757.734491:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 2926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758757.734534:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1782758757.734543:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211741440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758757.734568:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758757.734574:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 2926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734584:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 2926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734599:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc34a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc343 expref: 19 pid: 5794 timeout: 2926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734624:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734632:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734647:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734653:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734659:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734665:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734675:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758757.734680:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734687:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734703:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734713:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758757.734751:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211741440:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758757.734759:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00010000:00010000:1.0:1782758757.734793:0:103802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734801:0:103802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758757.734808:0:103802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777dc351 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758757.736741:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211741440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758757.997335:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758758.319384:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758758.319416:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211741568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758758.319521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758758.319606:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741568 00000100:00100000:0.0:1782758758.319615:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741568 00000100:00100000:0.0:1782758758.319673:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1782758758.319682:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211741568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758758.319725:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758758.319768:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211741568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758758.319776:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:0.0:1782758758.319799:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758758.319863:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211741568:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782758759.003662:0:103850:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde75b7da0 20000000:00000080:0.0:1782758759.003683:0:103850:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081254800 uarg=0000000000000000 10000000:01000000:0.0:1782758759.005994:0:103850:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758759.006027:0:103850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006047:0:103850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006059:0:103850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006066:0:103850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006072:0:103850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006078:0:103850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006085:0:103850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758759.006090:0:103850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006099:0:103850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006115:0:103850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006123:0:103850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.006130:0:103850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc358 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758759.021555:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758759.083994:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758759.084005:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758759.084011:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758759.084071:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.084085:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.084097:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758759.084126:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211741696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758759.084203:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758759.088783:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183344900 going to sleep for 11 seconds 00000100:00100000:1.0:1782758759.095694:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741696 00000100:00100000:1.0:1782758759.095711:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741696 00000100:00100000:1.0:1782758759.096020:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1782758759.096033:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211741696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758759.096052:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758759.096076:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc35f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758759.096106:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758759.096119:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758759.096128:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758759.096266:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211741696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (12061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758759.096274:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1782758759.105261:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211741696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758759.105292:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.105305:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758759.105334:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758759.105340:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758759.105347:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.047384:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758760.052607:0:103899:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd48585fa0 20000000:00000080:3.0:1782758760.052624:0:103899:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7830400 uarg=0000000000000000 10000000:01000000:3.0:1782758760.052807:0:103899:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758760.052826:0:103899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758760.062032:0:103899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758760.062044:0:103899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758760.062106:0:103899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758760.062123:0:103899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 18 pid: 5796 timeout: 2928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758760.062140:0:103899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103899:1869355211741824:0@lo:104: 00000100:00100000:3.0:1782758760.062427:0:103899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758760.062480:0:103899:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183343480 going to sleep for 11 seconds 00000100:00100000:2.0:1782758760.064043:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782758760.064077:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741824 00000100:00100000:2.0:1782758760.064088:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741824 00000100:00100000:2.0:1782758760.064167:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1782758760.064177:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103899:x1869355211741824:12345-0@lo:104: 00010000:00010000:2.0:1782758760.064199:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758760.064306:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758760.064312:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:103899:x1869355211741824:12345-0@lo:104: Request processed in 137us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758760.064320:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782758760.064321:0:103899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103899:1869355211741824:0@lo:104: 00010000:00010000:3.0:1782758760.064348:0:103899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064419:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758760.064426:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064435:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758760.064439:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064448:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758760.064455:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758760.064461:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758760.064504:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064511:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758760.064547:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064554:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51200/0xdd99f5c4777dc35f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc366 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064571:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758760.064572:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758760.064574:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758760.064612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758760.064626:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211741952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758760.064665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.064745:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211741952 00000100:00100000:1.0:1782758760.064749:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211741952 00010000:00010000:1.0:1782758760.064771:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 2928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758760.064799:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1782758760.064807:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211741952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758760.064818:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758760.064867:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 2928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064879:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 2928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064893:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc366 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc35f expref: 19 pid: 5796 timeout: 2928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064906:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064920:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064935:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064942:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064949:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064955:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064961:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758760.064965:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064972:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.064995:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758760.065004:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758760.065056:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211741952:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.065063:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1782758760.065146:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211741952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758760.065210:0:103899:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758760.065218:0:103899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758760.065226:0:103899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc36d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758760.367738:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211742080:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.367898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.367961:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211742592:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.367991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.368018:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758760.368025:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211742464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.368096:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211742336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.368138:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758760.368143:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211742208:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758760.368204:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742080 00000100:00100000:1.0:1782758760.368211:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742080 00000100:00100000:1.0:1782758760.368251:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742464 00000100:00100000:1.0:1782758760.368253:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742464 00000100:00100000:1.0:1782758760.368280:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742208 00000100:00100000:1.0:1782758760.368282:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742208 00000100:00100000:1.0:1782758760.368296:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1782758760.368303:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211742080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368358:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211742080:12345-0@lo:400:kworker.0 Request processed in 55us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.368365:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1782758760.368385:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1782758760.368390:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211742464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368413:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211742464:12345-0@lo:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.368418:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1782758760.368429:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1782758760.368434:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211742208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368459:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211742208:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.368464:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1782758760.368479:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742592 00000100:00100000:1.0:1782758760.368482:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742592 00000100:00100000:1.0:1782758760.368504:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742336 00000100:00100000:1.0:1782758760.368506:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742336 00000100:00100000:1.0:1782758760.368525:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1782758760.368530:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211742592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368557:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211742592:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.368563:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1782758760.368574:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1782758760.368579:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211742336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368604:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211742336:12345-0@lo:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758760.368609:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00080000:1.0:1782758760.368634:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758760.368637:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758760.368640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758760.368676:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211742464:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368687:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211742080:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368696:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211742592:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368727:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211742208:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.368738:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211742336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758760.877066:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211742720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758760.877182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758760.877353:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742720 00000100:00100000:0.0:1782758760.877362:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742720 00000100:00100000:0.0:1782758760.877416:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1782758760.877425:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211742720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758760.877464:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758760.877516:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211742720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758760.877523:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1782758760.877609:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211742720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758761.068407:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758761.643960:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758761.643970:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758761.643974:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758761.644036:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758761.644049:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758761.644067:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758761.644100:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211742848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758761.644297:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758761.644484:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193cd9600 going to sleep for 11 seconds 00000100:00100000:3.0:1782758761.644886:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742848 00000100:00100000:3.0:1782758761.644894:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742848 00000100:00100000:3.0:1782758761.645009:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1782758761.645019:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211742848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758761.645037:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758761.645055:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc374 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758761.645080:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758761.645093:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758761.645102:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782758761.645265:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211742848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758761.645273:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1782758761.645374:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211742848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758761.645393:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758761.645403:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758761.645425:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758761.645430:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758761.645438:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758762.093095:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758763.117032:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758763.440709:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758763.440734:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211742976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758763.440854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758763.440894:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211742976 00000100:00100000:0.0:1782758763.440903:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211742976 00000100:00100000:0.0:1782758763.440970:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1782758763.440980:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211742976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758763.441022:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758763.441076:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211742976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758763.441084:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1782758763.441201:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211742976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758763.441252:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782758763.560305:0:104046:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc53293fa0 20000000:00000080:0.0:1782758763.560327:0:104046:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081257400 uarg=0000000000000000 10000000:01000000:0.0:1782758763.561970:0:104046:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758763.562002:0:104046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758763.562025:0:104046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758763.562037:0:104046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758763.567381:0:104046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758763.567422:0:104046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 18 pid: 5793 timeout: 2931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758763.567442:0:104046:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104046:1869355211743104:0@lo:104: 00000100:00100000:0.0:1782758763.567530:0:104046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758763.567590:0:104046:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782758763.569093:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743104 00000100:00100000:2.0:1782758763.569119:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743104 00000100:00100000:2.0:1782758763.569191:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1782758763.569203:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104046:x1869355211743104:12345-0@lo:104: 00010000:00010000:2.0:1782758763.569224:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758763.569328:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758763.569334:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104046:x1869355211743104:12345-0@lo:104: Request processed in 134us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758763.569341:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1782758763.569507:0:104046:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104046:1869355211743104:0@lo:104: 00010000:00010000:0.0:1782758763.569534:0:104046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.569897:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758763.569906:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.569916:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758763.569921:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.569931:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758763.569938:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758763.569945:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758763.570038:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570046:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758763.570083:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570090:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc374 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc37b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570107:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758763.570109:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758763.570110:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758763.570181:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758763.570200:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211743232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758763.570256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758763.570460:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743232 00000100:00100000:1.0:1782758763.570467:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743232 00010000:00010000:1.0:1782758763.570686:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 2931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758763.570725:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1782758763.570735:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211743232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758763.570748:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758763.570754:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 2931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570764:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 2931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570791:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc37b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc374 expref: 19 pid: 5793 timeout: 2931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570805:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570813:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570857:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570865:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570871:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570877:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570883:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758763.570887:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570895:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570918:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758763.570928:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758763.570973:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211743232:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758763.570981:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1782758763.571024:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211743232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758763.571090:0:104046:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758763.571110:0:104046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758763.571117:0:104046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dc382 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758764.140078:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758764.509056:0:104094:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff55ae5af0 20000000:00000080:0.0:1782758764.509164:0:104094:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081254c00 uarg=0000000000000000 10000000:01000000:0.0:1782758764.509423:0:104094:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758764.509451:0:104094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509470:0:104094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509483:0:104094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509492:0:104094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509500:0:104094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509507:0:104094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509514:0:104094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758764.509519:0:104094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509530:0:104094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509545:0:104094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509553:0:104094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758764.509564:0:104094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc389 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758765.165294:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758765.491311:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211743744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.491478:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211743488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.491559:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211744000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.491614:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758765.491620:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211743616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.491675:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743744 00000100:00100000:0.0:1782758765.491682:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743744 00000100:00100000:0.0:1782758765.491748:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744000 00000100:00100000:0.0:1782758765.491751:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744000 00000100:00100000:0.0:1782758765.491778:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1782758765.491788:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491858:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211743744:12345-0@lo:400:kworker.0 Request processed in 72us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758765.491866:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1782758765.491881:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1782758765.491887:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211744000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.491919:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211744000:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758765.491928:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1782758765.492038:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211743360:0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758765.492121:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211743872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492143:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782758765.492170:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758765.492173:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758765.492182:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743360 00000100:00100000:3.0:1782758765.492185:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743360 00000100:00100000:3.0:1782758765.492214:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1782758765.492220:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211743360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492253:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211743360:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758765.492259:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1782758765.492289:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743488 00000100:00100000:3.0:1782758765.492292:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743488 00000100:00100000:3.0:1782758765.492316:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743616 00000100:00100000:3.0:1782758765.492319:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743616 00000100:00100000:3.0:1782758765.492339:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211743872 00000100:00100000:3.0:1782758765.492341:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211743872 00000100:00100000:3.0:1782758765.492355:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1782758765.492360:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211743488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492392:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211743488:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758765.492398:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1782758765.492411:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:3.0:1782758765.492417:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492444:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211743616:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758765.492450:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:3.0:1782758765.492463:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1782758765.492469:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492494:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211743872:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758765.492500:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00080000:3.0:1782758765.492522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758765.492551:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211743360:0@lo:400:kworker.0 00000100:00100000:3.0:1782758765.492564:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211743872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.492750:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211743744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.492780:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211743616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.492789:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211743488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758765.492798:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211744000:0@lo:400:kworker.0 10000000:01000000:0.0:1782758765.550442:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758765.550451:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758765.550456:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758765.550508:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758765.550520:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758765.550531:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758765.550554:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211744128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758765.550626:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.550700:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758765.550783:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744128 00000100:00100000:1.0:1782758765.550791:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744128 00000100:00100000:1.0:1782758765.550863:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:1.0:1782758765.550871:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211744128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758765.550884:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758765.550899:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc390 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758765.550924:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758765.550935:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758765.550943:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782758765.550996:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211744128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758765.551004:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1782758765.551571:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211744128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758765.551593:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758765.551604:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758765.551632:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758765.551638:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758765.551645:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758765.996271:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758765.996300:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758765.996386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758765.996932:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744256 00000100:00100000:0.0:1782758765.996942:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744256 00000100:00100000:0.0:1782758765.997011:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1782758765.997022:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211744256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758765.997246:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758765.997318:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211744256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758765.997327:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1782758765.997878:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211744256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758766.195550:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758767.215359:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758768.236536:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758768.556241:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758768.558342:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211744384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758768.558448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758768.558590:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744384 00000100:00100000:0.0:1782758768.558599:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744384 00000100:00100000:0.0:1782758768.558688:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1782758768.558699:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211744384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758768.558750:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758768.558803:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211744384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758768.558810:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:3.0:1782758768.559237:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758768.559544:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211744384:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782758768.807302:0:104292:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc859e1b60 20000000:00000080:3.0:1782758768.807325:0:104292:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7830800 uarg=0000000000000000 10000000:01000000:3.0:1782758768.810003:0:104292:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758768.810035:0:104292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758768.810054:0:104292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758768.810065:0:104292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758768.810118:0:104292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758768.810135:0:104292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 18 pid: 5793 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758768.810153:0:104292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104292:1869355211744512:0@lo:104: 00000100:00100000:3.0:1782758768.810224:0:104292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758768.810334:0:104292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758768.812038:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744512 00000100:00100000:0.0:1782758768.812052:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744512 00000100:00100000:1.0:1782758768.812170:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1782758768.812181:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104292:x1869355211744512:12345-0@lo:104: 00010000:00010000:1.0:1782758768.812199:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812297:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758768.812305:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104292:x1869355211744512:12345-0@lo:104: Request processed in 126us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758768.812312:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00010000:00010000:1.0:1782758768.812337:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758768.812343:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812352:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758768.812357:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812366:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758768.812373:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758768.812379:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758768.812413:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812419:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758768.812439:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812447:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc390 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc397 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812463:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758768.812465:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758768.812466:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758768.812486:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211744640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758768.812521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758768.812567:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744640 00000100:00100000:1.0:1782758768.812571:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744640 00010000:00010000:1.0:1782758768.812587:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 19 pid: 5793 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758768.812610:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1782758768.812615:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211744640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758768.812625:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758768.812631:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 19 pid: 5793 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812641:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 19 pid: 5793 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812659:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812679:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812693:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812701:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812708:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812719:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812724:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758768.812729:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812735:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812743:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758768.812751:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758768.812774:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211744640:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758768.812780:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1782758768.812814:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211744640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758768.812950:0:104292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc397 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc390 expref: 18 pid: 5793 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758768.812967:0:104292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104292:1869355211744512:0@lo:104: 00010000:00010000:0.0:1782758768.812983:0:104292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758768.812992:0:104292:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758768.812998:0:104292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758768.813005:0:104292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc39e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758769.264114:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758769.901031:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758769.901041:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758769.901048:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758769.901112:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758769.901126:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758769.901139:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758769.901175:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211744768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758769.901261:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758769.901495:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758769.901673:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744768 00000100:00100000:3.0:1782758769.901682:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744768 00000100:00100000:3.0:1782758769.901747:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1782758769.901759:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211744768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758769.901778:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758769.901796:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc3a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758769.901848:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758769.901860:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758769.901872:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782758769.901946:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211744768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758769.901952:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1782758769.906484:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211744768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758769.906517:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758769.906530:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758769.906557:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758769.906563:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758769.906570:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758770.284307:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758770.610416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211745152:0@lo:400:kworker.0 00000100:00100000:0.0:1782758770.610515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758770.610587:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758770.610593:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211745280:0@lo:400:kworker.0 00000100:00100000:0.0:1782758770.610620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758770.610670:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745152 00000100:00100000:0.0:1782758770.610677:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745152 00000100:00100000:0.0:1782758770.610736:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1782758770.610746:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211745152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758770.610804:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211745152:12345-0@lo:400:kworker.0 Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758770.610811:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1782758770.610884:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745280 00000100:00100000:0.0:1782758770.610888:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745280 00000100:00100000:0.0:1782758770.610917:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1782758770.610923:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211745280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611108:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211744896:0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.611200:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211745024:0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758770.611287:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211745408:0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758770.611340:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211744896 00000100:00100000:3.0:1782758770.611344:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211744896 00000100:00100000:3.0:1782758770.611371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:3.0:1782758770.611377:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211744896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611411:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211744896:12345-0@lo:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758770.611419:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:3.0:1782758770.611448:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745408 00000100:00100000:3.0:1782758770.611451:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745408 00000100:00100000:3.0:1782758770.611477:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:3.0:1782758770.611483:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611513:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211745408:12345-0@lo:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758770.611519:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:3.0:1782758770.611554:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211744896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758770.611568:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211745408:0@lo:400:kworker.0 00000100:00100000:0.0:1782758770.616572:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211745280:12345-0@lo:400:kworker.0 Request processed in 5633us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758770.616591:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00080000:0.0:1782758770.616643:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758770.616650:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758770.616717:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211745280:0@lo:400:kworker.0 00000100:00100000:0.0:1782758770.616732:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211745152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.617145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758770.617190:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211745536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.617232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758770.617269:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745024 00000100:00100000:2.0:1782758770.617276:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745024 00000100:00100000:2.0:1782758770.617319:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1782758770.617328:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211745024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.617391:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211745024:12345-0@lo:400:kworker.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758770.617398:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1782758770.617419:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745536 00000100:00100000:2.0:1782758770.617424:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745536 00000100:00100000:2.0:1782758770.617462:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1782758770.617469:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.617501:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211745536:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758770.617509:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1782758770.617537:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211745024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758770.617547:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211745536:0@lo:400:kworker.0 00000100:00080000:2.0:1782758770.617564:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758771.120327:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211745664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758771.120415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758771.122346:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745664 00000100:00100000:0.0:1782758771.122363:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745664 00000100:00100000:0.0:1782758771.122549:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1782758771.122561:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211745664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758771.122606:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758771.131125:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211745664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8555us (10698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758771.131141:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1782758771.136873:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211745664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758771.310556:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758772.338561:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758773.357362:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758773.387778:0:104488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd226f510 20000000:00000080:2.0:1782758773.387805:0:104488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b58c00 uarg=0000000000000000 10000000:01000000:2.0:1782758773.389205:0:104488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758773.389230:0:104488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.389249:0:104488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.389260:0:104488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.389310:0:104488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.389329:0:104488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 18 pid: 5794 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758773.389348:0:104488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104488:1869355211745792:0@lo:104: 00000100:00100000:2.0:1782758773.389414:0:104488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758773.389602:0:104488:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3600 going to sleep for 11 seconds 00000100:00100000:3.0:1782758773.389732:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745792 00000100:00100000:3.0:1782758773.389740:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745792 00000100:00100000:3.0:1782758773.389799:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1782758773.389810:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104488:x1869355211745792:12345-0@lo:104: 00010000:00010000:3.0:1782758773.389852:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758773.389935:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758773.389942:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104488:x1869355211745792:12345-0@lo:104: Request processed in 135us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758773.389948:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:1.0:1782758773.389975:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758773.389984:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.389993:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758773.389997:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390007:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758773.390015:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758773.390020:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758773.390052:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390058:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758773.390102:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390110:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc3a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3ac expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390133:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758773.390135:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758773.390136:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758773.390144:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758773.390155:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211745920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758773.390201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758773.390302:0:104488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104488:1869355211745792:0@lo:104: 00010000:00010000:2.0:1782758773.390321:0:104488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758773.390598:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211745920 00000100:00100000:1.0:1782758773.390604:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211745920 00010000:00010000:1.0:1782758773.390630:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758773.390663:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1782758773.390670:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211745920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758773.390681:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758773.390688:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390698:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390712:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc3ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc3a5 expref: 19 pid: 5794 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390725:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390737:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390752:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390759:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390766:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390772:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390778:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758773.390782:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390789:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390807:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758773.390816:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782758773.390874:0:104488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.390883:0:104488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758773.390889:0:104488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc3b3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758773.390988:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211745920:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758773.391000:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1782758773.391287:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211745920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758773.681858:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758773.682106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758773.682677:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746048 00000100:00100000:1.0:1782758773.682688:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746048 00000100:00080000:2.0:1782758773.682852:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758773.683023:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1782758773.683036:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758773.683074:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758773.683151:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758773.683159:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1782758773.683403:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211746048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758774.380250:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758774.439230:0:104537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc54d45060 20000000:00000080:2.0:1782758774.439248:0:104537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b59000 uarg=0000000000000000 10000000:01000000:2.0:1782758774.439698:0:104537:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758774.439726:0:104537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439745:0:104537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439759:0:104537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439767:0:104537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439778:0:104537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439786:0:104537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439793:0:104537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758774.439797:0:104537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439806:0:104537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439930:0:104537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439941:0:104537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758774.439948:0:104537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777dc3ba lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758775.342057:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758775.342067:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758775.342071:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758775.342118:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758775.342129:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758775.342140:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758775.342164:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211746176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758775.342235:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758775.342296:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6540 going to sleep for 11 seconds 00000100:00100000:1.0:1782758775.342412:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746176 00000100:00100000:1.0:1782758775.342421:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746176 00000100:00100000:1.0:1782758775.342466:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1782758775.342475:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211746176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758775.342489:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758775.342501:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc3c1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758775.342524:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758775.342535:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758775.342556:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758775.342593:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211746176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758775.342600:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:0.0:1782758775.342713:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211746176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758775.342730:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758775.342739:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758775.342758:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758775.342764:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758775.342772:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758775.405659:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758775.724186:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211746304:0@lo:400:kworker.0 00000100:00100000:2.0:1782758775.724296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758775.724455:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746304 00000100:00100000:3.0:1782758775.724476:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746304 00000100:00100000:3.0:1782758775.724553:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:3.0:1782758775.724566:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211746304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758775.724614:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211746688:0@lo:400:kworker.0 00000100:00100000:0.0:1782758775.724660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758775.724723:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746688 00000100:00100000:0.0:1782758775.724728:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746688 00000100:00100000:0.0:1782758775.724770:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1782758775.724777:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211746688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758775.724815:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211746688:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758775.724841:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00080000:0.0:1782758775.724863:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758775.724900:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211746688:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.726851:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211746432:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758775.727144:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211746944:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758775.727194:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758775.727200:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211746560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758775.727253:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746432 00000100:00100000:1.0:1782758775.727259:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746432 00000100:00100000:1.0:1782758775.727306:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746560 00000100:00100000:1.0:1782758775.727309:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746560 00000100:00100000:1.0:1782758775.727338:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1782758775.727347:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211746432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727680:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211746432:12345-0@lo:400:kworker.0 Request processed in 333us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758775.727689:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1782758775.727712:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1782758775.727719:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211746560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727749:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211746560:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758775.727755:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1782758775.727796:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211746560:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.727807:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211746432:0@lo:400:kworker.0 00000100:00080000:0.0:1782758775.728126:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758775.728136:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758775.728148:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211746816:0@lo:400:kworker.0 00000100:00100000:0.0:1782758775.728181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758775.728217:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746816 00000100:00100000:0.0:1782758775.728222:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746816 00000100:00100000:0.0:1782758775.728258:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1782758775.728265:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211746816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758775.728314:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211746816:12345-0@lo:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758775.728320:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00080000:0.0:1782758775.728336:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758775.728352:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211746816:0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.728732:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211746944 00000100:00100000:1.0:1782758775.728737:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211746944 00000100:00100000:1.0:1782758775.728767:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:1.0:1782758775.728773:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211746944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758775.728810:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211746944:12345-0@lo:400:kworker.0 Request processed in 37us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758775.728816:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:1.0:1782758775.728860:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211746944:0@lo:400:kworker.0 00000100:00080000:0.0:1782758775.729650:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758775.730384:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211746304:12345-0@lo:400:kworker.0 Request processed in 5815us (6081us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758775.730400:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1782758775.731770:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211746304:0@lo:400:kworker.0 00000100:00100000:1.0:1782758776.236609:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758776.236634:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211747072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758776.236700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758776.236767:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747072 00000100:00100000:1.0:1782758776.236775:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747072 00000100:00100000:1.0:1782758776.236843:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1782758776.236852:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211747072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758776.236888:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758776.237009:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211747072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758776.237166:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1782758776.237217:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211747072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758776.429308:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758777.452542:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758778.476089:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758778.543874:0:104733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbe601790 20000000:00000080:0.0:1782758778.543893:0:104733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081254c00 uarg=0000000000000000 10000000:01000000:0.0:1782758778.544466:0:104733:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758778.545129:0:104733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758778.545150:0:104733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758778.545160:0:104733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758778.545199:0:104733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758778.545213:0:104733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 18 pid: 5793 timeout: 2946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758778.545226:0:104733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104733:1869355211747200:0@lo:104: 00000100:00100000:0.0:1782758778.545287:0:104733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758778.545342:0:104733:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758778.545433:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747200 00000100:00100000:3.0:1782758778.545440:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747200 00000100:00100000:3.0:1782758778.545518:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1782758778.545528:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104733:x1869355211747200:12345-0@lo:104: 00010000:00010000:3.0:1782758778.545540:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545612:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758778.545618:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104733:x1869355211747200:12345-0@lo:104: Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758778.545629:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00010000:00010000:3.0:1782758778.545653:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758778.545657:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545665:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758778.545668:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545677:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758778.545684:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758778.545690:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758778.545717:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545723:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758778.545742:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545748:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50e00/0xdd99f5c4777dc3c1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.545762:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758778.545763:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758778.545765:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758778.545783:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211747328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758778.545810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758778.546065:0:104733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104733:1869355211747200:0@lo:104: 00010000:00010000:2.0:1782758778.546083:0:104733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758778.546189:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747328 00000100:00100000:3.0:1782758778.546194:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747328 00010000:00010000:3.0:1782758778.546213:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 2946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758778.546242:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1782758778.546249:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211747328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758778.546258:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758778.546263:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 2946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546273:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 2946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546286:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc3c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc3c1 expref: 19 pid: 5793 timeout: 2946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546298:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546306:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546319:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546326:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546332:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546339:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546344:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758778.546348:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546355:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546366:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758778.546375:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758778.546405:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211747328:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758778.546412:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1782758778.546437:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211747328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758778.546508:0:104733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758778.546515:0:104733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758778.546521:0:104733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc3cf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758778.797555:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211747456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758778.797621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758778.798032:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747456 00000100:00100000:3.0:1782758778.798041:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747456 00000100:00100000:3.0:1782758778.798101:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1782758778.798111:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211747456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758778.798144:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758778.798196:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211747456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758778.798207:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00080000:3.0:1782758778.798228:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758778.798281:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211747456:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782758779.440356:0:104781:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd48d6ae70 20000000:00000080:3.0:1782758779.440374:0:104781:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171b7833000 uarg=0000000000000000 20000000:01000000:3.0:1782758779.440410:0:104781:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='nodemap..fileset=/c0dir' 20000000:01000000:3.0:1782758779.440492:0:104781:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'nodemap..fileset=/c0dir' 20000000:01000000:3.0:1782758779.440497:0:104781:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/nodemap..fileset=/c0dir del=0 00000040:00080000:1.0:1782758779.442379:0:104782:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1782758779.442649:0:104781:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.nodemap..fileset=/c0dir in log params 00000040:00080000:3.0:1782758779.453765:0:104781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1782758779.454153:0:104781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 112 off9648 00000040:00080000:3.0:1782758779.454229:0:104781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9872 10000000:01000000:3.0:1782758779.454249:0:104781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782758779.454339:0:104781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454360:0:104781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454368:0:104781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454374:0:104781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454382:0:104781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454432:0:104781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454453:0:104781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 17 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758779.454478:0:104781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747584:0@lo:104: 00000100:00100000:3.0:1782758779.454541:0:104781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782758779.454603:0:104781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454611:0:104781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 17 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758779.454619:0:104781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747712:0@lo:104: 00000100:00100000:3.0:1782758779.454640:0:104781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782758779.454664:0:104781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.454673:0:104781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 17 pid: 5796 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758779.454681:0:104781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747840:0@lo:104: 00000100:00100000:3.0:1782758779.454704:0:104781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758779.454717:0:104781:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758779.454974:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782758779.454987:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747584 00000100:00100000:2.0:1782758779.454994:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747584 00000100:00100000:2.0:1782758779.455028:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747712 00000100:00100000:2.0:1782758779.455030:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747712 00000100:00100000:2.0:1782758779.455039:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747840 00000100:00100000:2.0:1782758779.455041:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747840 00000100:00100000:2.0:1782758779.455055:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1782758779.455064:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:104781:x1869355211747584:12345-0@lo:104: 00010000:00010000:2.0:1782758779.455077:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455135:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758779.455140:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:104781:x1869355211747584:12345-0@lo:104: Request processed in 78us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.455147:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1782758779.455175:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1782758779.455182:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:104781:x1869355211747712:12345-0@lo:104: 00010000:00010000:2.0:1782758779.455189:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455216:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782758779.455219:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:104781:x1869355211747712:12345-0@lo:104: Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.455223:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1782758779.455231:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1782758779.455234:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917185b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104781:x1869355211747840:12345-0@lo:104: 00010000:00010000:2.0:1782758779.455239:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455256:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782758779.455259:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917185b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:104781:x1869355211747840:12345-0@lo:104: Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.455262:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:2.0:1782758779.455372:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782758779.455377:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455382:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758779.455385:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455390:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758779.455394:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758779.455398:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782758779.455421:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455427:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758779.455444:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455451:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777d5d68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455475:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782758779.455479:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455485:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758779.455488:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455494:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758779.455500:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758779.455505:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782758779.455517:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455523:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758779.455529:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455540:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777d5d5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d61 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455550:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758779.455552:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455558:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758779.455560:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455566:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758779.455572:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758779.455577:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782758779.455587:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455593:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758779.455607:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455614:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4000/0xdd99f5c4777d5d4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5d53 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.455625:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758779.455627:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758779.455629:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758779.455636:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758779.455641:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758779.455659:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211747968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758779.455689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758779.455718:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758779.455724:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211748096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758779.455743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758779.455765:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211748224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758779.455797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758779.455970:0:104781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747584:0@lo:104: 00000100:00100000:3.0:1782758779.455980:0:104781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747712:0@lo:104: 00000100:00100000:3.0:1782758779.455987:0:104781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104781:1869355211747840:0@lo:104: 00010000:00010000:3.0:1782758779.456014:0:104781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758779.456623:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211747968 00000100:00100000:2.0:1782758779.456631:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211747968 00010000:00010000:2.0:1782758779.456660:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 18 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758779.456694:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748096 00000100:00100000:2.0:1782758779.456697:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748096 00010000:00010000:2.0:1782758779.456709:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 19 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758779.456720:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748224 00000100:00100000:2.0:1782758779.456723:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748224 00010000:00010000:2.0:1782758779.456733:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 20 pid: 5796 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758779.456745:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1782758779.456751:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3307:x1869355211747968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758779.456763:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758779.456769:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 20 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456778:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 20 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456793:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777d5d6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5d68 expref: 20 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456805:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758779.456900:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211747968:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.456907:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1782758779.456922:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1782758779.456928:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211748096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758779.456936:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758779.456941:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 18 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456949:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 18 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456958:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4e00/0xdd99f5c4777d5d61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5d5a expref: 18 pid: 5794 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.456966:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758779.456986:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3307:x1869355211748096:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.456992:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1782758779.457004:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1782758779.457010:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3305:x1869355211748224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758779.457017:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758779.457021:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 16 pid: 5796 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457029:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 16 pid: 5796 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457038:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691600/0xdd99f5c4777d5d53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5d4c expref: 16 pid: 5796 timeout: 2947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457048:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457056:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457069:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457075:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457080:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457086:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457091:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758779.457095:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457102:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457111:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758779.457130:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758779.457159:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3305:x1869355211748224:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758779.457175:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1782758779.457232:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211748224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758779.457639:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211748096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758779.457648:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211747968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758779.457762:0:104781:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.457772:0:104781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.457786:0:104781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758779.501992:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758780.012351:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782758780.012359:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917183103000 from 7 10000000:01000000:2.0:1782758780.012364:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782758780.012407:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.012420:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.012430:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758780.012467:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.012539:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.012588:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917190899f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758780.012647:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748352 00000100:00100000:3.0:1782758780.012655:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748352 00000100:00100000:3.0:1782758780.012709:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:3.0:1782758780.012718:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211748352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758780.012731:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758780.012745:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc3dd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758780.012766:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758780.012777:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758780.012786:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758780.012842:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.012849:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1782758780.013293:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758780.013309:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.013318:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758780.013382:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.013413:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.013445:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917190899f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758780.013911:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748480 00000100:00100000:3.0:1782758780.013917:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748480 00000100:00100000:3.0:1782758780.013955:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:3.0:1782758780.013963:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758780.014259:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.014266:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1782758780.014402:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.014438:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.014490:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.014518:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917190899f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782758780.015378:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748608 00000100:00100000:3.0:1782758780.015386:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748608 00000100:00100000:3.0:1782758780.015539:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:3.0:1782758780.015550:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782758780.015743:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.015751:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1782758780.016007:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782758780.017755:0:104806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104806:1869355211748736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782758780.017858:0:104806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.017902:0:104806:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901300 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.017960:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748736 00000100:00100000:2.0:1782758780.017966:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748736 00000100:00100000:2.0:1782758780.018011:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1782758780.018019:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:104806:x1869355211748736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.018245:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:104806:x1869355211748736:12345-0@lo:502:llog_process_th.0 Request processed in 226us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.018252:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:0.0:1782758780.018413:0:104806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104806:1869355211748736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782758780.018442:0:104806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782758780.018614:0:104806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782758780.018618:0:104806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:0.0:1782758780.018625:0:104806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff917183103000 00000020:00000080:0.0:1782758780.018628:0:104806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1782758780.022275:0:104806:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 3629us 00000100:00100000:2.0:1782758780.051722:0:104806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104806:1869355211748864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.052349:0:104806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.052442:0:104806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c114600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.052495:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748864 00000100:00100000:0.0:1782758780.052502:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748864 00000100:00100000:0.0:1782758780.052592:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1782758780.052602:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:104806:x1869355211748864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782758780.052865:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:104806:x1869355211748864:12345-0@lo:502:llog_process_th.0 Request processed in 263us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.052873:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:2.0:1782758780.053082:0:104806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104806:1869355211748864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782758780.053115:0:104806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782758780.053122:0:104806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782758780.053125:0:104806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:2.0:1782758780.053132:0:104806:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782758780.053424:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782758780.053461:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782758780.053473:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.053484:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758780.053495:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758780.053497:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758780.053500:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758780.053527:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.053535:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.053548:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758780.053566:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758780.053597:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758780.053661:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.053761:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211748992 00000100:00100000:2.0:1782758780.053978:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211748992 00000100:00100000:2.0:1782758780.054056:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1782758780.054066:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211748992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758780.054079:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758780.054095:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc3eb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.054119:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.054131:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.054140:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782758780.054352:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211748992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.054360:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:1.0:1782758780.054434:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211748992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758780.054458:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758780.054468:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758780.054484:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758780.054488:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758780.054496:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758780.054503:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782758780.054505:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917184fef000 from 7 10000000:01000000:1.0:1782758780.054507:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782758780.054527:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758780.054535:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758780.054542:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758780.054557:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758780.054593:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758780.054631:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.054681:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749120 00000100:00100000:0.0:1782758780.054686:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749120 00000100:00100000:0.0:1782758780.054722:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:0.0:1782758780.054731:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211749120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758780.054738:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758780.054748:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc3f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.054763:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.054790:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758780.054797:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:0.0:1782758780.054860:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.054867:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1782758780.055059:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758780.055077:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758780.055086:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758780.055145:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758780.055191:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758780.055222:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.055366:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749248 00000100:00100000:0.0:1782758780.055372:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749248 00000100:00100000:0.0:1782758780.055408:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:0.0:1782758780.055417:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758780.055671:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.055677:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:0.0:1782758780.055706:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758780.055735:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782758780.055926:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758780.055948:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.055959:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749376 00000100:00100000:0.0:1782758780.055962:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749376 00000100:00100000:0.0:1782758780.055978:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1782758780.055983:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782758780.056118:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.056124:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1782758780.056231:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758780.056764:0:104808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104808:1869355211749504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.057351:0:104808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.057426:0:104808:0:(client.c:2701:ptlrpc_set_wait()) set ffff917187284f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.057468:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749504 00000100:00100000:0.0:1782758780.057473:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749504 00000100:00100000:0.0:1782758780.057539:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1782758780.057548:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:104808:x1869355211749504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782758780.057728:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:104808:x1869355211749504:12345-0@lo:502:llog_process_th.0 Request processed in 180us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.057735:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1782758780.057878:0:104808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104808:1869355211749504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782758780.057906:0:104808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782758780.057917:0:104808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782758780.057919:0:104808:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:2.0:1782758780.057927:0:104808:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff917184fef000 00000020:00000080:2.0:1782758780.057930:0:104808:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1782758780.059430:0:104808:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 1488us 00000100:00100000:0.0:1782758780.059492:0:104808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104808:1869355211749632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782758780.059556:0:104808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758780.059596:0:104808:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.059638:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749632 00000100:00100000:2.0:1782758780.059645:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749632 00000100:00100000:2.0:1782758780.059684:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1782758780.059693:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:104808:x1869355211749632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.059927:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:104808:x1869355211749632:12345-0@lo:502:llog_process_th.0 Request processed in 234us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.059934:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:0.0:1782758780.060139:0:104808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104808:1869355211749632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782758780.060178:0:104808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782758780.060185:0:104808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782758780.060187:0:104808:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1782758780.060191:0:104808:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782758780.060525:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782758780.060549:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782758780.060559:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.060568:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758780.060579:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782758780.060581:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9171932e8800 from 7 10000000:01000000:2.0:1782758780.060583:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782758780.060610:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.060618:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.060626:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758780.060645:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.060681:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.060715:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.060760:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749760 00000100:00100000:0.0:1782758780.060775:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749760 00000100:00100000:2.0:1782758780.061119:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1782758780.061128:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211749760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758780.061140:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758780.061151:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc407 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.061185:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.061195:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.061203:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758780.061235:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211749760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.061240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1782758780.061277:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758780.061290:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.061300:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758780.061355:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.061387:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.061414:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.061428:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211749888 00000100:00100000:2.0:1782758780.061431:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211749888 00000100:00100000:2.0:1782758780.061466:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1782758780.061482:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211749888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.061678:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211749888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.061685:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1782758780.061715:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211749888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.061741:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211750016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.061792:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.061806:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.061816:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750016 00000100:00100000:2.0:1782758780.061843:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750016 00000100:00100000:2.0:1782758780.061861:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:2.0:1782758780.061866:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211750016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.061991:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211750016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.061997:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:2.0:1782758780.062029:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211750016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782758780.062231:0:104810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104810:1869355211750144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.062264:0:104810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758780.062281:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750144 00000100:00100000:2.0:1782758780.062284:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750144 00000100:00100000:2.0:1782758780.062306:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1782758780.062312:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:104810:x1869355211750144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782758780.063427:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:104810:x1869355211750144:12345-0@lo:502:llog_process_th.0 Request processed in 1110us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758780.063437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1782758780.063502:0:104810:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758780.063519:0:104810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104810:1869355211750144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782758780.063551:0:104810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782758780.063561:0:104810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782758780.063564:0:104810:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:2.0:1782758780.063572:0:104810:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9171932e8800 00000020:00000080:2.0:1782758780.063575:0:104810:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1782758780.075642:0:104810:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 12053us 00000100:00100000:0.0:1782758780.075709:0:104810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104810:1869355211750272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782758780.075790:0:104810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758780.075854:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750272 00000100:00100000:0.0:1782758780.075862:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750272 00000100:00100000:0.0:1782758780.075915:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1782758780.075925:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:104810:x1869355211750272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782758780.076239:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:104810:x1869355211750272:12345-0@lo:502:llog_process_th.0 Request processed in 314us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758780.076247:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1782758780.076300:0:104810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171872ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1782758780.076322:0:104810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:104810:1869355211750272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782758780.076351:0:104810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782758780.076358:0:104810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782758780.076360:0:104810:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1782758780.076365:0:104810:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782758780.076445:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782758780.076490:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782758780.076503:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.076514:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758780.525297:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758780.852488:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211750400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.852559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.852608:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211750912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.852635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.852662:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758780.852669:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211750784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.852696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.852732:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750400 00000100:00100000:3.0:1782758780.852739:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750400 00000100:00100000:3.0:1782758780.852783:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1782758780.852792:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211750400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.852866:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211750400:12345-0@lo:400:kworker.0 Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.852874:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1782758780.852905:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750912 00000100:00100000:3.0:1782758780.852909:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750912 00000100:00100000:3.0:1782758780.852941:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:3.0:1782758780.852946:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211750912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.852976:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211750912:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.853056:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00080000:3.0:1782758780.853077:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758780.853101:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211750400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853114:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211750912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853161:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211750656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.853204:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782758780.853210:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211750528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853229:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.853245:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211751040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758780.853305:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750656 00000100:00100000:3.0:1782758780.853309:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750656 00000100:00100000:3.0:1782758780.853336:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750528 00000100:00100000:3.0:1782758780.853339:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750528 00000100:00100000:3.0:1782758780.853355:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1782758780.853360:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211750656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853395:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211750656:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.853402:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1782758780.853414:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1782758780.853419:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211750528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853460:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211750528:12345-0@lo:400:kworker.0 Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.853466:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1782758780.853486:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211750784 00000100:00100000:3.0:1782758780.853489:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211750784 00000100:00100000:3.0:1782758780.853513:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751040 00000100:00100000:3.0:1782758780.853515:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751040 00000100:00100000:3.0:1782758780.853535:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1782758780.853540:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211750784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853574:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211750784:12345-0@lo:400:kworker.0 Request processed in 34us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.853581:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1782758780.853591:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1782758780.853597:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211751040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853625:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211751040:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758780.853632:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00080000:3.0:1782758780.853844:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758780.853848:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758780.853851:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758780.853872:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211750528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853884:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211751040:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853892:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211750656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758780.853919:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211750784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758781.356151:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211751168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758781.356228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758781.356262:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751168 00000100:00100000:0.0:1782758781.356270:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751168 00000100:00100000:0.0:1782758781.356320:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1782758781.356331:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211751168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758781.356368:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758781.356444:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211751168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758781.356452:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1782758781.356494:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211751168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758781.548031:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758782.575352:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758783.596010:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758783.917734:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758783.917843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758783.918090:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751296 00000100:00100000:1.0:1782758783.918098:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751296 00000100:00100000:1.0:1782758783.918169:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1782758783.918179:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211751296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758783.918216:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758783.918269:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211751296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758783.918276:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:3.0:1782758783.918845:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758783.918908:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211751296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758784.620033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782758785.432125:0:105082:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 14:46:23 (1782758783) === 00010000:00010000:0.0:1782758785.644145:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758785.964103:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211751552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758785.964144:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211751424:0@lo:400:kworker.0 00000100:00100000:1.0:1782758785.964238:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211751808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758785.965449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758785.965583:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211752064:0@lo:400:kworker.0 00000100:00100000:2.0:1782758785.965640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758785.965887:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211751680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.965923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758785.965973:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751552 00000100:00100000:3.0:1782758785.965980:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751552 00000100:00100000:3.0:1782758785.966022:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751680 00000100:00100000:3.0:1782758785.966025:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751680 00000100:00100000:3.0:1782758785.966055:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1782758785.966064:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211751552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.966126:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211751552:12345-0@lo:400:kworker.0 Request processed in 61us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758785.966134:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1782758785.966157:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1782758785.966165:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211751552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.966166:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211751680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.966210:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211751680:12345-0@lo:400:kworker.0 Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758785.966218:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00080000:2.0:1782758785.966232:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758785.966244:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752064 00000100:00100000:3.0:1782758785.966249:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752064 00000100:00100000:2.0:1782758785.966267:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211751680:0@lo:400:kworker.0 00000100:00080000:2.0:1782758785.966285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758785.966287:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1782758785.966296:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758785.966441:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211752064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.968163:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211752064:12345-0@lo:400:kworker.0 Request processed in 1854us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758785.968178:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1782758785.971870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758785.971965:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211751936:0@lo:400:kworker.0 00000100:00100000:0.0:1782758785.972034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758785.972040:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751424 00000100:00100000:2.0:1782758785.972049:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751424 00000100:00100000:2.0:1782758785.972097:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:2.0:1782758785.972106:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758785.972176:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211751424:12345-0@lo:400:kworker.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758785.972183:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:0.0:1782758785.972366:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211751424:0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.972419:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751936 00000100:00100000:3.0:1782758785.972424:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751936 00000100:00100000:3.0:1782758785.972481:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1782758785.972488:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.972534:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211751936:12345-0@lo:400:kworker.0 Request processed in 46us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758785.972540:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00080000:2.0:1782758785.972599:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758785.972633:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211751936:0@lo:400:kworker.0 00000100:00100000:1.0:1782758785.972906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758785.973054:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211751808 00000100:00100000:3.0:1782758785.973059:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211751808 00000100:00100000:3.0:1782758785.973106:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1782758785.973113:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211751808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758785.973167:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211751808:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758785.973173:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00080000:2.0:1782758785.973269:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758785.973286:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211751808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758786.476501:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211752192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758786.476570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758786.476781:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752192 00000100:00100000:1.0:1782758786.476788:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752192 00000100:00100000:3.0:1782758786.476950:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1782758786.476963:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211752192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758786.477015:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758786.477072:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211752192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758786.477080:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1782758786.477114:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211752192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758786.667966:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758787.691978:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758788.718219:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758789.037427:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211752320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758789.037510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758789.037582:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752320 00000100:00100000:2.0:1782758789.037602:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752320 00000100:00100000:2.0:1782758789.037659:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1782758789.037668:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211752320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758789.037701:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758789.037746:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211752320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758789.037753:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:2.0:1782758789.037775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758789.037814:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211752320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758789.743198:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758790.765072:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758791.084282:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211752576:0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.084309:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211752704:0@lo:400:kworker.0 00000100:00100000:1.0:1782758791.084410:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211752832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758791.084474:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211752448:0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.084550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758791.084646:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758791.084659:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211753088:0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.084705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758791.084811:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752704 00000100:00100000:0.0:1782758791.084868:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752704 00000100:00100000:0.0:1782758791.085073:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1782758791.085088:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211752704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.085171:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211752704:12345-0@lo:400:kworker.0 Request processed in 87us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758791.085180:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1782758791.085250:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211752704:0@lo:400:kworker.0 00000100:00080000:0.0:1782758791.085290:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758791.085305:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753088 00000100:00100000:0.0:1782758791.085310:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753088 00000100:00100000:0.0:1782758791.085349:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:0.0:1782758791.085356:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211753088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.085398:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211753088:12345-0@lo:400:kworker.0 Request processed in 43us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758791.085405:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00080000:0.0:1782758791.085432:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758791.085451:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211753088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758791.087149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758791.087901:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752576 00000100:00100000:0.0:1782758791.087914:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752576 00000100:00100000:0.0:1782758791.087992:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1782758791.088003:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211752576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.088102:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211752576:12345-0@lo:400:kworker.0 Request processed in 100us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758791.088110:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1782758791.088579:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211752576:0@lo:400:kworker.0 00000100:00100000:1.0:1782758791.090586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758791.091075:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752832 00000100:00100000:3.0:1782758791.091087:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752832 00000100:00100000:3.0:1782758791.091183:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1782758791.091195:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211752832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758791.091299:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211752832:12345-0@lo:400:kworker.0 Request processed in 105us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758791.091309:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00080000:0.0:1782758791.091383:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758791.091724:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211752832:0@lo:400:kworker.0 00000100:00100000:2.0:1782758791.091943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758791.091999:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211752960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758791.092043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758791.092380:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752960 00000100:00100000:0.0:1782758791.092388:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752960 00000100:00100000:0.0:1782758791.092468:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1782758791.092478:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211752960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.092552:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211752960:12345-0@lo:400:kworker.0 Request processed in 76us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758791.092559:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:2.0:1782758791.092652:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211752960:0@lo:400:kworker.0 00000100:00080000:1.0:1782758791.092722:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758791.092866:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211752448 00000100:00100000:3.0:1782758791.092873:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211752448 00000100:00100000:3.0:1782758791.092916:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1782758791.092923:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211752448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758791.092983:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211752448:12345-0@lo:400:kworker.0 Request processed in 61us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758791.092990:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1782758791.093119:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211752448:0@lo:400:kworker.0 00000100:00100000:0.0:1782758791.596449:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211753216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758791.596549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758791.596795:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753216 00000100:00100000:1.0:1782758791.596804:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753216 00000100:00100000:1.0:1782758791.596882:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1782758791.596891:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211753216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758791.596929:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758791.596984:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211753216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758791.596991:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1782758791.597178:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211753216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758791.788310:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758792.812160:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758793.835998:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758794.156086:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758794.156113:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211753344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758794.156212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758794.156373:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753344 00000100:00100000:2.0:1782758794.156383:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753344 00000100:00100000:2.0:1782758794.156455:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1782758794.156478:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211753344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758794.156527:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758794.156581:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211753344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758794.156588:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1782758794.156638:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211753344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758794.156919:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758794.864930:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758795.884949:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758796.209597:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211753472:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.209728:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211753984:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.209779:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758796.209785:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211753856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.209859:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211753728:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.209901:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782758796.209907:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211753600:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.209950:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211754112:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.209972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758796.210006:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753984 00000100:00100000:0.0:1782758796.210014:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753984 00000100:00100000:0.0:1782758796.210061:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753728 00000100:00100000:0.0:1782758796.210064:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753728 00000100:00100000:0.0:1782758796.210081:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753600 00000100:00100000:0.0:1782758796.210083:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753600 00000100:00100000:0.0:1782758796.210097:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1782758796.210106:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210172:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211753984:12345-0@lo:400:kworker.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758796.210179:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1782758796.210194:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1782758796.210199:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211753728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211753728:12345-0@lo:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758796.210234:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1782758796.210245:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1782758796.210251:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210278:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211753600:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758796.210284:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1782758796.210302:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753856 00000100:00100000:0.0:1782758796.210305:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753856 00000100:00100000:0.0:1782758796.210329:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754112 00000100:00100000:0.0:1782758796.210333:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754112 00000100:00100000:0.0:1782758796.210354:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1782758796.210436:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211753856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210472:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211753856:12345-0@lo:400:kworker.0 Request processed in 112us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758796.210478:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1782758796.210488:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1782758796.210496:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211754112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210524:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211754112:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758796.210529:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00080000:0.0:1782758796.210555:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758796.210558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758796.210560:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758796.210597:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211753600:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210607:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211754112:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210616:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211753728:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210648:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211753856:0@lo:400:kworker.0 00000100:00100000:0.0:1782758796.210659:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211753984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758796.210750:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211753472 00000100:00100000:1.0:1782758796.210756:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211753472 00000100:00100000:1.0:1782758796.210793:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1782758796.210800:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211753472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758796.210856:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211753472:12345-0@lo:400:kworker.0 Request processed in 57us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758796.210862:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1782758796.216367:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211753472:0@lo:400:kworker.0 00000100:00100000:3.0:1782758796.718170:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758796.718198:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211754240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758796.718290:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758796.719216:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754240 00000100:00100000:1.0:1782758796.719227:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754240 00000100:00100000:1.0:1782758796.719287:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1782758796.719297:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211754240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758796.719335:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758796.719600:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211754240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758796.719609:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1782758796.719713:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211754240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758796.908968:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758797.934858:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782758798.277689:0:105490:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing load_modules_local 00010000:00010000:2.0:1782758798.955977:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758799.276062:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211754368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758799.282772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758799.282905:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754368 00000100:00100000:3.0:1782758799.282923:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754368 00000100:00100000:3.0:1782758799.283038:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1782758799.283054:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211754368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758799.283130:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758799.283231:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211754368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758799.283241:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:3.0:1782758799.283281:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758799.283944:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211754368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758799.991015:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758801.006589:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758801.328938:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758801.328965:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211754496:0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758801.329163:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211754880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758801.329230:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754880 00000100:00100000:3.0:1782758801.329239:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754880 00000100:00100000:3.0:1782758801.329315:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:3.0:1782758801.329326:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211754880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329388:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211754880:12345-0@lo:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758801.329395:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00080000:3.0:1782758801.329417:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758801.329452:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211754880:0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329615:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211755008:0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758801.329681:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755008 00000100:00100000:3.0:1782758801.329686:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755008 00000100:00100000:3.0:1782758801.329719:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1782758801.329726:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211755008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758801.329764:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211755008:12345-0@lo:400:kworker.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758801.329771:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00080000:3.0:1782758801.329789:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758801.329805:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211755008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331316:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754496 00000100:00100000:2.0:1782758801.331329:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754496 00000100:00100000:2.0:1782758801.331391:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:2.0:1782758801.331400:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211754496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331484:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211754496:12345-0@lo:400:kworker.0 Request processed in 86us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758801.331491:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:2.0:1782758801.331539:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211754752:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758801.331604:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782758801.331611:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211754624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758801.331651:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211755136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758801.331704:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754752 00000100:00100000:2.0:1782758801.331708:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754752 00000100:00100000:2.0:1782758801.331743:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211754624 00000100:00100000:2.0:1782758801.331746:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211754624 00000100:00100000:2.0:1782758801.331768:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1782758801.331775:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211754752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331818:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211754752:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758801.331871:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1782758801.331884:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1782758801.331890:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.331919:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211754624:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758801.331925:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1782758801.331945:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755136 00000100:00100000:2.0:1782758801.331949:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755136 00000100:00100000:2.0:1782758801.331976:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1782758801.331982:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211755136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.332011:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211755136:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758801.332016:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1782758801.332063:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211754624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.332073:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211755136:0@lo:400:kworker.0 00000100:00100000:2.0:1782758801.332081:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211754752:0@lo:400:kworker.0 00000100:00080000:2.0:1782758801.332107:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758801.332112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758801.332148:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211754496:0@lo:400:kworker.0 00000100:00100000:0.0:1782758801.837181:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211755264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758801.837267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758801.838738:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755264 00000100:00100000:3.0:1782758801.838753:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755264 00000100:00100000:3.0:1782758801.838838:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1782758801.838849:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211755264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758801.838893:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758801.839326:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211755264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 476us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758801.839335:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1782758801.839410:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211755264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758802.032638:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758803.057644:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782758803.660345:0:105752:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00010000:00010000:0.0:1782758804.077439:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758804.397394:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211755392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758804.397476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758804.398164:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755392 00000100:00100000:3.0:1782758804.398174:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755392 00000100:00100000:3.0:1782758804.398237:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1782758804.398249:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211755392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758804.398301:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758804.398657:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211755392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 409us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758804.398671:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:3.0:1782758804.398699:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758804.398752:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211755392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758805.100025:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758806.128094:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758806.444224:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211755520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444410:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211756032:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444472:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758806.444478:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211755904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444530:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211755648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444573:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211756160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444644:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758806.444650:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211755776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.444705:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756032 00000100:00100000:0.0:1782758806.444712:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756032 00000100:00100000:0.0:1782758806.444767:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755648 00000100:00100000:0.0:1782758806.444770:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755648 00000100:00100000:0.0:1782758806.444787:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755776 00000100:00100000:0.0:1782758806.444790:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755776 00000100:00100000:0.0:1782758806.444808:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1782758806.444817:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211756032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444916:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211756032:12345-0@lo:400:kworker.0 Request processed in 99us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.444927:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1782758806.444956:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1782758806.444962:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211755648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.444996:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211755648:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.445002:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1782758806.445013:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1782758806.445020:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211755776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445046:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211755776:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.445052:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1782758806.445074:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755904 00000100:00100000:0.0:1782758806.445077:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755904 00000100:00100000:0.0:1782758806.445101:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756160 00000100:00100000:0.0:1782758806.445104:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756160 00000100:00100000:0.0:1782758806.445120:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1782758806.445126:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211755904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445155:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211755904:12345-0@lo:400:kworker.0 Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.445162:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1782758806.445172:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1782758806.445178:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211756160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445201:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211756160:12345-0@lo:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.445207:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00080000:0.0:1782758806.445233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758806.445237:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758806.445239:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758806.445277:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211755776:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445287:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211755648:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445296:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211756160:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445326:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211755904:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.445336:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211756032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758806.445685:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211755520 00000100:00100000:3.0:1782758806.445691:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211755520 00000100:00100000:3.0:1782758806.445730:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1782758806.445736:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211755520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758806.445780:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211755520:12345-0@lo:400:kworker.0 Request processed in 45us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758806.445787:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1782758806.445846:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211755520:0@lo:400:kworker.0 00000100:00100000:0.0:1782758806.956427:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758806.956456:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211756288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758806.956560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758806.956654:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756288 00000100:00100000:0.0:1782758806.956662:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756288 00000100:00100000:0.0:1782758806.956712:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1782758806.956722:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211756288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758806.956765:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758806.956811:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211756288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758806.956819:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1782758806.956902:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211756288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758807.153725:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782758807.368802:0:105900:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:3.0:1782758807.384531:0:105901:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:3.0:1782758807.408613:0:105902:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00010000:00010000:2.0:1782758808.171998:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758808.444213:0:105950:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbf6dd670 20000000:00000080:0.0:1782758808.444232:0:105950:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171b7ae8c00 uarg=0000000000000000 20000000:01000000:0.0:1782758808.444334:0:105950:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1782758808.444343:0:105950:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1782758808.444350:0:105950:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782758808.445465:0:105951:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1782758808.445634:0:105950:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782758808.455070:0:105950:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782758808.455315:0:105950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455338:0:105950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455346:0:105950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455352:0:105950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455360:0:105950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455420:0:105950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455435:0:105950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 18 pid: 5793 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758808.455451:0:105950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756416:0@lo:104: 00000100:00100000:0.0:1782758808.455537:0:105950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782758808.455663:0:105950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455672:0:105950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 18 pid: 5794 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758808.455679:0:105950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756544:0@lo:104: 00000100:00100000:0.0:1782758808.455701:0:105950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782758808.455785:0:105950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758808.455793:0:105950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 18 pid: 5796 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758808.455802:0:105950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756672:0@lo:104: 00000100:00100000:0.0:1782758808.455857:0:105950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758808.456115:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756416 00000100:00100000:3.0:1782758808.456123:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756416 00000100:00100000:3.0:1782758808.456174:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756544 00000100:00100000:3.0:1782758808.456178:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756544 00000100:00100000:3.0:1782758808.456193:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1782758808.456203:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:105950:x1869355211756416:12345-0@lo:104: 00010000:00010000:3.0:1782758808.456232:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456292:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758808.456298:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:105950:x1869355211756416:12345-0@lo:104: Request processed in 96us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758808.456306:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1782758808.456326:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1782758808.456333:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:105950:x1869355211756544:12345-0@lo:104: 00010000:00010000:3.0:1782758808.456340:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456373:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782758808.456377:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:105950:x1869355211756544:12345-0@lo:104: Request processed in 46us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758808.456383:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:3.0:1782758808.456401:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782758808.456407:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456415:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758808.456420:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456430:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758808.456438:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758808.456443:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782758808.456470:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456477:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758808.456496:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456509:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694200/0xdd99f5c4777dc407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc40e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456522:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758808.456524:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456529:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758808.456531:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456537:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758808.456542:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758808.456546:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782758808.456555:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456561:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758808.456565:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456571:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc3f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc400 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.456577:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758808.456579:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758808.456580:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758808.456586:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758808.456603:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211756928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758808.456633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758808.456664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758808.456670:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211756800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758808.456691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758808.456808:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756928 00000100:00100000:2.0:1782758808.456815:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756928 00010000:00010000:2.0:1782758808.456859:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 19 pid: 5794 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758808.456879:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756800 00000100:00100000:2.0:1782758808.456882:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756800 00010000:00010000:2.0:1782758808.456909:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 20 pid: 5793 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758808.456927:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1782758808.456933:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355211756928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758808.456944:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758808.456950:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 20 pid: 5794 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.456959:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 20 pid: 5794 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.456980:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758808.457013:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355211756928:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758808.457019:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1782758808.457037:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1782758808.457043:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211756800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758808.457050:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758808.457055:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 19 pid: 5793 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.457063:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 19 pid: 5793 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.457072:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758808.457092:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211756800:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758808.457098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1782758808.457137:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211756800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758808.457146:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211756928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758808.457805:0:105950:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6e40 going to sleep for 11 seconds 00010000:00010000:0.0:1782758808.457844:0:105950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc40e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc407 expref: 18 pid: 5793 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758808.457857:0:105950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756416:0@lo:104: 00010000:00010000:0.0:1782758808.457869:0:105950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc3f9 expref: 17 pid: 5794 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758808.457875:0:105950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756544:0@lo:104: 00000100:00100000:3.0:1782758808.457939:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211756672 00000100:00100000:3.0:1782758808.457945:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211756672 00000100:00100000:3.0:1782758808.457988:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1782758808.457995:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:105950:x1869355211756672:12345-0@lo:104: 00010000:00010000:3.0:1782758808.458008:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758808.458065:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758808.458071:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:105950:x1869355211756672:12345-0@lo:104: Request processed in 77us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758808.458077:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1782758808.458137:0:105950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105950:1869355211756672:0@lo:104: 00010000:00010000:0.0:1782758808.458162:0:105950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458300:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758808.458306:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458313:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758808.458318:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458328:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758808.458335:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758808.458342:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782758808.458381:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458388:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782758808.458431:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211757056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758808.458465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782758808.458517:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458525:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695800/0xdd99f5c4777dc3dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458542:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758808.458543:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758808.458545:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758808.458555:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757056 00000100:00100000:2.0:1782758808.458560:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757056 00010000:00010000:2.0:1782758808.458580:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 17 pid: 5796 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758808.458602:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1782758808.458609:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3307:x1869355211757056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758808.458619:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758808.458624:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 17 pid: 5796 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458633:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 17 pid: 5796 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458646:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc3e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc3dd expref: 17 pid: 5796 timeout: 2976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458657:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458666:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458682:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458689:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458695:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458702:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458708:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758808.458712:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458719:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458731:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758808.458740:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758808.458915:0:105950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758808.458924:0:105950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758808.458930:0:105950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc415 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758808.463150:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3307:x1869355211757056:12345-0@lo:103:ldlm_bl.0 Request processed in 4530us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758808.463168:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1782758808.465261:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211757056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758809.196090:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782758809.423551:0:106000:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=8808, dev=0 00000100:00100000:0.0:1782758809.520045:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758809.520073:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211757184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758809.520146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758809.520555:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757184 00000100:00100000:3.0:1782758809.520564:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757184 00000100:00100000:3.0:1782758809.520669:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1782758809.520679:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211757184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758809.520713:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758809.520781:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211757184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758809.520788:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1782758809.520860:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211757184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758809.527573:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1782758809.709129:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782758809.709139:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917183103000 from 10 10000000:01000000:3.0:1782758809.709145:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782758809.709213:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.709225:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.709237:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758809.709390:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.709468:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758809.709522:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782758809.709905:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757312 00000100:00100000:1.0:1782758809.709914:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757312 00000100:00100000:1.0:1782758809.709966:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1782758809.709976:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211757312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758809.709993:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758809.710019:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc41c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758809.710049:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758809.710060:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758809.710069:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782758809.710133:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758809.710140:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:2.0:1782758809.710346:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758809.710365:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758809.710375:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758809.710443:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.710476:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758809.710512:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758809.710713:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757440 00000100:00100000:3.0:1782758809.710719:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757440 00000100:00100000:3.0:1782758809.710750:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:3.0:1782758809.710757:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.711516:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 757us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758809.711524:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:2.0:1782758809.711696:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.711747:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782758809.712127:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758809.712212:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758809.712483:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757568 00000100:00100000:3.0:1782758809.712489:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757568 00000100:00100000:3.0:1782758809.712802:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:3.0:1782758809.712816:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.713093:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758809.713101:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1782758809.713379:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782758809.714767:0:106013:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782758809.716531:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782758809.716577:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782758809.716591:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.716604:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758809.716618:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782758809.716621:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917184fef000 from 10 10000000:01000000:3.0:1782758809.716624:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782758809.716679:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.716688:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.716701:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758809.716733:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.716813:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758809.716891:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758809.717115:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757696 00000100:00100000:0.0:1782758809.717124:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757696 00000100:00100000:0.0:1782758809.717166:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1782758809.717174:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211757696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758809.717375:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758809.717387:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc42a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.717410:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.717420:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.717430:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782758809.717492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211757696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758809.717498:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:3.0:1782758809.717700:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758809.717718:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758809.717726:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758809.717786:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.717849:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758809.717885:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758809.718018:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757824 00000100:00100000:0.0:1782758809.718023:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757824 00000100:00100000:0.0:1782758809.718058:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:0.0:1782758809.718066:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211757824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758809.718411:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211757824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758809.718418:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1782758809.718468:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758809.718501:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758809.718544:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758809.718574:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758809.718597:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211757952 00000100:00100000:0.0:1782758809.718602:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211757952 00000100:00100000:0.0:1782758809.718634:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:0.0:1782758809.718642:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211757952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782758809.718790:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211757952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758809.718796:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1782758809.718968:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211757952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782758809.720003:0:106014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782758809.721126:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782758809.721161:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782758809.721174:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758809.721583:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758809.721596:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782758809.721599:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9171932e8800 from 10 10000000:01000000:2.0:1782758809.721602:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782758809.721643:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758809.721652:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758809.721663:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758809.721690:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.721764:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758809.721908:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771300 going to sleep for 11 seconds 00000100:00100000:0.0:1782758809.721992:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758080 00000100:00100000:0.0:1782758809.722001:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758080 00000100:00100000:0.0:1782758809.722057:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1782758809.722066:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211758080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758809.722082:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758809.722096:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc438 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.722121:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.722132:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758809.722143:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758809.722559:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211758080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 493us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758809.722572:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1782758809.722651:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758809.722667:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758809.722683:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758809.722740:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.722775:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758809.722897:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771300 going to sleep for 11 seconds 00000100:00100000:3.0:1782758809.722969:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758208 00000100:00100000:3.0:1782758809.722976:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758208 00000100:00100000:3.0:1782758809.723004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1782758809.723012:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211758208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758809.723728:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211758208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 715us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758809.723736:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1782758809.723800:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.723939:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782758809.723981:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758809.724043:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771300 going to sleep for 11 seconds 00000100:00100000:1.0:1782758809.724073:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758336 00000100:00100000:1.0:1782758809.724078:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758336 00000100:00100000:1.0:1782758809.724110:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:1.0:1782758809.724118:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211758336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758809.724281:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211758336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758809.724288:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:2.0:1782758809.724579:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211758336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782758809.727758:0:106015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782758809.728760:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782758809.728789:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782758809.728801:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758809.728814:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758810.220075:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758811.244500:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758811.570350:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211758464:0@lo:400:kworker.0 00000100:00100000:2.0:1782758811.570440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758811.570598:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758464 00000100:00100000:0.0:1782758811.570608:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758464 00000100:00100000:0.0:1782758811.570671:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1782758811.570682:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758811.574126:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211758720:0@lo:400:kworker.0 00000100:00100000:1.0:1782758811.574964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758811.575035:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758811.575044:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211758848:0@lo:400:kworker.0 00000100:00100000:1.0:1782758811.575091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758811.578571:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758720 00000100:00100000:1.0:1782758811.578587:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758720 00000100:00100000:1.0:1782758811.578662:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1782758811.578672:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211758720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758811.578770:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211758720:12345-0@lo:400:kworker.0 Request processed in 100us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758811.578776:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1782758811.578851:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211758720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758811.579036:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211758464:12345-0@lo:400:kworker.0 Request processed in 8355us (8596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758811.579046:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1782758811.579074:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758848 00000100:00100000:0.0:1782758811.579078:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758848 00000100:00100000:0.0:1782758811.579113:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1782758811.579119:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211758848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758811.579165:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211758848:12345-0@lo:400:kworker.0 Request processed in 47us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758811.579171:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00080000:0.0:1782758811.579188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758811.579193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758811.579312:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211758848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582120:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211758592:0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758811.582335:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211759104:0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758811.582389:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758811.582396:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211758976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758811.582453:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758592 00000100:00100000:3.0:1782758811.582460:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758592 00000100:00100000:3.0:1782758811.582508:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211758976 00000100:00100000:3.0:1782758811.582512:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211758976 00000100:00100000:3.0:1782758811.582544:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:3.0:1782758811.582554:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211758592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582619:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211758592:12345-0@lo:400:kworker.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758811.582626:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:3.0:1782758811.582646:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1782758811.582653:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211758976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582681:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211758976:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758811.582687:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00080000:3.0:1782758811.582708:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758811.582747:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211758976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758811.582758:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211758592:0@lo:400:kworker.0 00000100:00100000:2.0:1782758811.584046:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211758464:0@lo:400:kworker.0 00000100:00100000:2.0:1782758811.584092:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759104 00000100:00100000:2.0:1782758811.584099:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759104 00000100:00100000:2.0:1782758811.584151:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1782758811.584159:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211759104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758811.584236:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211759104:12345-0@lo:400:kworker.0 Request processed in 77us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758811.584242:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1782758811.584286:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211759104:0@lo:400:kworker.0 00000100:00080000:0.0:1782758811.584858:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758812.076400:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758812.076430:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211759232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758812.076519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758812.076603:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759232 00000100:00100000:0.0:1782758812.076611:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759232 00000100:00100000:0.0:1782758812.076664:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1782758812.076674:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211759232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758812.076724:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758812.077125:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211759232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 450us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758812.077133:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1782758812.085368:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211759232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758812.269417:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782758812.926158:0:106152:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=8808, dev=0 00000020:00000004:3.0:1782758812.933384:0:106153:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=8808, dev=0 00000020:00000004:1.0:1782758812.958099:0:106154:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=8808, dev=0 00010000:00010000:3.0:1782758813.296659:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758814.316646:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758814.641928:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758814.641952:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211759360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758814.642026:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758814.642101:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759360 00000100:00100000:1.0:1782758814.642110:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759360 00000100:00100000:1.0:1782758814.642173:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1782758814.642185:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211759360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758814.642230:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758814.642289:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211759360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758814.642296:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00080000:1.0:1782758814.642324:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758814.642366:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211759360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758815.340252:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758816.371491:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782758816.377699:0:106299:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=9200, dev=0 00000100:00100000:3.0:1782758816.686519:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211759744:0@lo:400:kworker.0 00000100:00100000:3.0:1782758816.686605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758816.686673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758816.686679:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211759872:0@lo:400:kworker.0 00000100:00100000:3.0:1782758816.686716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758816.686888:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211759488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.686924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758816.686958:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211760000:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.686983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758816.687004:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758816.687010:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211759616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758816.687048:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211760128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758816.687151:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759744 00000100:00100000:0.0:1782758816.687159:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759744 00000100:00100000:0.0:1782758816.687204:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760000 00000100:00100000:0.0:1782758816.687207:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760000 00000100:00100000:0.0:1782758816.687223:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759616 00000100:00100000:0.0:1782758816.687225:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759616 00000100:00100000:0.0:1782758816.687239:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1782758816.687247:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211759744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687315:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211759744:12345-0@lo:400:kworker.0 Request processed in 68us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758816.687323:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1782758816.687340:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1782758816.687346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687376:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211760000:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758816.687383:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1782758816.687393:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1782758816.687399:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211759616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211759616:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758816.687430:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1782758816.687447:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759872 00000100:00100000:0.0:1782758816.687450:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759872 00000100:00100000:0.0:1782758816.687471:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760128 00000100:00100000:0.0:1782758816.687474:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760128 00000100:00100000:0.0:1782758816.687489:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:0.0:1782758816.687494:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687523:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211759872:12345-0@lo:400:kworker.0 Request processed in 28us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758816.687528:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:0.0:1782758816.687538:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1782758816.687543:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687565:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211760128:12345-0@lo:400:kworker.0 Request processed in 22us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758816.687570:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00080000:0.0:1782758816.687600:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758816.687604:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758816.687607:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758816.687640:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211759872:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687652:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211759744:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687682:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211759616:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687690:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211760128:0@lo:400:kworker.0 00000100:00100000:0.0:1782758816.687699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211760000:0@lo:400:kworker.0 00000100:00100000:3.0:1782758816.689291:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211759488 00000100:00100000:3.0:1782758816.689305:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211759488 00000100:00100000:3.0:1782758816.689353:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1782758816.689361:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211759488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758816.689464:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211759488:12345-0@lo:400:kworker.0 Request processed in 103us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758816.689472:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1782758816.689650:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211759488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758817.199633:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758817.199712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758817.199799:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760256 00000100:00100000:0.0:1782758817.199806:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760256 00000100:00100000:0.0:1782758817.199878:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1782758817.199886:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758817.199924:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758817.199973:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758817.199981:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1782758817.200028:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758817.396393:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758818.412106:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758819.447230:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758819.755962:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758819.756097:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758819.756182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758819.756249:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760384 00000100:00100000:1.0:1782758819.756257:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760384 00000100:00100000:1.0:1782758819.756318:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1782758819.756328:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758819.756623:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758819.756695:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758819.756704:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:1.0:1782758819.756734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758819.756780:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760384:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1782758819.920196:0:106448:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=9200, dev=0 00000020:00000004:3.0:1782758819.929970:0:106449:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=9200, dev=0 00000020:00000004:2.0:1782758819.974482:0:106450:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=9200, dev=0 00010000:00010000:3.0:1782758820.460730:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758821.485883:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758821.805455:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211760768:0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.805597:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211760512:0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.805678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758821.805735:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758821.805741:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211760640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.805783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758821.805841:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760512 00000100:00100000:0.0:1782758821.805850:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760512 00000100:00100000:0.0:1782758821.805893:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1782758821.805901:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211760512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.805954:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211760512:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758821.805962:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1782758821.806006:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760640 00000100:00100000:0.0:1782758821.806010:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760640 00000100:00100000:0.0:1782758821.806036:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1782758821.806042:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211760640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.806089:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211760640:12345-0@lo:400:kworker.0 Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758821.806095:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1782758821.806133:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211760640:0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.806141:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211760512:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.806616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758821.806707:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758821.806714:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760896:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.806744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758821.806775:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760896 00000100:00100000:2.0:1782758821.806779:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760896 00000100:00100000:2.0:1782758821.806820:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1782758821.806847:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.806885:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211760896:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758821.806892:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00080000:2.0:1782758821.806909:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758821.806931:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211760896:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.806965:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211761024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.806987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758821.807615:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211760768 00000100:00100000:2.0:1782758821.807624:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211760768 00000100:00100000:2.0:1782758821.807726:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761024 00000100:00100000:2.0:1782758821.807730:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761024 00000100:00100000:0.0:1782758821.809349:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1782758821.809375:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211760768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758821.809517:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211760768:12345-0@lo:400:kworker.0 Request processed in 155us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758821.809525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:1.0:1782758821.813298:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211760768:0@lo:400:kworker.0 00000100:00080000:3.0:1782758821.815855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758821.820735:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1782758821.820752:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211761024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.820891:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211761024:12345-0@lo:400:kworker.0 Request processed in 143us (13902us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758821.820899:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1782758821.820967:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211761024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.821228:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211761152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.821266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758821.821351:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761152 00000100:00100000:2.0:1782758821.821358:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761152 00000100:00080000:3.0:1782758821.821408:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758821.821409:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:2.0:1782758821.821420:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211761152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758821.821471:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211761152:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758821.821479:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1782758821.821504:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211761152:0@lo:400:kworker.0 00000100:00100000:1.0:1782758822.316316:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211761280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758822.316413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758822.316617:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761280 00000100:00100000:0.0:1782758822.316637:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761280 00000100:00100000:0.0:1782758822.316698:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1782758822.316709:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211761280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758822.316746:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758822.316802:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211761280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.316811:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:1.0:1782758822.319235:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211761280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758822.508986:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758822.615699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.615843:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196890624 00000100:00100000:0.0:1782758822.615856:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196890624 00000100:00100000:0.0:1782758822.615911:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1565 00000100:00100000:0.0:1782758822.615921:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355196890624:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782758822.615953:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 2192e054-ee2f-4962-9e35-ea4618b4dde3@192.168.204.31@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:0.0:1782758822.615991:0:5794:0:(genops.c:1406:class_connect()) connect: client 2192e054-ee2f-4962-9e35-ea4618b4dde3, cookie 0xdd99f5c4777dc446 00000100:00080000:0.0:1782758822.616049:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917084d24800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758822.616123:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+5:2360:x1869355196890624:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 201us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.616132:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1565 00000100:00100000:3.0:1782758822.628675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.628893:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196890752 00000100:00100000:0.0:1782758822.628903:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196890752 00000100:00100000:0.0:1782758822.628974:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1566 00000100:00100000:0.0:1782758822.628985:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+5:63726:x1869355196890752:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782758822.629005:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758822.629024:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f7d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.629053:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f7d expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.629065:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f7d expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.629074:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:0.0:1782758822.629140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+6:63726:x1869355196890752:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 156us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.629148:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1566 00000100:00100000:3.0:1782758822.635161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.638276:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196890880 00000100:00100000:1.0:1782758822.638295:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196890880 00000100:00100000:1.0:1782758822.638360:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1567 00000100:00100000:1.0:1782758822.638372:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+6:63726:x1869355196890880:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782758822.638774:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+6:63726:x1869355196890880:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 403us (3621us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782758822.638783:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1567 00000100:00100000:2.0:1782758822.653530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.655201:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891008 00000100:00100000:1.0:1782758822.655216:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891008 00000100:00100000:1.0:1782758822.655295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1568 00000100:00100000:1.0:1782758822.655307:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+6:63726:x1869355196891008:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758822.655325:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758822.655345:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64f84 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.655379:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f84 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.655392:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f84 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.655402:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782758822.655483:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+7:63726:x1869355196891008:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 178us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758822.655491:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1568 00000100:00100000:3.0:1782758822.671700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.678278:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891136 00000100:00100000:0.0:1782758822.678296:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891136 00000100:00100000:0.0:1782758822.678424:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1569 00000100:00100000:0.0:1782758822.678436:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+7:63726:x1869355196891136:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782758822.678798:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63726:x1869355196891136:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 363us (7107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.678807:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1569 00000100:00100000:2.0:1782758822.683261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.683600:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891264 00000100:00100000:0.0:1782758822.683612:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891264 00000100:00100000:0.0:1782758822.683696:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1570 00000100:00100000:0.0:1782758822.683707:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63726:x1869355196891264:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782758822.684911:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63726:x1869355196891264:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 1198us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.684923:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1570 00000100:00100000:2.0:1782758822.692284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.693294:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891392 00000100:00100000:0.0:1782758822.693309:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891392 00000100:00100000:0.0:1782758822.693455:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1571 00000100:00100000:0.0:1782758822.693467:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63745:x1869355196891392:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758822.693918:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63745:x1869355196891392:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 453us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.693927:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1571 00000100:00100000:3.0:1782758822.715439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.715687:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891520 00000100:00100000:0.0:1782758822.715700:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891520 00000100:00100000:0.0:1782758822.715769:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1572 00000100:00100000:0.0:1782758822.715780:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63745:x1869355196891520:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758822.716110:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63745:x1869355196891520:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 331us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.716119:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1572 00000100:00100000:2.0:1782758822.735810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.738881:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891648 00000100:00100000:0.0:1782758822.738899:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891648 00000100:00100000:0.0:1782758822.738995:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1573 00000100:00100000:0.0:1782758822.739007:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:63726:x1869355196891648:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782758822.739027:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758822.739047:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc45b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64fae expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.739078:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fae expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.739090:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fae expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758822.739099:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:0.0:1782758822.739170:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:63726:x1869355196891648:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 165us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.739177:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1573 00000100:00100000:2.0:1782758822.748574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.749464:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891776 00000100:00100000:1.0:1782758822.749476:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891776 00000100:00100000:1.0:1782758822.749543:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1574 00000100:00100000:1.0:1782758822.749553:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:63726:x1869355196891776:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782758822.749582:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782758822.749608:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782758822.749625:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782758822.749628:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782758822.749630:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782758822.752885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:63726:x1869355196891776:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 3317us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758822.752902:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1574 00000100:00100000:2.0:1782758822.757035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.757230:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196891904 00000100:00100000:1.0:1782758822.757241:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196891904 00000100:00100000:1.0:1782758822.757301:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1575 00000100:00100000:1.0:1782758822.757311:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:63726:x1869355196891904:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758822.757329:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758822.757348:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64fb5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.757378:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.757389:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758822.757403:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782758822.757600:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63726:x1869355196891904:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 289us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758822.757608:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1575 00000100:00100000:2.0:1782758822.760879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.761110:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892032 00000100:00100000:1.0:1782758822.761121:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892032 00000100:00100000:1.0:1782758822.761180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1576 00000100:00100000:1.0:1782758822.761191:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63726:x1869355196892032:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782758822.761660:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63726:x1869355196892032:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 468us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758822.761669:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1576 00000100:00100000:2.0:1782758822.766541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758822.766903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892160 00000100:00100000:3.0:1782758822.766913:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892160 00000100:00100000:2.0:1782758822.767270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1577 00000100:00100000:2.0:1782758822.767282:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63726:x1869355196892160:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782758822.767523:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63726:x1869355196892160:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 243us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758822.767531:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1577 00000100:00100000:3.0:1782758822.770019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.771368:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892288 00000100:00100000:0.0:1782758822.771391:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892288 00000100:00100000:0.0:1782758822.771441:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1578 00000100:00100000:0.0:1782758822.771460:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63750:x1869355196892288:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758822.771875:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63750:x1869355196892288:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 425us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.771885:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1578 00000100:00100000:1.0:1782758822.811401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.811629:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892416 00000100:00100000:0.0:1782758822.811642:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892416 00000100:00100000:0.0:1782758822.811704:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1579 00000100:00100000:0.0:1782758822.811715:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63750:x1869355196892416:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758822.812042:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63750:x1869355196892416:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 327us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.812051:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1579 00000100:00100000:3.0:1782758822.818960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.819634:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892544 00000100:00100000:0.0:1782758822.819649:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892544 00000100:00100000:0.0:1782758822.819709:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1262 00000100:00100000:0.0:1782758822.819717:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2360:x1869355196892544:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782758822.819752:0:19544:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b41f5e30-c84e-4368-8f14-cecc88662c13@192.168.204.31@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:0.0:1782758822.819805:0:19544:0:(genops.c:1406:class_connect()) connect: client b41f5e30-c84e-4368-8f14-cecc88662c13, cookie 0xdd99f5c4777dc469 00000004:00100000:0.0:1782758822.819910:0:19544:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782758822.820183:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917084d20000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758822.820665:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2360:x1869355196892544:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 943us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.820675:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1262 00000100:00100000:3.0:1782758822.826327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758822.826370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758822.826604:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892800 00000100:00100000:2.0:1782758822.826625:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892800 00000100:00100000:2.0:1782758822.826700:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892672 00000100:00100000:2.0:1782758822.826703:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892672 00000100:00100000:2.0:1782758822.826739:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1263 00000100:00100000:2.0:1782758822.826748:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+7:63726:x1869355196892800:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782758822.826795:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1782758822.826919:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+7:63726:x1869355196892800:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 172us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758822.826928:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1263 00000100:00100000:2.0:1782758822.826958:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1264 00000100:00100000:2.0:1782758822.826965:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+6:0:x1869355196892672:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782758822.826977:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1782758822.827000:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+6:0:x1869355196892672:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758822.827006:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1264 00000100:00080000:3.0:1782758822.828293:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758822.833173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758822.833356:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196892928 00000100:00100000:0.0:1782758822.833367:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196892928 00000100:00100000:0.0:1782758822.833438:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1265 00000100:00100000:0.0:1782758822.833458:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63726:x1869355196892928:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782758822.833564:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63726:x1869355196892928:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 108us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.833573:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1265 00000100:00100000:2.0:1782758822.837491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758822.837539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758822.837700:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893056 00000100:00100000:3.0:1782758822.837710:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893056 00000100:00100000:3.0:1782758822.837763:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893184 00000100:00100000:3.0:1782758822.837766:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893184 00000100:00100000:3.0:1782758822.837797:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 700 00000100:00100000:3.0:1782758822.837805:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196893056:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782758822.837874:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b41f5e30-c84e-4368-8f14-cecc88662c13@192.168.204.31@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:3.0:1782758822.837909:0:6598:0:(genops.c:1406:class_connect()) connect: client b41f5e30-c84e-4368-8f14-cecc88662c13, cookie 0xdd99f5c4777dc470 00002000:00100000:3.0:1782758822.838179:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b41f5e30-c84e-4368-8f14-cecc88662c13/ffff9171bc198000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758822.838282:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1782758822.838559:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:2.0:1782758822.838567:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196893184:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782758822.838589:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b41f5e30-c84e-4368-8f14-cecc88662c13@192.168.204.31@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:2.0:1782758822.838607:0:9120:0:(genops.c:1406:class_connect()) connect: client b41f5e30-c84e-4368-8f14-cecc88662c13, cookie 0xdd99f5c4777dc477 00002000:00100000:2.0:1782758822.838623:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b41f5e30-c84e-4368-8f14-cecc88662c13/ffff9171bb696000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782758822.838631:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782758822.838817:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782758822.838875:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1782758822.839363:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782758822.839380:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171bc199000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758822.839424:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2360:x1869355196893056:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 1618us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758822.839433:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 700 00000100:00100000:2.0:1782758822.839526:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2360:x1869355196893184:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 957us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758822.839533:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:3.0:1782758822.843289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758822.843654:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893312 00000100:00100000:1.0:1782758822.843665:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893312 00000100:00100000:1.0:1782758822.844055:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1782758822.844532:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63726:x1869355196893312:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782758822.844923:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782758822.845298:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63726:x1869355196893312:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 1231us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758822.845308:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:1.0:1782758823.124624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758823.124724:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893440 00000100:00100000:2.0:1782758823.124735:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893440 00000100:00100000:2.0:1782758823.124802:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1266 00000100:00100000:2.0:1782758823.124812:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63770:x1869355196893440:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782758823.124864:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758823.124924:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dc47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64fdf expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125009:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125025:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125038:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758823.125250:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758823.125254:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758823.125336:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125361:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695c00/0xdd99f5c4777dc47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fdf expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125379:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fdf expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758823.125388:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6900) 00010000:00010000:2.0:1782758823.125391:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758823.125394:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758823.125459:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+7:63770:x1869355196893440:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 648us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758823.125467:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1266 00010000:00010000:3.0:1782758823.532659:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782758824.428611:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00010000:00010000:0.0:1782758824.556227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758824.877381:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211761408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758824.877485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758824.877592:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761408 00000100:00100000:1.0:1782758824.877602:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761408 00000100:00100000:1.0:1782758824.877678:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1782758824.877688:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211761408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758824.877735:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758824.877788:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211761408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758824.877796:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:2.0:1782758824.877928:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758824.878486:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211761408:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782758824.971916:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00000001:00100000:3.0:1782758824.972111:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00010000:00010000:0.0:1782758825.580890:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758825.603943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758825.604083:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893568 00000100:00100000:0.0:1782758825.604100:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893568 00000100:00100000:0.0:1782758825.604268:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1267 00000100:00100000:0.0:1782758825.604282:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63823:x1869355196893568:12345-192.168.204.31@tcp:41:lfs.0 00000004:00000024:0.0:1782758825.604357:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782758825.604496:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b41f5e30-c84e-4368-8f14-cecc88662c13+6:63823:x1869355196893568:12345-192.168.204.31@tcp:41:lfs.0 Request processed in 217us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758825.604505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1267 00000100:00080000:2.0:1782758825.604608:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758825.610004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758825.610194:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893696 00000100:00100000:1.0:1782758825.610207:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893696 00000100:00100000:1.0:1782758825.610311:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:1.0:1782758825.610324:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b41f5e30-c84e-4368-8f14-cecc88662c13+5:63823:x1869355196893696:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:1.0:1782758825.610360:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758825.610464:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b41f5e30-c84e-4368-8f14-cecc88662c13+5:63823:x1869355196893696:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 142us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758825.610473:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00080000:2.0:1782758825.613066:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758825.614296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758825.614403:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893824 00000100:00100000:2.0:1782758825.614420:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893824 00000100:00100000:2.0:1782758825.614525:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00100000:2.0:1782758825.614539:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b41f5e30-c84e-4368-8f14-cecc88662c13+5:63823:x1869355196893824:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:2.0:1782758825.614605:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758825.614714:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b41f5e30-c84e-4368-8f14-cecc88662c13+5:63823:x1869355196893824:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 177us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758825.614724:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00080000:3.0:1782758825.615517:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782758826.606381:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758826.927915:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211761664:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928091:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211762176:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928150:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782758826.928157:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211761536:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928214:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211762048:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928269:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211761920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758826.928320:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211761792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758826.928370:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762176 00000100:00100000:0.0:1782758826.928381:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762176 00000100:00100000:0.0:1782758826.928447:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761920 00000100:00100000:0.0:1782758826.928451:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761920 00000100:00100000:0.0:1782758826.928704:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1782758826.928720:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211762176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928892:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211762176:12345-0@lo:400:kworker.0 Request processed in 176us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758826.928902:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1782758826.928925:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1782758826.928932:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.928968:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211761920:12345-0@lo:400:kworker.0 Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758826.928974:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1782758826.928996:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761664 00000100:00100000:0.0:1782758826.929000:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761664 00000100:00100000:0.0:1782758826.929028:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762048 00000100:00100000:0.0:1782758826.929031:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762048 00000100:00100000:0.0:1782758826.929050:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761792 00000100:00100000:0.0:1782758826.929053:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761792 00000100:00100000:0.0:1782758826.929076:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1782758826.929082:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.929115:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211761664:12345-0@lo:400:kworker.0 Request processed in 33us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758826.929122:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1782758826.929132:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1782758826.929138:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211762048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.929169:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211762048:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758826.929175:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1782758826.929185:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1782758826.929191:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.929216:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211761792:12345-0@lo:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758826.929222:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00080000:0.0:1782758826.929244:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758826.929249:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758826.929252:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758826.929300:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211761792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758826.929314:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211761920:0@lo:400:kworker.0 00000100:00100000:1.0:1782758826.929702:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211761536 00000100:00100000:1.0:1782758826.929709:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211761536 00000100:00100000:1.0:1782758826.929759:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:1.0:1782758826.929768:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211761536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758826.929841:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211761536:12345-0@lo:400:kworker.0 Request processed in 55us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758826.929849:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:3.0:1782758826.931255:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211762176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758826.931287:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211761536:0@lo:400:kworker.0 00000100:00100000:3.0:1782758826.931299:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211762048:0@lo:400:kworker.0 00000100:00100000:3.0:1782758826.931311:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211761664:0@lo:400:kworker.0 00000100:00100000:1.0:1782758827.450160:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211762304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758827.450274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758827.451509:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762304 00000100:00100000:0.0:1782758827.451534:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762304 00000100:00100000:0.0:1782758827.451642:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1782758827.451656:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211762304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758827.451703:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758827.460311:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211762304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8642us (10021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758827.460334:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1782758827.473476:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211762304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758827.631281:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758828.217759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758828.217900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758828.220155:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894208 00000100:00100000:1.0:1782758828.220176:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894208 00000100:00100000:1.0:1782758828.220436:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00100000:1.0:1782758828.220460:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196894208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758828.220598:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196894208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 139us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758828.220606:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00080000:0.0:1782758828.221084:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758828.225021:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196893952 00000100:00100000:2.0:1782758828.225045:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196893952 00000100:00100000:2.0:1782758828.225138:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1581 00000100:00100000:2.0:1782758828.225151:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2363:x1869355196893952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758828.225268:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2363:x1869355196893952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 120us (7525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758828.225277:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1581 00000100:00100000:3.0:1782758828.225727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758828.226552:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894080 00000100:00100000:2.0:1782758828.226563:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894080 00000100:00100000:2.0:1782758828.226646:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2077 00000100:00100000:2.0:1782758828.226656:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2363:x1869355196894080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782758828.226746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758828.227446:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2363:x1869355196894080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 787us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758828.227457:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2077 00000100:00100000:0.0:1782758828.256880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758828.257312:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894336 00000100:00100000:1.0:1782758828.257326:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894336 00000100:00100000:1.0:1782758828.257430:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1618 00000100:00100000:1.0:1782758828.257443:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196894336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758828.257559:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196894336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 118us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758828.257568:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1618 00000100:00080000:0.0:1782758828.258463:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782758828.652314:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758829.676233:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782758829.714998:0:106648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1782758830.001349:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211762432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758830.001430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758830.001640:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762432 00000100:00100000:2.0:1782758830.001649:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762432 00000100:00100000:2.0:1782758830.001714:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1782758830.001724:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211762432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758830.001763:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758830.001818:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211762432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758830.001849:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00080000:3.0:1782758830.005848:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758830.005945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211762432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758830.705155:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758831.724629:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758832.055167:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211762816:0@lo:400:kworker.0 00000100:00100000:2.0:1782758832.055280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758832.055375:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758832.055382:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211762944:0@lo:400:kworker.0 00000100:00100000:2.0:1782758832.055414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758832.055467:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762816 00000100:00100000:2.0:1782758832.055478:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762816 00000100:00100000:2.0:1782758832.055558:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1782758832.055569:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.055818:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211762560:0@lo:400:kworker.0 00000100:00100000:0.0:1782758832.055919:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211762688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.059904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758832.059997:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211763072:0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.060060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758832.062215:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763072 00000100:00100000:3.0:1782758832.062238:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763072 00000100:00100000:3.0:1782758832.062420:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:3.0:1782758832.062452:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211763072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.062587:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211763072:12345-0@lo:400:kworker.0 Request processed in 156us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758832.062597:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1782758832.062851:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762560 00000100:00100000:1.0:1782758832.062857:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762560 00000100:00100000:1.0:1782758832.062905:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:1.0:1782758832.062913:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211762560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758832.062958:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211762560:12345-0@lo:400:kworker.0 Request processed in 46us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758832.062964:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1782758832.063103:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211762560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.063123:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211763072:0@lo:400:kworker.0 00000100:00100000:0.0:1782758832.063319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758832.063388:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211763200:0@lo:400:kworker.0 00000100:00100000:0.0:1782758832.063429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758832.068076:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762944 00000100:00100000:1.0:1782758832.068100:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762944 00000100:00100000:1.0:1782758832.068212:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763200 00000100:00100000:1.0:1782758832.068216:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763200 00000100:00100000:1.0:1782758832.068262:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1782758832.068276:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211762944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758832.068421:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211762944:12345-0@lo:400:kworker.0 Request processed in 147us (13004us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758832.068439:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1782758832.068468:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1782758832.068475:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211763200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758832.068518:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211763200:12345-0@lo:400:kworker.0 Request processed in 44us (5089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758832.068525:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:3.0:1782758832.068646:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211762688 00000100:00100000:3.0:1782758832.068652:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211762688 00000100:00100000:3.0:1782758832.068698:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1782758832.068706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211762688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.068754:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211762688:12345-0@lo:400:kworker.0 Request processed in 49us (5436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758832.068760:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1782758832.069135:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211762688:0@lo:400:kworker.0 00000100:00100000:0.0:1782758832.069152:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211763200:0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.069981:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211762944:0@lo:400:kworker.0 00000100:00100000:3.0:1782758832.070000:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211762816:0@lo:400:kworker.0 00000100:00080000:3.0:1782758832.070038:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758832.070045:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758832.070048:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758832.070957:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211762816:12345-0@lo:400:kworker.0 Request processed in 15382us (15669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758832.070970:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1782758832.557151:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211763328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758832.557276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758832.557393:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763328 00000100:00100000:3.0:1782758832.557406:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763328 00000100:00100000:3.0:1782758832.557499:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1782758832.557511:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211763328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758832.557573:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758832.557631:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211763328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758832.557640:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1782758832.557717:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211763328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758832.748225:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758833.345817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758833.345947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758833.345994:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894592 00000100:00100000:0.0:1782758833.346008:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894592 00000100:00100000:2.0:1782758833.346209:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894464 00000100:00100000:2.0:1782758833.346214:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894464 00000100:00100000:2.0:1782758833.346245:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1583 00000100:00100000:2.0:1782758833.346254:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196894464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758833.346322:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196894464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758833.346329:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1583 00000100:00100000:0.0:1782758833.346545:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2081 00000100:00100000:0.0:1782758833.346558:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2361:x1869355196894592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758833.346593:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2361:x1869355196894592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758833.346601:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2081 00000100:00080000:0.0:1782758833.346621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758833.355056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758833.355223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758833.367974:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894848 00000100:00100000:3.0:1782758833.367990:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894848 00000100:00100000:3.0:1782758833.368231:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894720 00000100:00100000:3.0:1782758833.368235:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894720 00000100:00100000:3.0:1782758833.368266:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00100000:3.0:1782758833.368278:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2362:x1869355196894848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758833.368359:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2362:x1869355196894848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (13314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758833.368367:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00100000:3.0:1782758833.368385:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1622 00000100:00100000:3.0:1782758833.368392:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2362:x1869355196894720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758833.368432:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2362:x1869355196894720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (13209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758833.368439:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1622 00000100:00080000:0.0:1782758833.368630:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758833.368634:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758833.772128:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758834.796034:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758835.117572:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211763456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758835.117680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758835.117803:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763456 00000100:00100000:0.0:1782758835.117811:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763456 00000100:00100000:0.0:1782758835.117894:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1782758835.117903:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211763456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758835.117942:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758835.117989:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211763456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758835.117997:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:0.0:1782758835.118017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758835.118303:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211763456:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782758835.493277:0:106798:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc24a0b490 20000000:00000080:0.0:1782758835.493298:0:106798:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171bbc29c00 uarg=0000000000000000 20000000:01000000:0.0:1782758835.493341:0:106798:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782758835.493348:0:106798:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782758835.493353:0:106798:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782758835.500313:0:106799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1782758835.501026:0:106798:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782758835.520319:0:106798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782758835.520727:0:106798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.520753:0:106798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.520762:0:106798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.520769:0:106798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.520779:0:106798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.520794:0:106798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.521403:0:106798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.521423:0:106798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 9 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.521443:0:106798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763584:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782758835.522330:0:106798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.522342:0:106798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 18 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.522354:0:106798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763712:0@lo:104: 00000100:00100000:2.0:1782758835.522419:0:106798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782758835.522470:0:106798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.522492:0:106798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 18 pid: 5794 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.522508:0:106798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763840:0@lo:104: 00000100:00100000:2.0:1782758835.522531:0:106798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782758835.524290:0:106798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.524315:0:106798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 18 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.524331:0:106798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763968:0@lo:104: 00000100:00100000:2.0:1782758835.524401:0:106798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758835.530760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758835.530927:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196894976 00000100:00100000:3.0:1782758835.530937:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196894976 00010000:00010000:3.0:1782758835.530985:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 10 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758835.532352:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 485 00000100:00100000:3.0:1782758835.532383:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196894976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758835.532403:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758835.532412:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 10 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758835.532428:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 10 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758835.532451:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758835.533521:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196894976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1140us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758835.533532:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 485 00000100:00100000:2.0:1782758835.546629:0:106798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f840 going to sleep for 11 seconds 00010000:00010000:2.0:1782758835.546755:0:106798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fb5 expref: 9 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.546777:0:106798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763584:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782758835.547977:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763712 00000100:00100000:1.0:1782758835.547992:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763712 00000100:00100000:1.0:1782758835.548048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763840 00000100:00100000:1.0:1782758835.548052:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763840 00000100:00100000:1.0:1782758835.548063:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211763968 00000100:00100000:1.0:1782758835.548065:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211763968 00000100:00100000:1.0:1782758835.548080:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1782758835.548089:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:106798:x1869355211763712:12345-0@lo:104: 00010000:00010000:1.0:1782758835.548108:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548208:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758835.548214:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:106798:x1869355211763712:12345-0@lo:104: Request processed in 126us (25796us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758835.548232:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1782758835.548253:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1782758835.548259:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:106798:x1869355211763840:12345-0@lo:104: 00010000:00010000:1.0:1782758835.548268:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548301:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782758835.548306:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:106798:x1869355211763840:12345-0@lo:104: Request processed in 48us (25774us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758835.548311:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1782758835.548323:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1782758835.548328:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:106798:x1869355211763968:12345-0@lo:104: 00010000:00010000:1.0:1782758835.548335:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548383:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782758835.548388:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:106798:x1869355211763968:12345-0@lo:104: Request processed in 61us (23989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758835.548394:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:1.0:1782758835.548417:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782758835.548423:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548431:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758835.548437:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548447:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758835.548454:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758835.548460:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782758835.548503:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548515:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758835.548539:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548546:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694000/0xdd99f5c4777dc438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc43f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548562:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782758835.548565:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548571:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758835.548574:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548581:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758835.548587:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758835.548592:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782758835.548604:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548609:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758835.548614:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548621:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc42a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc431 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548629:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758835.548632:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548637:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758835.548640:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548646:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758835.548652:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758835.548657:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782758835.548670:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548676:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758835.548690:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548697:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691c00/0xdd99f5c4777dc41c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc423 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758835.548710:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758835.548712:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758835.548714:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758835.548719:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758835.552935:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758835.553485:0:106798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763712:0@lo:104: 00000100:00100000:2.0:1782758835.553498:0:106798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763840:0@lo:104: 00000100:00100000:2.0:1782758835.553506:0:106798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106798:1869355211763968:0@lo:104: 00010000:00010000:2.0:1782758835.553557:0:106798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.554757:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211764096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758835.554857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758835.554919:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758835.554926:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211764224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758835.554947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758835.555436:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758835.555449:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211764352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758835.555495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758835.555776:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764096 00000100:00100000:2.0:1782758835.555786:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764096 00010000:00010000:2.0:1782758835.555859:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 19 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.555890:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764224 00000100:00100000:2.0:1782758835.555893:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764224 00010000:00010000:2.0:1782758835.555908:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 20 pid: 5794 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.555919:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764352 00000100:00100000:2.0:1782758835.555921:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764352 00010000:00010000:2.0:1782758835.555932:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 21 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758835.555944:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1782758835.555951:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3305:x1869355211764096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758835.555967:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758835.555971:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 21 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.555982:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 21 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556014:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc43f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc438 expref: 21 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556029:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758835.556066:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3305:x1869355211764096:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758835.556073:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1782758835.556090:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1782758835.556095:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211764224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758835.556103:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758835.556107:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 19 pid: 5794 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556115:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 19 pid: 5794 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556123:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc431 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc42a expref: 19 pid: 5794 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556130:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758835.556146:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211764224:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758835.556151:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1782758835.556161:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1782758835.556165:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3308:x1869355211764352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758835.556172:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758835.556175:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 17 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556182:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 17 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556190:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc41c expref: 17 pid: 5793 timeout: 3003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556412:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556421:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556439:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556446:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556452:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556458:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556465:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758835.556470:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556490:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556514:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.556527:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758835.559735:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355211764352:12345-0@lo:103:ldlm_bl.0 Request processed in 3559us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758835.559751:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1782758835.560133:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211764224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758835.560145:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211764096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758835.560183:0:106798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.560268:0:106798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758835.560277:0:106798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc48c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758835.569155:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211764352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758835.823318:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758836.846879:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758836.974952:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782758836.974960:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917183103000 from 10 10000000:01000000:0.0:1782758836.974965:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782758836.975015:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758836.975026:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758836.975037:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758836.975062:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758836.975130:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758836.975225:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88600 going to sleep for 11 seconds 00000100:00100000:3.0:1782758836.980614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764480 00000100:00100000:3.0:1782758836.980629:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764480 00000100:00100000:3.0:1782758836.980703:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1782758836.980716:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211764480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758836.980738:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758836.980767:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690600/0xdd99f5c4777dc49a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc493 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758836.980800:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690600/0xdd99f5c4777dc49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc493 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758836.980812:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690600/0xdd99f5c4777dc49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc493 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758836.980952:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690600, rc 0) 00000100:00100000:3.0:1782758836.981083:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 369us (5952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758836.981090:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:0.0:1782758836.993454:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758836.993489:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc49a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758836.993504:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc49a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758836.993591:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758836.993656:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758837.000927:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764608 00000100:00100000:1.0:1782758837.000942:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764608 00000100:00100000:1.0:1782758837.001008:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:1.0:1782758837.001020:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.001366:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (7709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758837.001385:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1782758837.006945:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88600 going to sleep for 11 seconds 00000100:00100000:0.0:1782758837.006998:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758837.007060:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782758837.007138:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758837.007192:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88600 going to sleep for 11 seconds 00000100:00100000:1.0:1782758837.007632:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764736 00000100:00100000:1.0:1782758837.007640:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764736 00000100:00100000:1.0:1782758837.007695:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1782758837.007705:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.007946:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758837.007955:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1782758837.013942:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782758837.014797:0:106828:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782758837.014991:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782758837.015017:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782758837.015030:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc49a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758837.015041:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51400/0xdd99f5c4777dc493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc49a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758837.015051:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782758837.015053:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff917184fef000 from 10 10000000:01000000:1.0:1782758837.015055:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782758837.015094:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758837.015107:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758837.015116:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758837.015142:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.015208:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758837.015256:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758837.015515:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764864 00000100:00100000:0.0:1782758837.015522:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764864 00000100:00100000:0.0:1782758837.015572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1782758837.015580:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211764864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758837.015594:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758837.015608:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc4a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc4a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758837.015633:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4a1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758837.015645:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50600/0xdd99f5c4777dc4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4a1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758837.015655:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50600, rc 0) 00000100:00100000:0.0:1782758837.015699:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211764864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758837.015706:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1782758837.015793:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758837.015808:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4a8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758837.015819:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc4a8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758837.015902:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.015927:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758837.015942:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758837.016946:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211764992 00000100:00100000:0.0:1782758837.016955:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211764992 00000100:00100000:0.0:1782758837.017004:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:0.0:1782758837.017012:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211764992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782758837.017466:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211764992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 454us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758837.017477:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1782758837.025982:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.026050:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.026128:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758837.026178:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758837.026240:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765120 00000100:00100000:3.0:1782758837.026248:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765120 00000100:00100000:3.0:1782758837.026309:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:3.0:1782758837.026319:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211765120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782758837.026557:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211765120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.026565:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:2.0:1782758837.026647:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782758837.027630:0:106829:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782758837.027952:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782758837.027975:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782758837.027987:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4a8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.027998:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4e00/0xdd99f5c4777dc4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4a8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758837.028009:0:5798:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782758837.028011:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9171932e8800 from 10 10000000:01000000:3.0:1782758837.028015:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782758837.028051:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.028059:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.028070:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758837.028092:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758837.028148:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.028188:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782758837.028272:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765248 00000100:00100000:2.0:1782758837.028279:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765248 00000100:00100000:2.0:1782758837.028320:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:2.0:1782758837.028328:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211765248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758837.028350:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758837.028362:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc4b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc4af expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758837.028384:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc4b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4af expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758837.028394:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695a00/0xdd99f5c4777dc4b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4af expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758837.028402:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695a00, rc 0) 00000100:00100000:2.0:1782758837.028438:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211765248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758837.028456:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:3.0:1782758837.028636:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758837.028651:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.028660:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc4b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758837.028710:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758837.028736:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.028761:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782758837.028859:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765376 00000100:00100000:1.0:1782758837.028864:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765376 00000100:00100000:1.0:1782758837.028892:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1782758837.028899:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211765376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.029172:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211765376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758837.029180:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1782758837.029217:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.029250:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.029301:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758837.029319:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765504 00000100:00100000:1.0:1782758837.029322:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765504 00000100:00100000:1.0:1782758837.029352:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1782758837.029359:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211765504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782758837.029631:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211765504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758837.029638:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1782758837.029664:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186c39600 going to sleep for 11 seconds 00000100:00100000:1.0:1782758837.029675:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211765504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782758837.034861:0:106830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782758837.037782:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782758837.037986:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782758837.037999:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758837.038012:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690400/0xdd99f5c4777dc4af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758837.167727:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211765632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.167807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.167901:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211766144:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.167931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.167961:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758837.167969:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211766016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.167991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.168021:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211765760:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.168058:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758837.168063:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211765888:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758837.168114:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765632 00000100:00100000:3.0:1782758837.168122:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765632 00000100:00100000:3.0:1782758837.168189:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766016 00000100:00100000:3.0:1782758837.168192:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766016 00000100:00100000:3.0:1782758837.168219:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765760 00000100:00100000:3.0:1782758837.168222:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765760 00000100:00100000:3.0:1782758837.168239:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:3.0:1782758837.168248:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168317:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211765632:12345-0@lo:400:kworker.0 Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.168325:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:3.0:1782758837.168355:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:3.0:1782758837.168362:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211766016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168393:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211766016:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.168398:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:3.0:1782758837.168407:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1782758837.168413:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211765760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168440:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211765760:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.168449:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1782758837.168466:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766144 00000100:00100000:3.0:1782758837.168470:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766144 00000100:00100000:3.0:1782758837.168493:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211765888 00000100:00100000:3.0:1782758837.168496:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211765888 00000100:00100000:3.0:1782758837.168515:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:3.0:1782758837.168522:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168561:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211766144:12345-0@lo:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.168567:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:3.0:1782758837.168576:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1782758837.168581:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211765888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168601:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211765888:12345-0@lo:400:kworker.0 Request processed in 21us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.168605:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00080000:3.0:1782758837.168631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758837.168634:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758837.168637:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758837.168673:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211765888:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168687:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211765760:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168719:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211766016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168729:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211765632:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.168739:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211766144:0@lo:400:kworker.0 00000100:00100000:3.0:1782758837.183379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758837.183431:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895104 00000100:00100000:3.0:1782758837.183630:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895104 00000100:00100000:3.0:1782758837.183700:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1593 00000100:00100000:3.0:1782758837.183713:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:63741:x1869355196895104:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758837.183733:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758837.183752:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dc4bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64fe6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.183784:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fe6 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.183796:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fe6 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758837.183805:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691a00, rc 0) 00000100:00100000:3.0:1782758837.183885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63741:x1869355196895104:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 174us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.183893:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1593 00000100:00100000:3.0:1782758837.189732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758837.189780:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895232 00000100:00100000:3.0:1782758837.189792:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895232 00000100:00100000:3.0:1782758837.189872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1594 00000100:00100000:3.0:1782758837.189884:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63741:x1869355196895232:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782758837.190238:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63741:x1869355196895232:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 355us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.190247:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1594 00000100:00100000:3.0:1782758837.205937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758837.206078:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895360 00000100:00100000:1.0:1782758837.206111:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895360 00000100:00100000:3.0:1782758837.206281:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1595 00000100:00100000:3.0:1782758837.206392:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63741:x1869355196895360:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782758837.207310:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:63741:x1869355196895360:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 919us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758837.207320:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1595 00000100:00100000:3.0:1782758837.679583:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211766272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758837.679688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758837.679865:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766272 00000100:00100000:0.0:1782758837.679879:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766272 00000100:00100000:0.0:1782758837.679971:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1782758837.679985:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211766272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758837.680043:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758837.680174:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211766272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758837.680185:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1782758837.680224:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211766272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758837.869329:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758838.455493:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758838.458018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758838.458060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758838.458086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758838.458133:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895872 00000100:00100000:3.0:1782758838.458145:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895872 00000100:00100000:3.0:1782758838.458210:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895744 00000100:00100000:3.0:1782758838.458214:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895744 00000100:00100000:3.0:1782758838.458244:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000100:00100000:3.0:1782758838.458253:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2361:x1869355196895872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758838.458338:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2361:x1869355196895872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758838.458344:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000100:00100000:3.0:1782758838.458361:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1626 00000100:00100000:3.0:1782758838.458367:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2361:x1869355196895744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758838.458390:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2361:x1869355196895744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758838.458396:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1626 00000100:00100000:3.0:1782758838.458415:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895488 00000100:00100000:3.0:1782758838.458418:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895488 00000100:00100000:3.0:1782758838.458447:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1596 00000100:00100000:3.0:1782758838.458453:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196895488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758838.458482:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2361:x1869355196895488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758838.458488:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1596 00000100:00080000:3.0:1782758838.458517:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758838.458520:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758838.458925:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196895616 00000100:00100000:0.0:1782758838.458931:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196895616 00000100:00100000:0.0:1782758838.458968:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2085 00000100:00100000:0.0:1782758838.458975:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2361:x1869355196895616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758838.459027:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2361:x1869355196895616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758838.459442:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2085 00000100:00080000:3.0:1782758838.461391:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758838.894404:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758839.920020:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758840.236433:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211766400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758840.236510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758840.236710:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766400 00000100:00100000:1.0:1782758840.236718:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766400 00000100:00100000:1.0:1782758840.236779:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1782758840.236789:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211766400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758840.236842:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758840.236893:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211766400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758840.236901:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1782758840.236953:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211766400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758840.237210:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758840.940031:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758841.966658:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758842.284140:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211766784:0@lo:400:kworker.0 00000100:00100000:2.0:1782758842.284225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758842.284330:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211766528:0@lo:400:kworker.0 00000100:00100000:3.0:1782758842.284362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758842.284393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758842.284400:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211766656:0@lo:400:kworker.0 00000100:00100000:3.0:1782758842.284422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758842.284454:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766784 00000100:00100000:3.0:1782758842.284473:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766784 00000100:00100000:3.0:1782758842.284521:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766656 00000100:00100000:3.0:1782758842.284524:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766656 00000100:00100000:3.0:1782758842.284547:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:3.0:1782758842.284557:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211766784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.284699:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211766912:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.284733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782758842.284773:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758842.284788:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1782758842.284795:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211766656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.284852:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211766656:12345-0@lo:400:kworker.0 Request processed in 58us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758842.284860:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1782758842.284884:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766528 00000100:00100000:1.0:1782758842.284888:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766528 00000100:00100000:1.0:1782758842.284911:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:1.0:1782758842.284917:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211766528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.284947:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211766528:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758842.284953:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:1.0:1782758842.284996:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211766656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.285007:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211766528:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.285052:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211766912 00000100:00100000:1.0:1782758842.285055:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211766912 00000100:00100000:1.0:1782758842.285088:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1782758842.285094:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211766912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.285129:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211766912:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758842.285135:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00080000:1.0:1782758842.285148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758842.285163:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211766912:0@lo:400:kworker.0 00000100:00100000:3.0:1782758842.286974:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211766784:12345-0@lo:400:kworker.0 Request processed in 2411us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758842.286989:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1782758842.288499:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211766784:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.288503:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211767040:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.288565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758842.288607:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758842.288614:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211767168:0@lo:400:kworker.0 00000100:00100000:1.0:1782758842.288639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758842.288686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767168 00000100:00100000:0.0:1782758842.288694:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767168 00000100:00100000:0.0:1782758842.288749:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:0.0:1782758842.288758:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211767168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758842.288809:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211767168:12345-0@lo:400:kworker.0 Request processed in 53us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758842.288817:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00080000:1.0:1782758842.288846:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758842.288909:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767040 00000100:00100000:2.0:1782758842.288915:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767040 00000100:00100000:2.0:1782758842.288956:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1782758842.288962:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211767040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758842.288997:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211767040:12345-0@lo:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758842.289003:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:1.0:1782758842.289063:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758842.289078:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211767168:0@lo:400:kworker.0 00000100:00100000:0.0:1782758842.289090:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211767040:0@lo:400:kworker.0 00000100:00100000:2.0:1782758842.798947:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211767296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758842.799023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758842.799173:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767296 00000100:00100000:1.0:1782758842.799181:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767296 00000100:00100000:1.0:1782758842.799251:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1782758842.799262:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211767296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758842.799306:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758842.799358:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211767296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758842.799366:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1782758842.799461:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211767296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758842.988410:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758843.578665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758843.578714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758843.578751:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758843.578791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758843.579277:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896000 00000100:00100000:1.0:1782758843.579287:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896000 00000100:00100000:1.0:1782758843.579339:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1598 00000100:00100000:1.0:1782758843.579349:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2363:x1869355196896000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758843.579441:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2363:x1869355196896000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758843.579449:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1598 00000100:00100000:1.0:1782758843.579487:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896128 00000100:00100000:1.0:1782758843.579493:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896128 00000100:00100000:1.0:1782758843.579546:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2089 00000100:00100000:1.0:1782758843.579552:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2363:x1869355196896128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758843.579582:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2363:x1869355196896128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758843.579588:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2089 00000100:00100000:1.0:1782758843.579607:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896256 00000100:00100000:1.0:1782758843.579610:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896256 00000100:00100000:1.0:1782758843.579636:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896384 00000100:00100000:1.0:1782758843.579639:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896384 00000100:00100000:1.0:1782758843.579670:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000100:00100000:1.0:1782758843.579677:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196896256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758843.579703:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196896256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758843.579709:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000100:00100000:1.0:1782758843.579720:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1630 00000100:00100000:1.0:1782758843.579726:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196896384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758843.579747:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2363:x1869355196896384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758843.579753:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1630 00000100:00080000:1.0:1782758843.579771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758843.579775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758843.579777:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1782758844.000992:0:106995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: finish setup 14:47:20 (1782758840) === 00010000:00010000:0.0:1782758844.012174:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758845.036109:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758845.356704:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211767424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758845.356781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758845.362790:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767424 00000100:00100000:3.0:1782758845.362807:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767424 00000100:00100000:3.0:1782758845.363041:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1782758845.363053:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211767424:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758845.363068:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782758845.363097:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758845.363682:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211767424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 629us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758845.363692:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1782758845.363730:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211767424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758845.931090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758845.931134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758845.931183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758845.931300:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896640 00000100:00100000:3.0:1782758845.931306:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896896 00000100:00100000:3.0:1782758845.931314:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896896 00000100:00100000:1.0:1782758845.931314:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896640 00000100:00100000:3.0:1782758845.931394:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896768 00000100:00100000:3.0:1782758845.931398:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896768 00000100:00100000:1.0:1782758845.931404:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1782758845.931445:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2192e054-ee2f-4962-9e35-ea4618b4dde3+12:2363:x1869355196896640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758845.931464:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758845.931484:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f84 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758845.931502:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758845.931561:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2192e054-ee2f-4962-9e35-ea4618b4dde3+11:2363:x1869355196896640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758845.932266:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:2.0:1782758845.932281:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2192e054-ee2f-4962-9e35-ea4618b4dde3+11:2363:x1869355196896896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758845.932293:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758845.932306:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691a00/0xdd99f5c4777dc4bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fe6 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758845.932319:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758845.932345:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2192e054-ee2f-4962-9e35-ea4618b4dde3+10:2363:x1869355196896896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758845.932353:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1782758845.942079:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1782758845.942114:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2192e054-ee2f-4962-9e35-ea4618b4dde3+9:2363:x1869355196896768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782758845.942138:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758845.942172:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51800/0xdd99f5c4777dc45b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fae expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758845.942190:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758845.942349:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2192e054-ee2f-4962-9e35-ea4618b4dde3+8:2363:x1869355196896768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 249us (11164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758845.942359:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1782758845.942451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758845.942594:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196896512 00000100:00100000:3.0:1782758845.942602:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196896512 00000100:00100000:3.0:1782758845.942645:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:3.0:1782758845.942652:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2360:x1869355196896512:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782758845.942678:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc477 00000100:00080000:3.0:1782758845.942686:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782758845.942721:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1782758845.942951:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00080000:1.0:1782758845.942995:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782758845.943010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758845.943181:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+2:2360:x1869355196896512:12345-192.168.204.31@tcp:9:umount.0 Request processed in 528us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758845.943189:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:3.0:1782758845.947077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758845.947816:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897024 00000100:00100000:1.0:1782758845.947838:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897024 00000100:00080000:2.0:1782758845.947898:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758845.947914:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:1.0:1782758845.947924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+5:2360:x1869355196897024:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:1.0:1782758845.947956:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc470 00000100:00080000:1.0:1782758845.947964:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171bc199000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782758845.948012:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00010000:00010000:2.0:1782758845.948058:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758845.948289:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b41f5e30-c84e-4368-8f14-cecc88662c13+2:2360:x1869355196897024:12345-192.168.204.31@tcp:9:umount.0 Request processed in 365us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758845.948301:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:2.0:1782758845.971338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758845.972340:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897280 00000100:00100000:3.0:1782758845.972353:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897280 00000100:00100000:3.0:1782758845.972456:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1268 00000100:00100000:3.0:1782758845.972471:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+6:2360:x1869355196897280:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1782758845.972506:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc469 00000020:00010000:3.0:1782758845.974186:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917084d24000: total 0 00000100:00080000:3.0:1782758845.974194:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917084d20000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782758845.974235:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967784 00000100:00080000:2.0:1782758845.974363:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1782758845.974799:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917084d24000: total 0 00010000:00010000:1.0:1782758845.974805:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758845.974880:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917084d24000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758845.974920:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6900) 00010000:00010000:1.0:1782758845.974923:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758845.974935:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694200/0xdd99f5c4777dc485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64fdf expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758845.974962:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917084d24000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782758845.974973:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758845.974975:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758845.974977:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758845.985514:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b41f5e30-c84e-4368-8f14-cecc88662c13+3:2360:x1869355196897280:12345-192.168.204.31@tcp:39:umount.0 Request processed in 13034us (14172us total) trans 4294967785 rc 0/0 00000100:00100000:0.0:1782758845.985529:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1268 00000100:00100000:2.0:1782758846.041450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758846.042149:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897536 00000100:00100000:1.0:1782758846.042171:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897536 00000100:00100000:1.0:1782758846.042242:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1599 00000100:00100000:1.0:1782758846.042252:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+7:2360:x1869355196897536:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:1.0:1782758846.042290:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc446 00000020:00010000:1.0:1782758846.042298:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917084d21000: total 0 00000100:00080000:1.0:1782758846.042303:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917084d24800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1782758846.042391:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917084d21000: total 0 00000100:00100000:1.0:1782758846.042394:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2192e054-ee2f-4962-9e35-ea4618b4dde3+3:2360:x1869355196897536:12345-192.168.204.31@tcp:251:umount.0 Request processed in 141us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758846.042405:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1599 00010000:00010000:2.0:1782758846.042446:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917084d21000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782758846.042490:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc44d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64f7d expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758846.042509:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917084d21000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782758846.042518:0:5789:0:(genops.c:906:class_export_put()) final put ffff917084d21000/2192e054-ee2f-4962-9e35-ea4618b4dde3 00010000:00010000:2.0:1782758846.042540:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758846.042543:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758846.042545:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758846.046239:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d21000/2192e054-ee2f-4962-9e35-ea4618b4dde3 for MGS 00000020:00000080:1.0:1782758846.046327:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d24800 for MGS 00010000:00010000:2.0:1782758846.060666:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758847.096014:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758847.411801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758847.411882:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758847.411904:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211767680:0@lo:400:kworker.0 00000100:00100000:2.0:1782758847.411981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758847.412051:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767680 00000100:00100000:2.0:1782758847.412059:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767680 00000100:00100000:2.0:1782758847.412106:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:2.0:1782758847.412116:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211767680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758847.412183:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211767680:12345-0@lo:400:kworker.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758847.412190:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:2.0:1782758847.412234:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211767680:0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.415579:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211767552:0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.415663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758847.415787:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767552 00000100:00100000:2.0:1782758847.415796:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767552 00000100:00100000:2.0:1782758847.415867:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:2.0:1782758847.415878:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211767552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758847.415933:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211767552:12345-0@lo:400:kworker.0 Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758847.415940:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1782758847.416087:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211767552:0@lo:400:kworker.0 00000100:00100000:2.0:1782758847.418149:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211767808:0@lo:400:kworker.0 00000100:00100000:2.0:1782758847.418224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758847.418301:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767808 00000100:00100000:3.0:1782758847.418311:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767808 00000100:00100000:3.0:1782758847.418381:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1782758847.418393:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211767808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758847.419034:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211767936:0@lo:400:kworker.0 00000100:00100000:0.0:1782758847.419073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758847.423331:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211767808:12345-0@lo:400:kworker.0 Request processed in 4924us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758847.423348:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00080000:3.0:1782758847.423406:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758847.431489:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211767936 00000100:00100000:1.0:1782758847.431500:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211767936 00000100:00100000:3.0:1782758847.431595:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211768064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.431661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758847.431702:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758847.431710:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211768192:0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.431736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758847.431763:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768064 00000100:00100000:3.0:1782758847.431766:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768064 00000100:00100000:3.0:1782758847.431834:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1782758847.431844:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211768064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.431896:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211768064:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758847.431903:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1782758847.431925:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768192 00000100:00100000:3.0:1782758847.431928:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768192 00000100:00100000:3.0:1782758847.431951:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1782758847.431957:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211768192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.431987:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211768192:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758847.431997:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00080000:3.0:1782758847.432013:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758847.432018:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758847.432045:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211768192:0@lo:400:kworker.0 00000100:00100000:3.0:1782758847.432055:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211768064:0@lo:400:kworker.0 00000100:00100000:1.0:1782758847.432163:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1782758847.432170:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211767936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758847.432213:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211767936:12345-0@lo:400:kworker.0 Request processed in 44us (13139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758847.432220:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1782758847.432257:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211767936:0@lo:400:kworker.0 00000100:00080000:1.0:1782758847.432270:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758847.434043:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211767808:0@lo:400:kworker.0 00000100:00100000:1.0:1782758847.930474:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211768320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758847.930561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758847.930654:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768320 00000100:00100000:1.0:1782758847.930662:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768320 00000100:00100000:1.0:1782758847.930711:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1782758847.930720:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211768320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758847.930757:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758847.930801:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211768320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758847.930806:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1782758847.930876:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211768320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758848.107959:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758849.132455:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758849.831705:0:107140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7ca3e720 20000000:00000080:3.0:1782758849.831725:0:107140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2daa400 uarg=0000000000000000 10000000:01000000:2.0:1782758849.934962:0:107140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758849.934987:0:107140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.935007:0:107140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.935017:0:107140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.935052:0:107140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.935066:0:107140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 18 pid: 5793 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758849.935079:0:107140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107140:1869355211768448:0@lo:104: 00000100:00100000:2.0:1782758849.935156:0:107140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758849.935280:0:107140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1782758849.937188:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782758849.937216:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768448 00000100:00100000:0.0:1782758849.937227:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768448 00000100:00100000:0.0:1782758849.937279:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1782758849.937288:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917185b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107140:x1869355211768448:12345-0@lo:104: 00010000:00010000:0.0:1782758849.937305:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758849.937652:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758849.937660:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917185b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107140:x1869355211768448:12345-0@lo:104: Request processed in 372us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758849.937668:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1782758849.937756:0:107140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107140:1869355211768448:0@lo:104: 00010000:00010000:2.0:1782758849.937778:0:107140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.937913:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758849.937921:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.937929:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758849.937933:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.937947:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758849.937955:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758849.937960:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758849.938037:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938044:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758849.938094:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938103:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc3eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc3f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938123:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758849.938126:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758849.938127:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758849.938178:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758849.938197:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211768576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758849.938243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758849.938330:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768576 00000100:00100000:1.0:1782758849.938335:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768576 00010000:00010000:1.0:1782758849.938371:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 19 pid: 5793 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758849.938437:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1782758849.938445:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211768576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758849.938458:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758849.938463:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 19 pid: 5793 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938474:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 19 pid: 5793 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938488:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc3f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc3eb expref: 19 pid: 5793 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938502:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938510:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938526:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938533:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938540:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938558:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938564:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758849.938568:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938575:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938590:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758849.938599:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758849.938637:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211768576:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758849.938644:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:2.0:1782758849.938771:0:107140:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.938779:0:107140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758849.938785:0:107140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc4c4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758849.944693:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211768576:0@lo:103:ldlm_bl.0 00000001:00100000:3.0:1782758850.042786:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00000001:00080000:3.0:1782758850.042814:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967785 is committed 00000020:00000080:3.0:1782758850.042849:0:5824:0:(genops.c:906:class_export_put()) final put ffff917084d24000/b41f5e30-c84e-4368-8f14-cecc88662c13 00000020:00000080:2.0:1782758850.042894:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d24000/b41f5e30-c84e-4368-8f14-cecc88662c13 for lustre-MDT0000 00000020:00000080:2.0:1782758850.042958:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d20000 for lustre-MDT0000 00010000:00010000:2.0:1782758850.158925:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758850.476966:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211768704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758850.477046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758850.477155:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768704 00000100:00100000:1.0:1782758850.477164:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768704 00000100:00100000:1.0:1782758850.477226:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1782758850.477237:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211768704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758850.477298:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758850.477351:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211768704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758850.477374:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:1.0:1782758850.477608:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758850.477899:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211768704:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1782758850.581681:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00000020:00000080:2.0:1782758850.581691:0:7507:0:(genops.c:906:class_export_put()) final put ffff9171bb696000/b41f5e30-c84e-4368-8f14-cecc88662c13 00000020:00000080:2.0:1782758850.581724:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bb696000/b41f5e30-c84e-4368-8f14-cecc88662c13 for lustre-OST0001 00000020:00000080:2.0:1782758850.581766:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bb693000 for lustre-OST0001 00000001:00100000:3.0:1782758850.585485:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b41f5e30-c84e-4368-8f14-cecc88662c13 00000020:00000080:3.0:1782758850.585494:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171bc198000/b41f5e30-c84e-4368-8f14-cecc88662c13 00000020:00000080:2.0:1782758850.585649:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bc198000/b41f5e30-c84e-4368-8f14-cecc88662c13 for lustre-OST0000 00000020:00000080:2.0:1782758850.585789:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bc199000 for lustre-OST0000 00010000:00010000:1.0:1782758851.216652:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758851.495211:0:107192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff432d1a40 20000000:00000080:3.0:1782758851.495229:0:107192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2da8c00 uarg=0000000000000000 10000000:01000000:3.0:1782758851.502326:0:107192:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758851.502358:0:107192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502376:0:107192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502388:0:107192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502394:0:107192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502401:0:107192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502409:0:107192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502415:0:107192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758851.502419:0:107192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502427:0:107192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502440:0:107192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502447:0:107192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.502454:0:107192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc4cb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758851.884910:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758851.884922:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758851.884929:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758851.884990:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758851.885016:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758851.885029:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758851.885068:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211768832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758851.885154:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758851.885304:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758851.891867:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768832 00000100:00100000:3.0:1782758851.891883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768832 00000100:00100000:3.0:1782758851.892141:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1782758851.892154:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211768832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758851.892174:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758851.892196:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc4d2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.892232:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.892243:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758851.892251:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782758851.892337:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211768832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (7182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758851.892345:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:0.0:1782758851.893608:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211768832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758851.893641:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758851.893654:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758851.893681:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758851.893688:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758851.893702:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758852.204087:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758852.523045:0:107240:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd627fcfc0 20000000:00000080:0.0:1782758852.523067:0:107240:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312f800 uarg=0000000000000000 10000000:01000000:0.0:1782758852.523282:0:107240:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758852.523301:0:107240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758852.523318:0:107240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758852.523326:0:107240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758852.524256:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211768960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758852.524382:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211769472:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.524389:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211768960 00000100:00100000:3.0:1782758852.524396:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211768960 00000100:00100000:2.0:1782758852.524408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758852.524430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758852.524435:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211769344:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.524439:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1782758852.524448:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211768960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758852.524479:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211769088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.524499:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211768960:12345-0@lo:400:kworker.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758852.524501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758852.524506:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:2.0:1782758852.524516:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758852.524520:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211769216:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.524521:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769344 00000100:00100000:3.0:1782758852.524523:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769344 00000100:00100000:2.0:1782758852.524540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758852.524545:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769088 00000100:00100000:3.0:1782758852.524548:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769088 00000100:00100000:3.0:1782758852.524563:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:2.0:1782758852.524564:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769472 00000100:00100000:2.0:1782758852.524567:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769472 00000100:00100000:3.0:1782758852.524568:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211769344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524594:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769216 00000100:00100000:3.0:1782758852.524596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211769344:12345-0@lo:400:kworker.0 Request processed in 27us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758852.524596:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769216 00000100:00100000:3.0:1782758852.524601:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1782758852.524612:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1782758852.524614:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1782758852.524618:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211769088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524619:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211769472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524643:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211769472:12345-0@lo:400:kworker.0 Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758852.524644:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211769088:12345-0@lo:400:kworker.0 Request processed in 27us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758852.524649:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1782758852.524650:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1782758852.524664:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1782758852.524669:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211769216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758852.524696:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211769216:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758852.524702:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00080000:1.0:1782758852.525006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758852.525012:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758852.525014:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782758852.525931:0:107240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758852.525947:0:107240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 18 pid: 5793 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758852.525961:0:107240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107240:1869355211769600:0@lo:104: 00000100:00100000:0.0:1782758852.526005:0:107240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758852.526047:0:107240:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758852.528264:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769600 00000100:00100000:3.0:1782758852.528279:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769600 00000100:00100000:1.0:1782758852.528536:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211769216:0@lo:400:kworker.0 00000100:00100000:1.0:1782758852.528554:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211769088:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.528680:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782758852.528690:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107240:x1869355211769600:12345-0@lo:104: 00010000:00010000:3.0:1782758852.528714:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758852.528801:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758852.528808:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107240:x1869355211769600:12345-0@lo:104: Request processed in 120us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758852.528814:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782758852.528874:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211769344:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.528888:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211768960:0@lo:400:kworker.0 00000100:00100000:3.0:1782758852.528900:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211769472:0@lo:400:kworker.0 00000100:00100000:1.0:1782758852.529022:0:107240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107240:1869355211769600:0@lo:104: 00010000:00010000:1.0:1782758852.529050:0:107240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530364:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758852.530374:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530384:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758852.530388:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530398:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758852.530405:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758852.530412:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758852.530464:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530471:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758852.530502:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530510:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50c00/0xdd99f5c4777dc4d2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4d9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758852.530514:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782758852.530528:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758852.530530:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758852.530530:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211769728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758852.530532:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758852.530591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758852.530685:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769728 00000100:00100000:2.0:1782758852.530691:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769728 00010000:00010000:2.0:1782758852.530729:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758852.530763:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1782758852.530772:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211769728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758852.530786:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758852.530792:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530803:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530817:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc4d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc4d2 expref: 19 pid: 5793 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530858:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530867:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530883:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530890:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530897:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530903:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530907:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758852.530912:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530918:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530933:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758852.530943:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758852.530981:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211769728:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758852.530988:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1782758852.531029:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211769728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758852.531133:0:107240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758852.531141:0:107240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758852.531147:0:107240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc4e0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758853.036377:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211769856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758853.036459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758853.037259:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769856 00000100:00100000:3.0:1782758853.037270:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769856 00000100:00100000:3.0:1782758853.037368:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1782758853.037378:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211769856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758853.037420:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758853.037723:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211769856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758853.037735:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1782758853.037800:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211769856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758853.229941:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758853.608748:0:107289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdf9d8bd0 20000000:00000080:2.0:1782758853.608765:0:107289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf5a000 uarg=0000000000000000 10000000:01000000:2.0:1782758853.609046:0:107289:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758853.609068:0:107289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609086:0:107289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609099:0:107289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609107:0:107289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609114:0:107289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609122:0:107289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609128:0:107289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758853.609132:0:107289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609140:0:107289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609153:0:107289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609162:0:107289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758853.609169:0:107289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4e7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758853.869094:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758853.869102:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758853.869107:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758853.869160:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758853.869176:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758853.869266:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758853.869296:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211769984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758853.869435:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758853.869586:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782758853.869813:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211769984 00000100:00100000:1.0:1782758853.869846:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211769984 00000100:00100000:1.0:1782758853.869981:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:1.0:1782758853.869991:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211769984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758853.870019:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758853.870034:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc4ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758853.870059:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758853.870071:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758853.870081:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782758853.870121:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211769984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758853.870129:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:0.0:1782758853.870293:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211769984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758853.870311:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758853.870320:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758853.870416:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758853.870422:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758853.870429:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758854.252363:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758855.276293:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758855.598044:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211770112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758855.598116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758855.598275:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770112 00000100:00100000:1.0:1782758855.598284:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770112 00000100:00100000:1.0:1782758855.598341:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1782758855.598352:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211770112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758855.598388:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758855.598435:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211770112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758855.598441:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:1.0:1782758855.598484:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758855.598775:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211770112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758856.305201:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758857.324041:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758857.646251:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211770368:0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.646334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758857.646350:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758857.646364:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211770240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758857.646397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758857.646437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770240 00000100:00100000:1.0:1782758857.646445:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770240 00000100:00100000:1.0:1782758857.646535:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:1.0:1782758857.646548:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.646560:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758857.646567:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211770496:0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.646591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758857.646617:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211770240:12345-0@lo:400:kworker.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758857.646626:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1782758857.646899:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211770240:0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.647124:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211770880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758857.647124:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211770624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.647157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758857.647220:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770368 00000100:00100000:3.0:1782758857.647224:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770368 00000100:00100000:1.0:1782758857.647224:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211770752:0@lo:400:kworker.0 00000100:00100000:3.0:1782758857.647253:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770496 00000100:00100000:1.0:1782758857.647264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758857.647265:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770496 00000100:00100000:3.0:1782758857.647290:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1782758857.647292:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770752 00000100:00100000:1.0:1782758857.647295:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770752 00000100:00100000:3.0:1782758857.647297:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211770368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758857.647312:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1782758857.647316:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758857.647359:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770880 00000100:00100000:0.0:1782758857.647363:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770880 00000100:00100000:0.0:1782758857.647394:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1782758857.647401:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211770880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758857.647439:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211770880:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758857.647445:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1782758857.647466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758857.647481:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211770880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758857.647528:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211770368:0@lo:400:kworker.0 00000100:00080000:0.0:1782758857.648185:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758857.648191:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758857.649465:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211770496:12345-0@lo:400:kworker.0 Request processed in 2142us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758857.649480:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1782758857.649511:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1782758857.649525:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758857.649591:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211770752:12345-0@lo:400:kworker.0 Request processed in 73us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758857.649597:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1782758857.649883:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211770752:0@lo:400:kworker.0 00000100:00100000:0.0:1782758857.649968:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211770496:0@lo:400:kworker.0 00000100:00100000:3.0:1782758857.650105:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211770368:12345-0@lo:400:kworker.0 Request processed in 2807us (3770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758857.650113:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1782758857.650142:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211770624 00000100:00100000:3.0:1782758857.650149:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211770624 00000100:00100000:3.0:1782758857.650236:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:3.0:1782758857.650255:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211770624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758857.650304:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211770624:12345-0@lo:400:kworker.0 Request processed in 62us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758857.650310:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00080000:0.0:1782758857.650444:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758857.650516:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211770624:0@lo:400:kworker.0 00000020:00000080:2.0:1782758857.832567:0:107486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb9132d60 20000000:00000080:2.0:1782758857.832584:0:107486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf58400 uarg=0000000000000000 10000000:01000000:2.0:1782758857.833979:0:107486:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758857.834005:0:107486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.834025:0:107486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.834034:0:107486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.834075:0:107486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.834095:0:107486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 18 pid: 5794 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758857.834114:0:107486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107486:1869355211771008:0@lo:104: 00000100:00100000:2.0:1782758857.834186:0:107486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758857.834237:0:107486:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1782758857.834322:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771008 00000100:00100000:0.0:1782758857.834330:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771008 00000100:00100000:0.0:1782758857.834387:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1782758857.834399:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107486:x1869355211771008:12345-0@lo:104: 00010000:00010000:0.0:1782758857.834414:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758857.834492:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758857.834498:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107486:x1869355211771008:12345-0@lo:104: Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758857.834505:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00010000:00010000:1.0:1782758857.834574:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758857.834583:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834590:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758857.834594:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834603:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758857.834615:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758857.834620:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758857.834654:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834661:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758857.834684:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834690:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51000/0xdd99f5c4777dc4ee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc4f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834706:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758857.834708:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758857.834710:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758857.834721:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211771136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758857.834751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758857.834786:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771136 00000100:00100000:1.0:1782758857.834790:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771136 00010000:00010000:1.0:1782758857.834810:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 19 pid: 5794 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758857.834857:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1782758857.834864:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211771136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758857.834874:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758857.834879:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 19 pid: 5794 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834890:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 19 pid: 5794 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834905:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834913:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834937:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834944:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834951:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834958:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834963:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758857.834967:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834974:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834981:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758857.834995:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758857.835023:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211771136:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758857.835029:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1782758857.835068:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211771136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758857.835252:0:107486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc4f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc4ee expref: 18 pid: 5794 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758857.835262:0:107486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107486:1869355211771008:0@lo:104: 00010000:00010000:2.0:1782758857.835274:0:107486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.835283:0:107486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.835289:0:107486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758857.835296:0:107486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc4fc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758858.156606:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211771264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758858.156688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758858.156808:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771264 00000100:00100000:0.0:1782758858.156817:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771264 00000100:00100000:0.0:1782758858.156909:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1782758858.156919:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211771264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758858.156972:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758858.157027:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211771264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758858.157035:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1782758858.157092:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211771264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758858.352074:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758859.308142:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758859.308155:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758859.308162:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758859.308361:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758859.308377:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758859.308392:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758859.308427:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211771392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758859.308526:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758859.308600:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6240 going to sleep for 11 seconds 00000100:00100000:1.0:1782758859.309515:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771392 00000100:00100000:1.0:1782758859.309527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771392 00000100:00100000:1.0:1782758859.309606:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1782758859.309618:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211771392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758859.309639:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758859.309663:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc503 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758859.309698:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758859.309722:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758859.309733:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782758859.309812:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211771392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758859.309863:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1782758859.310117:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211771392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758859.310141:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758859.310152:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758859.310177:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758859.310183:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758859.310196:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758859.373144:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758860.396513:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758860.722253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758860.722291:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211771520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758860.722377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758860.722479:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771520 00000100:00100000:2.0:1782758860.722488:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771520 00000100:00100000:2.0:1782758860.722549:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1782758860.722559:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211771520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758860.722595:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758860.722637:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211771520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758860.722644:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00080000:2.0:1782758860.722662:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758860.724034:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211771520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758861.421142:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758861.785817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.785937:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897664 00000100:00100000:1.0:1782758861.785949:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897664 00000100:00100000:1.0:1782758861.786000:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1605 00000100:00100000:1.0:1782758861.786008:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355196897664:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782758861.786033:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from adcdaf9e-8a6b-4257-bb38-d6c55dc444fd@192.168.204.31@tcp t0 exp 0000000000000000 cur 2930 last 0 00000020:00000080:1.0:1782758861.786062:0:5794:0:(genops.c:1406:class_connect()) connect: client adcdaf9e-8a6b-4257-bb38-d6c55dc444fd, cookie 0xdd99f5c4777dc511 00000100:00080000:1.0:1782758861.786106:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9171bb696000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758861.786288:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+5:2360:x1869355196897664:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 278us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.786297:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1605 00000100:00100000:2.0:1782758861.818797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.819707:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897792 00000100:00100000:1.0:1782758861.819728:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897792 00000100:00100000:1.0:1782758861.819794:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1606 00000100:00100000:1.0:1782758861.819805:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+5:64806:x1869355196897792:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758861.819863:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758861.819883:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf64ffb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.819912:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ffb expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.819924:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ffb expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.819938:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782758861.819990:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+6:64806:x1869355196897792:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 186us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.819997:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1606 00000100:00100000:3.0:1782758861.822747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.822817:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196897920 00000100:00100000:2.0:1782758861.822858:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196897920 00000100:00100000:2.0:1782758861.822911:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1607 00000100:00100000:2.0:1782758861.822920:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+6:64806:x1869355196897920:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782758861.823199:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+6:64806:x1869355196897920:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 279us (460us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782758861.823207:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1607 00000100:00100000:0.0:1782758861.829669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.829969:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898048 00000100:00100000:2.0:1782758861.829980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898048 00000100:00100000:2.0:1782758861.830089:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1608 00000100:00100000:2.0:1782758861.830106:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+6:64806:x1869355196898048:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782758861.830122:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758861.830137:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65002 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.830171:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65002 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.830181:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65002 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.830188:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782758861.830254:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+7:64806:x1869355196898048:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 148us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.830262:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1608 00000100:00100000:3.0:1782758861.832575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.832660:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898176 00000100:00100000:1.0:1782758861.832669:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898176 00000100:00100000:1.0:1782758861.833077:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1609 00000100:00100000:1.0:1782758861.833089:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+7:64806:x1869355196898176:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782758861.833716:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64806:x1869355196898176:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 627us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.833725:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1609 00000100:00100000:3.0:1782758861.849555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.849684:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898304 00000100:00100000:2.0:1782758861.849703:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898304 00000100:00100000:2.0:1782758861.849762:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1610 00000100:00100000:2.0:1782758861.849782:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64806:x1869355196898304:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782758861.850078:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64806:x1869355196898304:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 298us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.850086:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1610 00000100:00100000:0.0:1782758861.858800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.859216:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898432 00000100:00100000:2.0:1782758861.859225:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898432 00000100:00100000:2.0:1782758861.859287:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1611 00000100:00100000:2.0:1782758861.859296:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64825:x1869355196898432:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782758861.859573:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64825:x1869355196898432:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 277us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.859581:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1611 00000100:00100000:3.0:1782758861.893363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.893560:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898560 00000100:00100000:1.0:1782758861.893571:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898560 00000100:00100000:1.0:1782758861.893631:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1612 00000100:00100000:1.0:1782758861.893641:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64825:x1869355196898560:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782758861.894016:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64825:x1869355196898560:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 375us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.894025:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1612 00000100:00100000:0.0:1782758861.899898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.900388:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898688 00000100:00100000:1.0:1782758861.900400:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898688 00000100:00100000:1.0:1782758861.900463:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1613 00000100:00100000:1.0:1782758861.900474:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:64806:x1869355196898688:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758861.900493:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758861.900518:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6502c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.900548:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6502c expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.900561:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6502c expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758861.900571:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758861.900631:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+9:64806:x1869355196898688:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 158us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.900648:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1613 00000100:00100000:0.0:1782758861.904960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.905110:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898816 00000100:00100000:2.0:1782758861.905121:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898816 00000100:00100000:2.0:1782758861.905186:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1614 00000100:00100000:2.0:1782758861.905197:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+9:64806:x1869355196898816:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782758861.905220:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782758861.905242:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782758861.905245:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782758861.905248:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782758861.905250:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782758861.911228:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+9:64806:x1869355196898816:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 6023us (6267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.911243:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1614 00000100:00100000:0.0:1782758861.929693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.929870:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196898944 00000100:00100000:2.0:1782758861.929881:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196898944 00000100:00100000:2.0:1782758861.929949:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1615 00000100:00100000:2.0:1782758861.929960:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+9:64806:x1869355196898944:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782758861.929990:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758861.930007:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc52d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65033 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.930041:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc52d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65033 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.930052:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc52d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65033 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758861.930062:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695c00, rc 0) 00000100:00100000:2.0:1782758861.930128:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64806:x1869355196898944:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 169us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.930135:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1615 00000100:00100000:0.0:1782758861.935730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758861.935949:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899072 00000100:00100000:2.0:1782758861.935959:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899072 00000100:00100000:2.0:1782758861.936028:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1616 00000100:00100000:2.0:1782758861.936039:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64806:x1869355196899072:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782758861.936360:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64806:x1869355196899072:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 323us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758861.936368:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1616 00000100:00100000:0.0:1782758861.942947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758861.951479:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899200 00000100:00100000:3.0:1782758861.951497:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899200 00000100:00100000:3.0:1782758861.951584:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00100000:3.0:1782758861.951596:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64806:x1869355196899200:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782758861.952480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64806:x1869355196899200:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 882us (9539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758861.952489:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1617 00000100:00100000:0.0:1782758861.968698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758861.969157:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899328 00000100:00100000:1.0:1782758861.969167:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899328 00000100:00100000:1.0:1782758861.969558:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1618 00000100:00100000:1.0:1782758861.969569:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64830:x1869355196899328:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782758861.969870:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64830:x1869355196899328:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 302us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758861.969878:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1618 00000100:00100000:0.0:1782758862.009956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758862.011893:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899456 00000100:00100000:2.0:1782758862.011907:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899456 00000100:00100000:2.0:1782758862.011971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1619 00000100:00100000:2.0:1782758862.011981:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64830:x1869355196899456:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782758862.012264:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:64830:x1869355196899456:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 282us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758862.012273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1619 00000100:00100000:0.0:1782758862.020040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758862.020256:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899584 00000100:00100000:2.0:1782758862.020268:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899584 00000100:00100000:2.0:1782758862.020318:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1269 00000100:00100000:2.0:1782758862.020326:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355196899584:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782758862.020355:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 28523624-e8ee-4ffc-a0c3-eabe66c3aef1@192.168.204.31@tcp t0 exp 0000000000000000 cur 2930 last 0 00000020:00000080:2.0:1782758862.020410:0:5802:0:(genops.c:1406:class_connect()) connect: client 28523624-e8ee-4ffc-a0c3-eabe66c3aef1, cookie 0xdd99f5c4777dc534 00000004:00100000:2.0:1782758862.020443:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782758862.020693:0:5802:0:(import.c:65:import_set_state_nolock()) ffff9171b7608000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782758862.021172:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:2360:x1869355196899584:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 438us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758862.021183:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1269 00000100:00100000:0.0:1782758862.030007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758862.030103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758862.030734:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899712 00000100:00100000:3.0:1782758862.030746:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899712 00000100:00100000:3.0:1782758862.030871:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899840 00000100:00100000:3.0:1782758862.030875:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899840 00000100:00100000:3.0:1782758862.030900:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000100:00100000:3.0:1782758862.030910:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+7:0:x1869355196899712:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782758862.030957:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1782758862.031032:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+7:0:x1869355196899712:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 123us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758862.031040:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1270 00000100:00100000:3.0:1782758862.031061:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1271 00000100:00100000:3.0:1782758862.031068:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196899840:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782758862.031079:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1782758862.031100:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196899840:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 34us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758862.031106:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1271 00000100:00080000:0.0:1782758862.031588:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758862.040310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758862.040410:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196899968 00000100:00100000:2.0:1782758862.040420:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196899968 00000100:00100000:2.0:1782758862.040477:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1272 00000100:00100000:2.0:1782758862.040488:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196899968:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782758862.040577:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196899968:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758862.040585:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1272 00000100:00100000:0.0:1782758862.051637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758862.051695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758862.051741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758862.051921:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900096 00000100:00100000:1.0:1782758862.051931:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900096 00000100:00100000:1.0:1782758862.051974:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900224 00000100:00100000:1.0:1782758862.051977:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900224 00000100:00100000:1.0:1782758862.051999:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 704 00000100:00100000:1.0:1782758862.052007:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196900096:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782758862.052040:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 28523624-e8ee-4ffc-a0c3-eabe66c3aef1@192.168.204.31@tcp t0 exp 0000000000000000 cur 2930 last 0 00000020:00000080:1.0:1782758862.052072:0:6599:0:(genops.c:1406:class_connect()) connect: client 28523624-e8ee-4ffc-a0c3-eabe66c3aef1, cookie 0xdd99f5c4777dc53b 00002000:00100000:1.0:1782758862.052086:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28523624-e8ee-4ffc-a0c3-eabe66c3aef1/ffff9171bb694800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782758862.052097:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782758862.052351:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782758862.052379:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758862.052444:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:2360:x1869355196900096:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 436us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.052452:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 704 00000100:00100000:1.0:1782758862.052474:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:1.0:1782758862.052479:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196900224:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782758862.052496:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 28523624-e8ee-4ffc-a0c3-eabe66c3aef1@192.168.204.31@tcp t0 exp 0000000000000000 cur 2930 last 0 00000020:00000080:1.0:1782758862.052512:0:6599:0:(genops.c:1406:class_connect()) connect: client 28523624-e8ee-4ffc-a0c3-eabe66c3aef1, cookie 0xdd99f5c4777dc542 00002000:00100000:1.0:1782758862.052519:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28523624-e8ee-4ffc-a0c3-eabe66c3aef1/ffff91719027e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782758862.052535:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782758862.052651:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782758862.052669:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917184f29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758862.052693:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:2360:x1869355196900224:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 213us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.052700:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:3.0:1782758862.053037:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900352 00000100:00100000:3.0:1782758862.053043:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900352 00000100:00100000:3.0:1782758862.053136:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:3.0:1782758862.053144:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196900352:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782758862.053324:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782758862.053438:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:64806:x1869355196900352:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 295us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758862.053446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 129 00010000:00010000:1.0:1782758862.444985:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758862.764193:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211771648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.764309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758862.764657:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211772032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758862.764697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758862.764722:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758862.764729:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211771904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758862.764758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758862.764874:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211771776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.764905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758862.764924:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211772288:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.764949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758862.764971:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758862.764976:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211772160:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.764999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758862.765039:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771904 00000100:00100000:1.0:1782758862.765049:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771904 00000100:00100000:1.0:1782758862.765199:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771776 00000100:00100000:1.0:1782758862.765203:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771776 00000100:00100000:1.0:1782758862.765224:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772160 00000100:00100000:1.0:1782758862.765228:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772160 00000100:00100000:1.0:1782758862.765250:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1782758862.765260:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211771904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765327:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211771904:12345-0@lo:400:kworker.0 Request processed in 67us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.765335:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1782758862.765363:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1782758862.765369:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211771776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765403:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211771776:12345-0@lo:400:kworker.0 Request processed in 34us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.765409:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1782758862.765422:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1782758862.765428:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765455:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211772160:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.765461:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00080000:1.0:1782758862.765486:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758862.765501:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772032 00000100:00100000:1.0:1782758862.765506:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772032 00000100:00100000:1.0:1782758862.765538:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772288 00000100:00100000:1.0:1782758862.765541:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772288 00000100:00100000:1.0:1782758862.765561:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:1.0:1782758862.765567:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765600:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211772032:12345-0@lo:400:kworker.0 Request processed in 33us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.765606:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:1.0:1782758862.765618:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1782758862.765624:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211772288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765649:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211772288:12345-0@lo:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758862.765654:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00080000:1.0:1782758862.765672:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758862.765675:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758862.765708:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211771904:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765721:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211772032:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765760:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211772160:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765771:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211771776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758862.765779:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211772288:0@lo:400:kworker.0 00000100:00100000:2.0:1782758862.768300:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211771648 00000100:00100000:2.0:1782758862.768318:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211771648 00000100:00100000:2.0:1782758862.768400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:2.0:1782758862.768411:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758862.768543:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211771648:12345-0@lo:400:kworker.0 Request processed in 134us (4235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758862.768551:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:3.0:1782758862.768867:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211771648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758863.276387:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211772416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758863.276507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758863.277361:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772416 00000100:00100000:2.0:1782758863.277373:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772416 00000100:00100000:2.0:1782758863.277463:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1782758863.277474:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211772416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758863.277506:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758863.277578:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211772416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758863.277586:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1782758863.277709:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211772416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758863.469526:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758864.495794:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782758865.388878:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00010000:00010000:1.0:1782758865.516118:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758865.852355:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211772544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758865.852454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758865.852907:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772544 00000100:00100000:1.0:1782758865.852918:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772544 00000100:00100000:1.0:1782758865.852987:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1782758865.857211:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211772544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758865.857280:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758865.857411:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211772544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4414us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758865.857424:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00080000:1.0:1782758865.857618:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758865.857684:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211772544:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782758865.912817:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000001:00100000:0.0:1782758865.924015:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00010000:00010000:0.0:1782758866.544155:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758867.127302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758867.127356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758867.127403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758867.127441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758867.127527:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900480 00000100:00100000:3.0:1782758867.127549:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900480 00000100:00100000:3.0:1782758867.127620:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00100000:3.0:1782758867.127630:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196900480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758867.127698:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196900480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758867.127705:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1621 00000100:00100000:1.0:1782758867.130245:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900608 00000100:00100000:1.0:1782758867.130261:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900608 00000100:00100000:1.0:1782758867.130362:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2102 00000100:00100000:1.0:1782758867.130376:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758867.130455:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758867.130463:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2102 00000100:00100000:1.0:1782758867.130496:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900864 00000100:00100000:1.0:1782758867.130500:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900864 00000100:00100000:1.0:1782758867.130526:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900736 00000100:00100000:1.0:1782758867.130529:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900736 00000100:00100000:3.0:1782758867.130977:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1639 00000100:00100000:3.0:1782758867.130988:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758867.131026:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (3668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758867.131032:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1639 00000100:00100000:1.0:1782758867.131107:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1640 00000100:00100000:1.0:1782758867.131114:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758867.131141:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196900736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758867.131148:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1640 00000100:00080000:0.0:1782758867.132448:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758867.132457:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758867.132461:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758867.568193:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758867.884046:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211772672:0@lo:400:kworker.0 00000100:00100000:0.0:1782758867.884159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758867.884312:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772672 00000100:00100000:2.0:1782758867.884323:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772672 00000100:00100000:2.0:1782758867.884403:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:2.0:1782758867.884414:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211772672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758867.889031:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211772672:12345-0@lo:400:kworker.0 Request processed in 4602us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758867.889052:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:0.0:1782758867.889787:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211772672:0@lo:400:kworker.0 00000100:00100000:0.0:1782758867.889849:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758867.889865:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211772800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758867.889944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758867.893168:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772800 00000100:00100000:2.0:1782758867.893191:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772800 00000100:00100000:2.0:1782758867.893280:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1782758867.893294:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211772800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758867.893428:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211772800:12345-0@lo:400:kworker.0 Request processed in 136us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758867.893436:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1782758867.894176:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211772800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758867.895047:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211772928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758867.895204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758867.895348:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211773056:0@lo:400:kworker.0 00000100:00100000:1.0:1782758867.895388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758867.897088:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773056 00000100:00100000:2.0:1782758867.897104:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773056 00000100:00100000:2.0:1782758867.897192:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:2.0:1782758867.897204:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211773056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758867.897311:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211773056:12345-0@lo:400:kworker.0 Request processed in 110us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758867.897320:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00080000:2.0:1782758867.897349:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758867.897396:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211773056:0@lo:400:kworker.0 00000100:00100000:2.0:1782758867.897931:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211772928 00000100:00100000:2.0:1782758867.897937:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211772928 00000100:00100000:2.0:1782758867.897999:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1782758867.898007:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211772928:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782758867.903351:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758867.903391:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211773184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758867.903519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758867.903571:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758867.903578:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211773312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758867.903608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758867.903645:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773184 00000100:00100000:3.0:1782758867.903654:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773184 00000100:00100000:3.0:1782758867.903724:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1782758867.903747:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211773184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758867.903814:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211773184:12345-0@lo:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758867.903849:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1782758867.903880:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773312 00000100:00100000:3.0:1782758867.903884:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773312 00000100:00100000:3.0:1782758867.903924:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1782758867.903930:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758867.903978:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211773312:12345-0@lo:400:kworker.0 Request processed in 48us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758867.903985:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00080000:3.0:1782758867.903999:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758867.904002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758867.904034:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211773312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758867.904045:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211773184:0@lo:400:kworker.0 00000100:00100000:2.0:1782758867.905889:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211772928:12345-0@lo:400:kworker.0 Request processed in 7871us (10675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758867.905907:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:0.0:1782758867.909665:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211772928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758868.396914:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758868.396947:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211773440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758868.397048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758868.397756:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773440 00000100:00100000:2.0:1782758868.397767:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773440 00000100:00100000:2.0:1782758868.397861:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1782758868.397872:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211773440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758868.397932:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758868.398004:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211773440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758868.398012:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1782758868.403335:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211773440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758868.590082:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758869.614301:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758870.637355:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758870.956089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758870.956120:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211773568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758870.956211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758870.956323:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773568 00000100:00100000:1.0:1782758870.956333:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773568 00000100:00100000:1.0:1782758870.956417:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1782758870.956428:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211773568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758870.956472:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758870.956524:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211773568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758870.956531:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1782758870.956597:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211773568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782758870.962976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1782758871.162781:0:107835:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25b: test nodemap info values ========= 14:47:47 (1782758867) 00010000:00010000:0.0:1782758871.661807:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758872.247480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758872.247529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758872.247566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758872.247603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758872.247732:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901120 00000100:00100000:1.0:1782758872.247743:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901120 00000100:00100000:1.0:1782758872.247812:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2106 00000100:00100000:1.0:1782758872.247842:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196901120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758872.247914:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196901120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758872.247921:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2106 00000100:00080000:0.0:1782758872.247993:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758872.249921:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196900992 00000100:00100000:2.0:1782758872.249936:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196900992 00000100:00100000:2.0:1782758872.250217:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1623 00000100:00100000:2.0:1782758872.250231:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196900992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758872.250297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196900992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758872.250304:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1623 00000100:00100000:2.0:1782758872.250343:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901248 00000100:00100000:2.0:1782758872.250348:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901248 00000100:00100000:2.0:1782758872.250395:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901376 00000100:00100000:2.0:1782758872.250399:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901376 00000100:00100000:2.0:1782758872.250423:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1643 00000100:00100000:2.0:1782758872.250430:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196901248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758872.250458:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196901248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758872.250465:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1643 00000100:00100000:2.0:1782758872.250478:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1644 00000100:00100000:2.0:1782758872.250484:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196901376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758872.250507:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196901376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758872.250512:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1644 00000100:00080000:0.0:1782758872.250601:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758872.250606:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782758872.684094:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758873.006657:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782758873.006735:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758873.006778:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211773824:0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.006917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758873.007029:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773824 00000100:00100000:1.0:1782758873.007040:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773824 00000100:00100000:1.0:1782758873.007131:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1782758873.007145:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211773824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.007220:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211773824:12345-0@lo:400:kworker.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758873.007229:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1782758873.007297:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211773824:0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.007908:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211773696:0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.007989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758873.008236:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773696 00000100:00100000:1.0:1782758873.008244:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773696 00000100:00100000:1.0:1782758873.008302:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1782758873.008313:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211773696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.008374:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211773696:12345-0@lo:400:kworker.0 Request processed in 63us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758873.008382:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1782758873.008480:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211773696:0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.008926:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758873.009443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758873.009461:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211774080:0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.009518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758873.009749:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211773952:0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.009809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758873.009919:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774080 00000100:00100000:2.0:1782758873.009927:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774080 00000100:00100000:2.0:1782758873.009996:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:2.0:1782758873.010004:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211774080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.010056:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211774080:12345-0@lo:400:kworker.0 Request processed in 52us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758873.010062:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00080000:2.0:1782758873.010088:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758873.010702:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211774080:0@lo:400:kworker.0 00000100:00100000:0.0:1782758873.011257:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211774208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758873.011321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758873.011364:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211774336:0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.011401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758873.011454:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774336 00000100:00100000:2.0:1782758873.011461:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774336 00000100:00100000:2.0:1782758873.011527:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:2.0:1782758873.011537:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211774336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758873.011744:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211774336:12345-0@lo:400:kworker.0 Request processed in 207us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758873.011752:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00080000:2.0:1782758873.011788:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758873.011845:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211774336:0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.014668:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211773952 00000100:00100000:1.0:1782758873.014684:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211773952 00000100:00100000:1.0:1782758873.014761:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774208 00000100:00100000:1.0:1782758873.014777:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774208 00000100:00100000:1.0:1782758873.014807:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1782758873.014817:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.014966:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211773952:12345-0@lo:400:kworker.0 Request processed in 149us (5155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758873.014974:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1782758873.015017:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:1.0:1782758873.015024:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211774208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.015411:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211774208:12345-0@lo:400:kworker.0 Request processed in 387us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758873.015419:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00080000:1.0:1782758873.015455:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758873.015527:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211773952:0@lo:400:kworker.0 00000100:00100000:1.0:1782758873.019905:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211774208:0@lo:400:kworker.0 00000100:00100000:0.0:1782758873.516458:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758873.516496:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211774464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758873.516595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758873.516693:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774464 00000100:00100000:0.0:1782758873.516703:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774464 00000100:00100000:0.0:1782758873.516768:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1782758873.516779:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211774464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758873.516847:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758873.516900:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211774464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758873.516908:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1782758873.517516:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211774464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758873.709156:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1782758874.220012:0:107884:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782758874.245123:0:107884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1782758874.732211:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758875.757730:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758876.076207:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758876.076244:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211774592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758876.076347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758876.076550:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774592 00000100:00100000:1.0:1782758876.076562:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774592 00000100:00100000:1.0:1782758876.076647:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1782758876.076671:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211774592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758876.076720:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758876.076781:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211774592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758876.076789:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:1.0:1782758876.076819:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758876.077112:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211774592:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782758876.106124:0:107932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6ea4b090 20000000:00000080:3.0:1782758876.106149:0:107932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bcfa5400 uarg=0000000000000000 10000000:01000000:3.0:1782758876.107191:0:107932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758876.107217:0:107932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758876.107241:0:107932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758876.107252:0:107932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758876.107303:0:107932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758876.107319:0:107932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 18 pid: 5796 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758876.107337:0:107932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107932:1869355211774720:0@lo:104: 00000100:00100000:3.0:1782758876.107427:0:107932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758876.107611:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774720 00000100:00100000:0.0:1782758876.107621:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774720 00000100:00100000:3.0:1782758876.107635:0:107932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758876.107750:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1782758876.107763:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107932:x1869355211774720:12345-0@lo:104: 00010000:00010000:0.0:1782758876.107778:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758876.108391:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758876.108401:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:107932:x1869355211774720:12345-0@lo:104: Request processed in 640us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758876.108415:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:2.0:1782758876.108489:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758876.108499:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.108509:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758876.108515:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.108525:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758876.108532:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758876.108539:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758876.108593:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.108599:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758876.108626:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.108634:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc503 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc50a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.108649:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758876.108651:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758876.108653:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758876.108677:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211774848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758876.108724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758876.108774:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774848 00000100:00100000:2.0:1782758876.108780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774848 00010000:00010000:2.0:1782758876.108803:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 19 pid: 5796 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758876.108860:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1782758876.109251:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211774848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758876.109271:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758876.109278:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 19 pid: 5796 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109291:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 19 pid: 5796 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109314:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109324:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109352:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109360:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109369:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109376:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109381:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758876.109386:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109395:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109405:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.109416:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758876.109463:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211774848:12345-0@lo:103:ldlm_bl.0 Request processed in 594us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758876.109470:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1782758876.109566:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211774848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758876.114354:0:107932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc50a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc503 expref: 18 pid: 5796 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758876.114390:0:107932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107932:1869355211774720:0@lo:104: 00010000:00010000:1.0:1782758876.114431:0:107932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.116449:0:107932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.116473:0:107932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758876.116482:0:107932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690c00/0xdd99f5c4777dc549 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758876.790664:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758877.378030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758877.378078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758877.378109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758877.378141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758877.378179:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901632 00000100:00100000:0.0:1782758877.378193:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901632 00000100:00100000:0.0:1782758877.378278:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2110 00000100:00100000:0.0:1782758877.378290:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758877.378390:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758877.378399:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2110 00000100:00100000:0.0:1782758877.378430:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901760 00000100:00100000:0.0:1782758877.378434:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901760 00000100:00100000:0.0:1782758877.378462:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901888 00000100:00100000:0.0:1782758877.378465:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901888 00000100:00100000:0.0:1782758877.378485:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1647 00000100:00100000:0.0:1782758877.378492:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758877.378520:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758877.378527:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1647 00000100:00100000:3.0:1782758877.380063:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196901504 00000100:00100000:3.0:1782758877.380076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196901504 00000100:00100000:3.0:1782758877.380148:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000100:00100000:3.0:1782758877.380158:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196901504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758877.380235:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196901504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758877.380247:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1625 00000100:00100000:0.0:1782758877.380374:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1648 00000100:00100000:0.0:1782758877.380385:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758877.380417:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196901888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758877.380423:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1648 00000100:00080000:0.0:1782758877.380446:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758877.380452:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758877.380456:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1782758877.481570:0:107982:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee5106e50 20000000:00000080:0.0:1782758877.481597:0:107982:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718383b000 uarg=0000000000000000 10000000:01000000:0.0:1782758877.483442:0:107982:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758877.483479:0:107982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483501:0:107982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483514:0:107982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483521:0:107982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483527:0:107982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483536:0:107982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483551:0:107982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758877.483556:0:107982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483566:0:107982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483583:0:107982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483591:0:107982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.483598:0:107982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc550 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758877.612559:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758877.612569:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758877.612575:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758877.612642:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758877.612657:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758877.612672:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758877.612718:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211774976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758877.612817:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758877.612911:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171918d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1782758877.612974:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211774976 00000100:00100000:1.0:1782758877.612986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211774976 00000100:00100000:1.0:1782758877.613050:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1782758877.613076:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211774976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758877.613259:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758877.613280:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc557 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758877.613315:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758877.613328:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758877.613338:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758877.613391:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211774976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758877.613400:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1782758877.616277:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211774976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758877.617388:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758877.617409:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758877.617449:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758877.617458:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758877.617467:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758877.804075:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758878.124124:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758878.124157:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211775232:0@lo:400:kworker.0 00000100:00100000:2.0:1782758878.124259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758878.124355:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775232 00000100:00100000:2.0:1782758878.124364:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775232 00000100:00100000:2.0:1782758878.124442:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1782758878.124455:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211775232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758878.124524:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211775232:12345-0@lo:400:kworker.0 Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758878.124563:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00080000:2.0:1782758878.124592:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758878.124632:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211775232:0@lo:400:kworker.0 00000100:00100000:2.0:1782758878.124682:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211775360:0@lo:400:kworker.0 00000100:00100000:2.0:1782758878.124712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758878.124744:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775360 00000100:00100000:2.0:1782758878.124749:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775360 00000100:00100000:2.0:1782758878.124796:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:2.0:1782758878.124803:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211775360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758878.124876:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211775360:12345-0@lo:400:kworker.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758878.124883:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00080000:2.0:1782758878.124898:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758878.124918:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211775360:0@lo:400:kworker.0 00000100:00100000:0.0:1782758878.125659:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211775104:0@lo:400:kworker.0 00000100:00100000:0.0:1782758878.125715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758878.125767:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211775616:0@lo:400:kworker.0 00000100:00100000:1.0:1782758878.125864:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775104 00000100:00100000:1.0:1782758878.125870:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775104 00000100:00100000:1.0:1782758878.125909:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1782758878.125918:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211775104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758878.125960:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211775104:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758878.125967:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:0.0:1782758878.126198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758878.126258:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211775104:0@lo:400:kworker.0 00000100:00100000:0.0:1782758878.126274:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758878.126281:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211775488:0@lo:400:kworker.0 00000100:00100000:0.0:1782758878.126304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758878.126335:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775488 00000100:00100000:0.0:1782758878.126515:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775488 00000100:00100000:0.0:1782758878.126567:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1782758878.126575:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211775488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758878.126612:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211775488:12345-0@lo:400:kworker.0 Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758878.126618:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1782758878.126645:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211775488:0@lo:400:kworker.0 00000100:00100000:1.0:1782758878.126700:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775616 00000100:00100000:1.0:1782758878.126705:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775616 00000100:00100000:1.0:1782758878.126741:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:1.0:1782758878.126748:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211775616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758878.127417:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211775616:12345-0@lo:400:kworker.0 Request processed in 668us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758878.127427:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:0.0:1782758878.127587:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211775616:0@lo:400:kworker.0 00000100:00080000:2.0:1782758878.127714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758878.127721:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758878.641750:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211775744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758878.641848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758878.642380:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775744 00000100:00100000:0.0:1782758878.642389:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775744 00000100:00100000:0.0:1782758878.642437:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1782758878.642446:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211775744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758878.642480:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758878.642545:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211775744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758878.642552:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1782758878.644301:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211775744:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1782758878.675764:0:108030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccef493b0 20000000:00000080:0.0:1782758878.675782:0:108030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be0c00 uarg=0000000000000000 10000000:01000000:0.0:1782758878.676495:0:108030:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758878.676517:0:108030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758878.676548:0:108030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758878.676557:0:108030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758878.676596:0:108030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758878.676611:0:108030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 18 pid: 5794 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758878.676626:0:108030:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108030:1869355211775872:0@lo:104: 00000100:00100000:0.0:1782758878.676701:0:108030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758878.677115:0:108030:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171907e70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758878.678270:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211775872 00000100:00100000:3.0:1782758878.678283:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211775872 00000100:00100000:3.0:1782758878.678386:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1782758878.678397:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108030:x1869355211775872:12345-0@lo:104: 00010000:00010000:3.0:1782758878.678414:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758878.678513:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758878.678529:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108030:x1869355211775872:12345-0@lo:104: Request processed in 126us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758878.678537:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:1.0:1782758878.678593:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758878.678600:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678608:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758878.678612:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678621:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758878.678628:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758878.678633:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758878.678676:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678682:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758878.678703:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678710:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc557 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc55e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678730:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758878.678732:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758878.678733:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758878.678741:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758878.678754:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211776000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758878.678796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758878.678868:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776000 00000100:00100000:1.0:1782758878.678872:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776000 00010000:00010000:1.0:1782758878.678893:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 19 pid: 5794 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758878.678916:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1782758878.678922:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211776000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758878.678933:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758878.678951:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 19 pid: 5794 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678961:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 19 pid: 5794 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678980:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.678988:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679003:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679014:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679022:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679028:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679033:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758878.679038:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679045:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679062:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758878.679072:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758878.679103:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211776000:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758878.679110:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1782758878.679152:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211776000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758878.679360:0:108030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc55e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc557 expref: 18 pid: 5794 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758878.679372:0:108030:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108030:1869355211775872:0@lo:104: 00010000:00010000:2.0:1782758878.679388:0:108030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758878.679397:0:108030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758878.679404:0:108030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758878.679410:0:108030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc565 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758878.828168:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758879.793330:0:108078:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0edeb840 20000000:00000080:1.0:1782758879.793348:0:108078:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d4c00 uarg=0000000000000000 10000000:01000000:1.0:1782758879.793556:0:108078:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758879.793580:0:108078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793598:0:108078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793609:0:108078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793616:0:108078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793623:0:108078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793630:0:108078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793636:0:108078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758879.793641:0:108078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793648:0:108078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793673:0:108078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793681:0:108078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758879.793687:0:108078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc56c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758879.853363:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782758880.050173:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758880.050181:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758880.050186:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758880.050232:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758880.050245:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758880.050256:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758880.050286:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211776128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758880.050358:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758880.050409:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3db40 going to sleep for 11 seconds 00000100:00100000:1.0:1782758880.051583:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776128 00000100:00100000:1.0:1782758880.051593:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776128 00000100:00100000:1.0:1782758880.051642:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1782758880.051652:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211776128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758880.051669:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758880.051687:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc573 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.051713:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.051724:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.051733:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758880.051792:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211776128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758880.051799:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1782758880.053414:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211776128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758880.053436:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.053448:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758880.053470:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758880.053475:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.053483:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782758880.577400:0:108126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc70658ac0 20000000:00000080:1.0:1782758880.577417:0:108126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917190482800 uarg=0000000000000000 10000000:01000000:1.0:1782758880.578540:0:108126:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758880.578568:0:108126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.578588:0:108126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.578597:0:108126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.578635:0:108126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.578649:0:108126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 18 pid: 5793 timeout: 3048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758880.578665:0:108126:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108126:1869355211776256:0@lo:104: 00000100:00100000:1.0:1782758880.578739:0:108126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758880.579153:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776256 00000100:00100000:3.0:1782758880.579237:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776256 00000100:00100000:3.0:1782758880.579329:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1782758880.579340:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108126:x1869355211776256:12345-0@lo:104: 00010000:00010000:3.0:1782758880.579355:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758880.579427:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758880.579435:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108126:x1869355211776256:12345-0@lo:104: Request processed in 97us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758880.579442:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00010000:2.0:1782758880.579493:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758880.579500:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579508:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758880.579512:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579521:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758880.579529:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758880.579533:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758880.579568:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579575:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758880.579597:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579603:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc573 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc57a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579619:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758880.579621:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758880.579622:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758880.579642:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211776384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758880.579674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758880.579714:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776384 00000100:00100000:2.0:1782758880.579719:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776384 00010000:00010000:2.0:1782758880.579737:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 3048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758880.579758:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1782758880.579765:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211776384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758880.579777:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758880.579782:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 3048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579794:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 3048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579850:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579859:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579875:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579882:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579891:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579896:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579901:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758880.579904:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579911:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579918:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758880.579932:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758880.580103:0:108126:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb840 going to sleep for 11 seconds 00010000:00010000:1.0:1782758880.580129:0:108126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc57a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc573 expref: 19 pid: 5793 timeout: 3048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758880.580140:0:108126:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108126:1869355211776256:0@lo:104: 00010000:00010000:1.0:1782758880.580168:0:108126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.580178:0:108126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.580184:0:108126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758880.580190:0:108126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc581 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758880.581371:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211776384:12345-0@lo:103:ldlm_bl.0 Request processed in 1600us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758880.581381:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1782758880.581433:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211776384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758880.878669:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758881.202790:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211776512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758881.202898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758881.202975:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776512 00000100:00100000:1.0:1782758881.202983:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776512 00000100:00100000:1.0:1782758881.203397:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1782758881.203407:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211776512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758881.203443:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758881.203504:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211776512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758881.203512:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1782758881.203563:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211776512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758881.204980:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1782758881.563727:0:108176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc093cfb30 20000000:00000080:3.0:1782758881.563751:0:108176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbf400 uarg=0000000000000000 10000000:01000000:3.0:1782758881.564416:0:108176:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758881.564443:0:108176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564605:0:108176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564622:0:108176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564630:0:108176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564637:0:108176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564644:0:108176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564650:0:108176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758881.564654:0:108176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564662:0:108176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564674:0:108176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564681:0:108176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758881.564687:0:108176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc588 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758881.900041:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758882.413196:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758882.413205:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758882.413210:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758882.413252:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758882.413265:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758882.413277:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758882.413362:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211776640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758882.413431:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758882.413487:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b23780 going to sleep for 11 seconds 00000100:00100000:3.0:1782758882.413775:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776640 00000100:00100000:3.0:1782758882.413784:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776640 00000100:00100000:3.0:1782758882.413856:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:3.0:1782758882.413865:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211776640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758882.413881:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758882.413897:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc58f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758882.413921:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758882.413931:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758882.413940:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690800, rc 0) 00000100:00100000:3.0:1782758882.413987:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211776640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758882.413994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:1.0:1782758882.414204:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211776640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758882.414219:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758882.414227:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758882.414247:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758882.414252:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758882.414258:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758882.486757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758882.487072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758882.487095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758882.487120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758882.487202:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902144 00000100:00100000:2.0:1782758882.487214:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902144 00000100:00100000:2.0:1782758882.487297:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2114 00000100:00100000:2.0:1782758882.487308:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196902144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758882.487386:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2362:x1869355196902144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758882.487394:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2114 00000100:00100000:2.0:1782758882.487420:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902272 00000100:00100000:2.0:1782758882.487424:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902272 00000100:00100000:2.0:1782758882.487459:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902400 00000100:00100000:2.0:1782758882.487463:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902400 00000100:00100000:2.0:1782758882.487486:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 706 00000100:00100000:2.0:1782758882.487492:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2360:x1869355196902272:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1782758882.487515:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc53b 00000100:00080000:2.0:1782758882.487524:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782758882.487563:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:2.0:1782758882.488168:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+2:2360:x1869355196902272:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 673us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758882.488176:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 706 00000100:00100000:2.0:1782758882.488191:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 707 00000100:00100000:2.0:1782758882.488198:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2360:x1869355196902400:12345-192.168.204.31@tcp:9:kworker.0 00000100:00100000:0.0:1782758882.488204:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902016 00000100:00100000:0.0:1782758882.488209:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902016 00000020:00000080:2.0:1782758882.488212:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc542 00000100:00080000:2.0:1782758882.488218:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917184f29000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782758882.488236:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000001:00000004:2.0:1782758882.488241:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1782758882.488242:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196902016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758882.488267:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196902016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758882.488273:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1629 00000100:00100000:2.0:1782758882.488465:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+2:2360:x1869355196902400:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 267us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758882.488473:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 707 00010000:00010000:2.0:1782758882.488645:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758882.488651:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782758882.495022:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758882.495033:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758882.495037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758882.925649:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758883.244050:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211777024:0@lo:400:kworker.0 00000100:00100000:2.0:1782758883.244124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758883.244179:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758883.244185:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211777152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758883.244214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758883.244244:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777152 00000100:00100000:2.0:1782758883.244252:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777152 00000100:00100000:2.0:1782758883.244310:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:2.0:1782758883.244319:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211777152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244453:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211776768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758883.244527:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211777280:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758883.244570:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758883.244576:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211776896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758883.244616:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211777408:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782758883.244659:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758883.244670:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776768 00000100:00100000:3.0:1782758883.244674:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776768 00000100:00100000:3.0:1782758883.244702:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:3.0:1782758883.244709:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211776768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244747:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211776768:12345-0@lo:400:kworker.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758883.244754:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:3.0:1782758883.244787:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777024 00000100:00100000:3.0:1782758883.244790:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777024 00000100:00100000:3.0:1782758883.244818:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777280 00000100:00100000:3.0:1782758883.244847:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777280 00000100:00100000:3.0:1782758883.244869:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211776896 00000100:00100000:3.0:1782758883.244872:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211776896 00000100:00100000:3.0:1782758883.244884:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1782758883.244889:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211777024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244925:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211777024:12345-0@lo:400:kworker.0 Request processed in 35us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758883.244931:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1782758883.244943:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1782758883.244948:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211777280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.244974:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211777280:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758883.244980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1782758883.244990:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:3.0:1782758883.244995:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.245020:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211776896:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758883.245025:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:3.0:1782758883.245045:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777408 00000100:00100000:3.0:1782758883.245048:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777408 00000100:00100000:3.0:1782758883.245071:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1782758883.245078:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211777408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.245106:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211777408:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758883.245112:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1782758883.245163:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211777024:0@lo:400:kworker.0 00000100:00080000:3.0:1782758883.245192:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758883.245196:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758883.245210:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211776896:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.245219:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211777408:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.245226:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211776768:0@lo:400:kworker.0 00000100:00100000:3.0:1782758883.245234:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211777280:0@lo:400:kworker.0 00000100:00100000:2.0:1782758883.245597:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211777152:12345-0@lo:400:kworker.0 Request processed in 1277us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758883.245604:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1782758883.245678:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211777152:0@lo:400:kworker.0 00000100:00100000:2.0:1782758883.757108:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758883.757132:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211777536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758883.757206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758883.757278:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777536 00000100:00100000:2.0:1782758883.757285:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777536 00000100:00100000:2.0:1782758883.757325:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1782758883.757333:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211777536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758883.757367:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758883.757410:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211777536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758883.757417:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1782758883.757473:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211777536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758883.949757:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758884.445612:0:108332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd4fea890 20000000:00000080:2.0:1782758884.445637:0:108332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812eb800 uarg=0000000000000000 10000000:01000000:2.0:1782758884.445979:0:108332:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758884.446000:0:108332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.446020:0:108332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.446029:0:108332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.446072:0:108332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.446087:0:108332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 18 pid: 5796 timeout: 3052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758884.446105:0:108332:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108332:1869355211777664:0@lo:104: 00000100:00100000:2.0:1782758884.446174:0:108332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758884.446295:0:108332:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171918d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758884.446347:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777664 00000100:00100000:3.0:1782758884.446358:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777664 00000100:00100000:3.0:1782758884.446604:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1782758884.446615:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108332:x1869355211777664:12345-0@lo:104: 00010000:00010000:3.0:1782758884.446630:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758884.446705:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758884.446712:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108332:x1869355211777664:12345-0@lo:104: Request processed in 99us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758884.446719:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:1.0:1782758884.446776:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758884.446783:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.446791:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758884.446795:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.446808:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758884.446817:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758884.446849:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758884.446878:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.446885:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758884.446904:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.446911:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc58f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc596 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.446927:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758884.446929:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758884.446931:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758884.446949:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211777792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758884.446985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758884.447018:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777792 00000100:00100000:1.0:1782758884.447022:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777792 00010000:00010000:1.0:1782758884.447040:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 19 pid: 5796 timeout: 3052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758884.447061:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1782758884.447067:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211777792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758884.447078:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758884.447083:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 19 pid: 5796 timeout: 3052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447093:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 19 pid: 5796 timeout: 3052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447109:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447117:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447131:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447138:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447145:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447152:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447158:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758884.447162:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447170:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447182:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758884.447192:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758884.447217:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211777792:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758884.447224:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1782758884.447261:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211777792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758884.447367:0:108332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc596 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc58f expref: 18 pid: 5796 timeout: 3052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758884.447378:0:108332:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108332:1869355211777664:0@lo:104: 00010000:00010000:2.0:1782758884.447391:0:108332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.447400:0:108332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.447420:0:108332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.447427:0:108332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc59d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758884.974572:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758885.355627:0:108380:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5ac82f80 20000000:00000080:2.0:1782758885.355644:0:108380:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812e9800 uarg=0000000000000000 10000000:01000000:2.0:1782758885.355908:0:108380:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758885.355932:0:108380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355952:0:108380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355964:0:108380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355972:0:108380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355984:0:108380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355990:0:108380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.355996:0:108380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758885.356001:0:108380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.356008:0:108380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.356019:0:108380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.356026:0:108380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758885.356032:0:108380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5a4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758885.996992:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758886.251911:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758886.251931:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758886.251937:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758886.251991:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758886.252003:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758886.252014:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758886.252042:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211777920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758886.252119:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758886.252203:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3180 going to sleep for 11 seconds 00000100:00100000:3.0:1782758886.252209:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211777920 00000100:00100000:3.0:1782758886.252219:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211777920 00000100:00100000:3.0:1782758886.252283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1782758886.252292:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211777920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758886.252306:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758886.252318:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc5ab expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758886.252342:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758886.252352:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758886.252360:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758886.252426:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211777920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758886.252437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:2.0:1782758886.252939:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211777920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758886.252960:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758886.252971:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758886.252997:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758886.253002:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758886.253010:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758886.325540:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758886.325616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758886.325751:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778048 00000100:00100000:2.0:1782758886.325760:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778048 00000100:00100000:2.0:1782758886.325846:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1782758886.325856:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211778048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758886.325895:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758886.325941:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211778048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758886.325948:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1782758886.326105:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211778048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758886.329514:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1782758886.398897:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000020:00000080:0.0:1782758886.398910:0:7507:0:(genops.c:906:class_export_put()) final put ffff91719027e800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000020:00000080:0.0:1782758886.398944:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff91719027e800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 for lustre-OST0001 00000020:00000080:0.0:1782758886.398995:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917184f29000 for lustre-OST0001 00000001:00100000:3.0:1782758886.403242:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000020:00000080:3.0:1782758886.403259:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171bb694800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000020:00000080:0.0:1782758886.403645:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bb694800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 for lustre-OST0000 00000020:00000080:0.0:1782758886.403712:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bb693000 for lustre-OST0000 00010000:00010000:1.0:1782758887.022115:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758887.604653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758887.604725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758887.604867:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902528 00000100:00100000:1.0:1782758887.604877:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902528 00000100:00100000:1.0:1782758887.604925:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1632 00000100:00100000:1.0:1782758887.604935:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2361:x1869355196902528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758887.605011:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2361:x1869355196902528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758887.605019:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1632 00000100:00100000:3.0:1782758887.605189:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902656 00000100:00100000:3.0:1782758887.605194:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902656 00000100:00100000:3.0:1782758887.605253:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2118 00000100:00100000:3.0:1782758887.605263:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2361:x1869355196902656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758887.605296:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2361:x1869355196902656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758887.605302:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2118 00000100:00080000:0.0:1782758887.605366:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758888.044554:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758888.365172:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211778560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758888.365315:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782758888.365321:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211778176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758888.365385:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211778688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758888.365440:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778176 00000100:00100000:3.0:1782758888.365450:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778176 00000100:00100000:3.0:1782758888.365508:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1782758888.365517:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211778176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365582:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211778176:12345-0@lo:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758888.365591:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1782758888.365635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778688 00000100:00100000:3.0:1782758888.365638:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778688 00000100:00100000:3.0:1782758888.365693:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:3.0:1782758888.365700:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365733:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211778688:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758888.365740:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00080000:3.0:1782758888.365760:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758888.365792:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211778176:0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.365805:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211778688:0@lo:400:kworker.0 00000100:00100000:0.0:1782758888.366107:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778560 00000100:00100000:0.0:1782758888.366111:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778560 00000100:00100000:0.0:1782758888.366155:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1782758888.366162:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211778560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758888.366201:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211778560:12345-0@lo:400:kworker.0 Request processed in 40us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758888.366208:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1782758888.366316:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211778304:0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.366357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758888.366383:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211778816:0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.366406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758888.366425:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758888.366431:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211778432:0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.366453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758888.366479:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778816 00000100:00100000:2.0:1782758888.366482:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778816 00000100:00100000:2.0:1782758888.366508:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1782758888.366513:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211778816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.366546:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211778816:12345-0@lo:400:kworker.0 Request processed in 32us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758888.366551:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1782758888.366769:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778304 00000100:00100000:0.0:1782758888.366773:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778304 00000100:00100000:0.0:1782758888.366797:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778432 00000100:00100000:0.0:1782758888.366799:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778432 00000100:00100000:0.0:1782758888.366814:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1782758888.366819:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211778304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758888.366872:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211778304:12345-0@lo:400:kworker.0 Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758888.366878:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1782758888.366888:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1782758888.366893:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211778432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758888.366912:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211778432:12345-0@lo:400:kworker.0 Request processed in 20us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758888.366918:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1782758888.367077:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211778432:0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.367086:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211778304:0@lo:400:kworker.0 00000100:00100000:2.0:1782758888.367094:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211778816:0@lo:400:kworker.0 00000100:00080000:3.0:1782758888.367240:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782758888.367245:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758888.367247:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758888.367270:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211778560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758888.877086:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758888.877119:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211778944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758888.877200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758888.880290:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211778944 00000100:00100000:1.0:1782758888.880306:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211778944 00000100:00100000:1.0:1782758888.880673:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1782758888.880685:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211778944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758888.880725:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758888.880843:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211778944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (3622us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758888.880851:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1782758888.881891:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211778944:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782758888.965334:0:108579:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfc296ae0 20000000:00000080:2.0:1782758888.965353:0:108579:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd9400 uarg=0000000000000000 00010000:00010000:2.0:1782758888.968921:0:108579:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758888.968944:0:108579:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758888.968959:0:108579:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758888.968978:0:108579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758888.968995:0:108579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758888.969003:0:108579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758888.969047:0:108579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758888.969067:0:108579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 18 pid: 5796 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758888.969082:0:108579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108579:1869355211779072:0@lo:104: 00000100:00100000:2.0:1782758888.969151:0:108579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758888.969260:0:108579:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88180 going to sleep for 11 seconds 00000100:00100000:3.0:1782758888.975140:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782758888.975173:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779072 00000100:00100000:3.0:1782758888.975184:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779072 00000100:00100000:3.0:1782758888.975240:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1782758888.975251:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b312dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108579:x1869355211779072:12345-0@lo:104: 00010000:00010000:3.0:1782758888.975272:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758888.975450:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758888.975458:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b312dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108579:x1869355211779072:12345-0@lo:104: Request processed in 209us (6307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758888.975467:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:1.0:1782758888.975583:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758888.975591:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975599:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758888.975603:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975611:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758888.975618:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758888.975623:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758888.975677:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975689:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758888.975725:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975733:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5400/0xdd99f5c4777dc5ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5b2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975752:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758888.975754:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758888.975756:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758888.975766:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758888.975781:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211779200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758888.975844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758888.975888:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779200 00000100:00100000:1.0:1782758888.975892:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779200 00010000:00010000:1.0:1782758888.975914:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 19 pid: 5796 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758888.975937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1782758888.975943:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211779200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758888.975954:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758888.975959:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 19 pid: 5796 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975970:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 19 pid: 5796 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975988:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.975997:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976012:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976020:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976027:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976032:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976038:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758888.976042:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976048:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976056:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758888.976067:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758888.976094:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211779200:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758888.976100:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1782758888.976147:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211779200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758888.978031:0:108579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc5b2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc5ab expref: 18 pid: 5796 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758888.978052:0:108579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108579:1869355211779072:0@lo:104: 00010000:00010000:2.0:1782758888.978077:0:108579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758888.981403:0:108579:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758888.981424:0:108579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758888.981432:0:108579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777dc5b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758889.074035:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758890.092196:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782758890.349985:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758890.349994:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758890.349999:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758890.350054:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758890.350067:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758890.350077:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758890.350108:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211779328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758890.350180:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758890.350251:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7a8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1782758890.354664:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779328 00000100:00100000:0.0:1782758890.354679:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779328 00000100:00100000:0.0:1782758890.354746:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:0.0:1782758890.354757:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211779328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758890.354775:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758890.354795:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc5c0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758890.354869:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758890.354882:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758890.354890:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:0.0:1782758890.354986:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211779328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758890.354992:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1782758890.356109:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211779328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758890.356134:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758890.356145:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758890.356167:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758890.356172:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758890.356179:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758891.118612:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758891.436228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758891.436254:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211779456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758891.436353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758891.436436:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779456 00000100:00100000:3.0:1782758891.436444:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779456 00000100:00100000:3.0:1782758891.436512:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1782758891.436524:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211779456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758891.436563:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758891.436629:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211779456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758891.436637:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:3.0:1782758891.436660:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758891.436698:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211779456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758892.141630:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758892.726919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758892.727027:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902784 00000100:00100000:2.0:1782758892.727045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758892.727046:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902784 00000100:00100000:3.0:1782758892.727152:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1635 00000100:00100000:3.0:1782758892.727165:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196902784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758892.727270:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2362:x1869355196902784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758892.727278:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1635 00000100:00100000:1.0:1782758892.727605:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196902912 00000100:00100000:1.0:1782758892.727611:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196902912 00000100:00100000:1.0:1782758892.727665:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00100000:1.0:1782758892.727673:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2361:x1869355196902912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758892.727714:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2361:x1869355196902912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758892.727721:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00080000:1.0:1782758892.727743:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758893.166366:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758893.191541:0:108776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff93f7e940 20000000:00000080:1.0:1782758893.191569:0:108776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc2000 uarg=0000000000000000 00010000:00010000:1.0:1782758893.193127:0:108776:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758893.193225:0:108776:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758893.193259:0:108776:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758893.193288:0:108776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758893.193312:0:108776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758893.193324:0:108776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758893.193383:0:108776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758893.193595:0:108776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 18 pid: 5796 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758893.193623:0:108776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108776:1869355211779584:0@lo:104: 00000100:00100000:1.0:1782758893.193724:0:108776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758893.193916:0:108776:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3180 going to sleep for 11 seconds 00000100:00100000:3.0:1782758893.194040:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779584 00000100:00100000:3.0:1782758893.194050:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779584 00000100:00100000:3.0:1782758893.194161:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1782758893.194174:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108776:x1869355211779584:12345-0@lo:104: 00010000:00010000:3.0:1782758893.194193:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758893.194397:0:108776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108776:1869355211779584:0@lo:104: 00010000:00010000:2.0:1782758893.194444:0:108776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758893.194615:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758893.194623:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:108776:x1869355211779584:12345-0@lo:104: Request processed in 452us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758893.194632:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00010000:0.0:1782758893.194781:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758893.194790:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.194798:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758893.194802:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.194811:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758893.194818:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758893.194851:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758893.194898:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.194904:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758893.194930:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.194937:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691400/0xdd99f5c4777dc5c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.194956:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758893.194958:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758893.194960:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758893.194976:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211779712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758893.195024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758893.195074:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779712 00000100:00100000:0.0:1782758893.195080:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779712 00010000:00010000:0.0:1782758893.195103:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758893.195131:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1782758893.195139:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211779712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758893.195359:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758893.195367:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195381:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195400:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc5c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc5c0 expref: 19 pid: 5796 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195591:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195603:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195623:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195631:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195638:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195644:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195650:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758893.195655:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.195663:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758893.197033:0:108776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758893.197053:0:108776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.199392:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.199589:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc5ce lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758893.199620:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758893.199752:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211779712:12345-0@lo:103:ldlm_bl.0 Request processed in 4607us (4721us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758893.199766:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1782758893.199957:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211779712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758893.484562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758893.484768:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211779968:0@lo:400:kworker.0 00000100:00100000:0.0:1782758893.484768:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211780096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758893.484885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758893.484886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758893.485776:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211780224:0@lo:400:kworker.0 00000100:00100000:3.0:1782758893.486107:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779968 00000100:00100000:3.0:1782758893.486117:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779968 00000100:00100000:3.0:1782758893.486190:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1782758893.486202:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211779968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758893.486245:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211779840:0@lo:400:kworker.0 00000100:00100000:3.0:1782758893.486274:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211779968:12345-0@lo:400:kworker.0 Request processed in 75us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758893.486283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758893.486288:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1782758893.486307:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780224 00000100:00100000:3.0:1782758893.486310:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780224 00000100:00100000:3.0:1782758893.486334:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211779840 00000100:00100000:3.0:1782758893.486337:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211779840 00000100:00100000:3.0:1782758893.486350:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1782758893.486355:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211780224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758893.486387:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211780224:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758893.486393:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1782758893.486424:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1782758893.486433:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486443:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211780224:0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486463:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758893.486468:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211779840:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758893.486473:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211780352:0@lo:400:kworker.0 00000100:00100000:3.0:1782758893.486479:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1782758893.486520:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211779968:0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758893.486747:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211779840:0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486773:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780096 00000100:00100000:2.0:1782758893.486777:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780096 00000100:00100000:2.0:1782758893.486806:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780352 00000100:00100000:2.0:1782758893.486809:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780352 00000100:00100000:2.0:1782758893.486849:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1782758893.486856:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211780096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758893.486896:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211780096:12345-0@lo:400:kworker.0 Request processed in 36us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758893.486903:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1782758893.486917:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:2.0:1782758893.486923:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211780352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782758893.486932:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782758893.486939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782758893.486942:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758893.486959:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211780352:12345-0@lo:400:kworker.0 Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758893.486967:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:2.0:1782758893.486996:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211780352:0@lo:400:kworker.0 00000100:00100000:0.0:1782758893.487239:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211780096:0@lo:400:kworker.0 00000100:00100000:0.0:1782758893.997230:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758893.997255:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211780480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758893.997324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758893.999029:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780480 00000100:00100000:2.0:1782758893.999043:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780480 00000100:00100000:2.0:1782758893.999114:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1782758893.999124:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211780480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758893.999166:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758893.999324:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211780480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758893.999332:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1782758893.999486:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211780480:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782758894.080285:0:108824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff27018660 20000000:00000080:2.0:1782758894.080305:0:108824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd9400 uarg=0000000000000000 10000000:01000000:2.0:1782758894.083667:0:108824:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758894.083706:0:108824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083776:0:108824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083788:0:108824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083794:0:108824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083800:0:108824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083807:0:108824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083813:0:108824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758894.083818:0:108824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.083949:0:108824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.084030:0:108824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.084041:0:108824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.084048:0:108824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc5d5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758894.195742:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782758894.635898:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758894.635907:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758894.635912:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758894.635967:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.635982:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758894.635994:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758894.636025:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211780608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758894.636097:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758894.638624:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758894.643653:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780608 00000100:00100000:1.0:1782758894.643798:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780608 00000100:00100000:0.0:1782758894.643969:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:0.0:1782758894.643980:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211780608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758894.643998:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758894.644017:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc5dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758894.644045:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758894.644056:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758894.644072:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782758894.644158:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211780608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (8060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758894.644165:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:0.0:1782758894.644226:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211780608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758894.644244:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758894.644255:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758894.644278:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758894.644283:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758894.644290:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758895.213422:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758896.239983:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758896.557046:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758896.557067:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211780736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758896.557136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758896.558015:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780736 00000100:00100000:3.0:1782758896.558025:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780736 00000100:00100000:3.0:1782758896.558084:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1782758896.558094:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211780736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758896.558131:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758896.558206:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211780736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758896.558213:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:3.0:1782758896.558233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758896.558272:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211780736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758897.260113:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758897.846726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758897.846775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758897.846811:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903168 00000100:00100000:1.0:1782758897.846832:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903168 00000100:00100000:0.0:1782758897.846839:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903040 00000100:00100000:0.0:1782758897.846843:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903040 00000100:00100000:1.0:1782758897.846890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00100000:0.0:1782758897.846890:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1637 00000100:00100000:1.0:1782758897.846900:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196903168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758897.846900:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758897.846973:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196903168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758897.846980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00080000:1.0:1782758897.847006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758897.855510:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 8599us (8781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758897.855525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1637 00010000:00010000:2.0:1782758898.284019:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758898.604096:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781248:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758898.604250:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758898.604256:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211781120:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758898.604311:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211780864:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604330:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781248 00000100:00100000:2.0:1782758898.604338:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781248 00000100:00100000:0.0:1782758898.604355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758898.604393:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211781376:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604401:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:2.0:1782758898.604412:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.604421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758898.604441:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782758898.604448:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211780992:0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.604480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758898.604487:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781248:12345-0@lo:400:kworker.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758898.604495:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:0.0:1782758898.604517:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211781504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604519:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781120 00000100:00100000:2.0:1782758898.604524:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781120 00000100:00100000:0.0:1782758898.604551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758898.604557:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781376 00000100:00100000:2.0:1782758898.604561:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781376 00000100:00100000:0.0:1782758898.604588:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780864 00000100:00100000:2.0:1782758898.604592:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211780992 00000100:00100000:0.0:1782758898.604593:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780864 00000100:00100000:2.0:1782758898.604597:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211780992 00000100:00100000:2.0:1782758898.604623:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1782758898.604628:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1782758898.604633:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211781120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.604640:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211780864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604679:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211781120:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758898.604685:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211780864:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758898.604691:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1782758898.604696:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1782758898.604713:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1782758898.604723:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211781376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.604728:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1782758898.604737:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211780992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604762:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211781376:12345-0@lo:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758898.604771:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1782758898.604776:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211780992:12345-0@lo:400:kworker.0 Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758898.604783:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00080000:2.0:1782758898.604794:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758898.604800:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758898.604812:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781504 00000100:00100000:2.0:1782758898.604815:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781504 00000100:00100000:2.0:1782758898.604873:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:2.0:1782758898.604879:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211781504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604911:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211781504:12345-0@lo:400:kworker.0 Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758898.604916:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00080000:2.0:1782758898.604939:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758898.604946:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211780992:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604963:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211781120:0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.604964:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211781504:0@lo:400:kworker.0 00000100:00100000:2.0:1782758898.604982:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781248:0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.605298:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211780864:0@lo:400:kworker.0 00000100:00100000:0.0:1782758898.605310:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211781376:0@lo:400:kworker.0 00000100:00100000:2.0:1782758899.116051:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758899.116079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758899.116182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758899.116412:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781632 00000100:00100000:0.0:1782758899.116422:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781632 00000100:00100000:0.0:1782758899.116479:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1782758899.116488:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758899.116528:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758899.116584:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758899.116592:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1782758899.116675:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758899.308616:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758900.336680:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758901.358658:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758901.684773:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758901.684869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758901.684948:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781760 00000100:00100000:3.0:1782758901.684956:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781760 00000100:00100000:3.0:1782758901.685005:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1782758901.685015:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758901.685049:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758901.685110:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211781760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758901.685118:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:3.0:1782758901.685139:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758901.685174:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211781760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758902.380072:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758902.967855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758902.967902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758902.967941:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903296 00000100:00100000:3.0:1782758902.967952:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903296 00000100:00100000:3.0:1782758902.968008:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1639 00000100:00100000:3.0:1782758902.968018:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758902.968136:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758902.968144:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1639 00000100:00100000:3.0:1782758902.968181:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903424 00000100:00100000:3.0:1782758902.968186:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903424 00000100:00100000:3.0:1782758902.968227:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00100000:3.0:1782758902.968233:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196903424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758902.968265:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196903424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758902.968272:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00080000:3.0:1782758902.968289:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782758903.410045:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758903.724751:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211782144:0@lo:400:kworker.0 00000100:00100000:1.0:1782758903.724800:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211782016:0@lo:400:kworker.0 00000100:00100000:3.0:1782758903.724860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758903.724943:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782144 00000100:00100000:1.0:1782758903.724951:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782144 00000100:00100000:3.0:1782758903.725062:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758903.725070:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211782272:0@lo:400:kworker.0 00000100:00100000:1.0:1782758903.725089:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:3.0:1782758903.725099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758903.725099:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211782144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782758903.725130:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758903.725142:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782272 00000100:00100000:3.0:1782758903.725146:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782272 00000100:00100000:1.0:1782758903.725157:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211782144:12345-0@lo:400:kworker.0 Request processed in 60us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758903.725164:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:3.0:1782758903.725184:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:3.0:1782758903.725191:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758903.725223:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211782272:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758903.725229:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00080000:3.0:1782758903.725249:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758903.725284:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211782272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758903.725296:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211782144:0@lo:400:kworker.0 00000100:00100000:2.0:1782758903.725512:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211781888:0@lo:400:kworker.0 00000100:00100000:2.0:1782758903.725548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758903.725584:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211782400:0@lo:400:kworker.0 00000100:00100000:2.0:1782758903.725606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758903.725676:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782400 00000100:00100000:3.0:1782758903.725681:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782400 00000100:00100000:0.0:1782758903.725789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758903.725813:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211782528:0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.725870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758903.725903:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782016 00000100:00100000:0.0:1782758903.725907:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782016 00000100:00100000:0.0:1782758903.725930:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1782758903.725937:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211782400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.726066:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211782400:12345-0@lo:400:kworker.0 Request processed in 129us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758903.726073:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1782758903.726086:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1782758903.726092:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211782016:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758903.726127:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758903.726128:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211782016:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758903.726134:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1782758903.726151:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782528 00000100:00100000:0.0:1782758903.726155:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782528 00000100:00100000:1.0:1782758903.726180:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211781888 00000100:00100000:1.0:1782758903.726188:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211781888 00000100:00100000:1.0:1782758903.726216:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:1.0:1782758903.726223:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211781888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758903.726255:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211781888:12345-0@lo:400:kworker.0 Request processed in 32us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758903.726260:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:0.0:1782758903.726446:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1782758903.726452:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211782528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.726483:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211782528:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758903.726490:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1782758903.726516:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211781888:0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.726526:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211782400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.726547:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211782016:0@lo:400:kworker.0 00000100:00100000:0.0:1782758903.726555:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211782528:0@lo:400:kworker.0 00000100:00080000:2.0:1782758903.727150:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758904.239556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758904.239581:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211782656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758904.239652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758904.241161:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782656 00000100:00100000:2.0:1782758904.241173:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782656 00000100:00100000:2.0:1782758904.241241:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1782758904.241251:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211782656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758904.241303:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758904.241388:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211782656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758904.241395:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1782758904.241651:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211782656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758904.428411:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758905.452119:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758906.475989:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758906.795989:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758906.796065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758906.796143:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782784 00000100:00100000:3.0:1782758906.796151:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782784 00000100:00100000:3.0:1782758906.796209:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1782758906.796218:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211782784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758906.796252:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758906.796302:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211782784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758906.796309:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00080000:3.0:1782758906.796330:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758906.796371:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211782784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758907.500018:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758907.970548:0:109407:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6136a1a0 20000000:00000080:1.0:1782758907.970567:0:109407:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e5400 uarg=0000000000000000 00010000:00010000:1.0:1782758907.978521:0:109407:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758907.978544:0:109407:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758907.978582:0:109407:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758907.978602:0:109407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.978620:0:109407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.978630:0:109407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.978674:0:109407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.978690:0:109407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 18 pid: 5793 timeout: 3076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758907.978705:0:109407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109407:1869355211782912:0@lo:104: 00000100:00100000:1.0:1782758907.978769:0:109407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758907.980918:0:109407:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0f840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758907.981159:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211782912 00000100:00100000:3.0:1782758907.981168:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211782912 00000100:00100000:3.0:1782758907.981236:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1782758907.981247:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109407:x1869355211782912:12345-0@lo:104: 00010000:00010000:3.0:1782758907.981363:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758907.981460:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758907.981466:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109407:x1869355211782912:12345-0@lo:104: Request processed in 222us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758907.981474:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00010000:00010000:0.0:1782758907.981536:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758907.981543:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981551:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758907.981555:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981563:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758907.981571:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758907.981576:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758907.981618:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981630:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758907.981660:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981667:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694400/0xdd99f5c4777dc5dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981685:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758907.981686:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758907.981688:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758907.981696:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758907.981708:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211783040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758907.981747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758907.981787:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783040 00000100:00100000:0.0:1782758907.981791:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783040 00010000:00010000:0.0:1782758907.981810:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 19 pid: 5793 timeout: 3076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758907.981862:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1782758907.981870:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211783040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758907.981881:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758907.981885:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 19 pid: 5793 timeout: 3076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981912:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 19 pid: 5793 timeout: 3076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981929:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981940:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981965:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981972:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981979:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981984:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.981989:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758907.981993:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.982001:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.982009:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758907.982018:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758907.982046:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211783040:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758907.982052:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1782758907.982088:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211783040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758907.983067:0:109407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc5e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc5dc expref: 18 pid: 5793 timeout: 3076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758907.983082:0:109407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109407:1869355211782912:0@lo:104: 00010000:00010000:1.0:1782758907.983100:0:109407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.983110:0:109407:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.983115:0:109407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758907.983121:0:109407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc5ea lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758908.089328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758908.089403:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903552 00000100:00100000:0.0:1782758908.089413:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903552 00000100:00100000:0.0:1782758908.089468:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1641 00000100:00100000:0.0:1782758908.089478:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758908.089560:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196903552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758908.089568:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1641 00000100:00100000:3.0:1782758908.097519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758908.101109:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903680 00000100:00100000:1.0:1782758908.101128:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903680 00000100:00100000:0.0:1782758908.107077:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2134 00000100:00100000:0.0:1782758908.107093:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196903680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758908.107177:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196903680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (9665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758908.107185:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2134 00000100:00080000:0.0:1782758908.107205:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758908.525177:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758908.791698:0:109455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7ff9d830 20000000:00000080:2.0:1782758908.791719:0:109455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7833000 uarg=0000000000000000 00010000:00010000:2.0:1782758908.792360:0:109455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758908.792381:0:109455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758908.792402:0:109455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758908.792424:0:109455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792443:0:109455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792455:0:109455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792462:0:109455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792469:0:109455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792476:0:109455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792483:0:109455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758908.792487:0:109455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792495:0:109455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792509:0:109455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792517:0:109455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758908.792528:0:109455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5f1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758908.844064:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211783168:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.844159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758908.844208:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211783680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.844421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758908.844456:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758908.844462:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211783552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.844493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758908.844531:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783680 00000100:00100000:3.0:1782758908.844538:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783680 00000100:00100000:3.0:1782758908.844769:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1782758908.844780:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.845585:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211783296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.845636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758908.845661:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211783808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.845684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758908.845863:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211783680:12345-0@lo:400:kworker.0 Request processed in 1084us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758908.845872:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1782758908.845895:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783296 00000100:00100000:3.0:1782758908.845901:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783296 00000100:00100000:3.0:1782758908.845929:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:3.0:1782758908.845948:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211783296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758908.846046:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211783296:12345-0@lo:400:kworker.0 Request processed in 99us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758908.846058:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1782758908.846582:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211783296:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.846600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758908.846697:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211783424:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.846729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758908.846765:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783168 00000100:00100000:0.0:1782758908.846770:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783168 00000100:00100000:0.0:1782758908.846799:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1782758908.846806:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211783168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.846862:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211783168:12345-0@lo:400:kworker.0 Request processed in 56us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758908.846868:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00080000:0.0:1782758908.846896:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758908.846909:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783424 00000100:00100000:0.0:1782758908.846912:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783424 00000100:00100000:0.0:1782758908.846956:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1782758908.846963:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211783424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.846997:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211783424:12345-0@lo:400:kworker.0 Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758908.847003:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1782758908.847031:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211783168:0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.847044:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211783680:0@lo:400:kworker.0 00000100:00080000:0.0:1782758908.847072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758908.847091:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211783424:0@lo:400:kworker.0 00000100:00100000:2.0:1782758908.848122:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783552 00000100:00100000:2.0:1782758908.848131:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783552 00000100:00080000:0.0:1782758908.848208:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758908.848489:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783808 00000100:00100000:3.0:1782758908.848494:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783808 00000100:00100000:3.0:1782758908.848530:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:3.0:1782758908.848540:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211783552:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782758908.848729:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758908.848751:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1782758908.848760:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211783808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758908.848806:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211783808:12345-0@lo:400:kworker.0 Request processed in 47us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758908.848813:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1782758908.848873:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211783808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758908.850979:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211783552:12345-0@lo:400:kworker.0 Request processed in 2431us (6474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758908.850993:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1782758908.853163:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211783552:0@lo:400:kworker.0 00000100:00100000:1.0:1782758909.356085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782758909.356110:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211783936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782758909.356194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758909.356418:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211783936 00000100:00100000:3.0:1782758909.356427:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211783936 00000100:00100000:3.0:1782758909.356492:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1782758909.356502:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211783936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758909.356539:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758909.356599:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211783936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758909.356606:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1782758909.356664:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211783936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758909.550100:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758909.550144:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758909.550148:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758909.550152:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758909.550192:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.550204:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.550216:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758909.550241:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211784064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758909.550303:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758909.554284:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb480 going to sleep for 11 seconds 00000100:00100000:2.0:1782758909.554495:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784064 00000100:00100000:2.0:1782758909.554504:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784064 00000100:00100000:2.0:1782758909.554565:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:2.0:1782758909.554574:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211784064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758909.554590:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758909.554611:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc5f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758909.554640:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758909.554652:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758909.554661:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694600, rc 0) 00000100:00100000:2.0:1782758909.554773:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211784064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758909.554780:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1782758909.556027:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211784064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758909.556050:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758909.556061:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758909.556084:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758909.556090:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758909.556096:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782758909.621634:0:109503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7ac8a240 20000000:00000080:1.0:1782758909.621652:0:109503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c5c00 uarg=0000000000000000 00010000:00010000:1.0:1782758909.621947:0:109503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758909.621963:0:109503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758909.621980:0:109503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758909.621998:0:109503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.622016:0:109503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.622025:0:109503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.622063:0:109503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.622076:0:109503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 18 pid: 5793 timeout: 3078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758909.622091:0:109503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109503:1869355211784192:0@lo:104: 00000100:00100000:1.0:1782758909.622156:0:109503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758909.622206:0:109503:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448240 going to sleep for 11 seconds 00000100:00100000:0.0:1782758909.622628:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784192 00000100:00100000:0.0:1782758909.622637:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784192 00000100:00100000:0.0:1782758909.622686:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1782758909.622695:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109503:x1869355211784192:12345-0@lo:104: 00010000:00010000:0.0:1782758909.622708:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622776:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758909.622784:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109503:x1869355211784192:12345-0@lo:104: Request processed in 90us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758909.622791:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00010000:0.0:1782758909.622814:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758909.622845:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622854:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758909.622859:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622869:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758909.622876:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758909.622883:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758909.622927:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622934:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758909.622951:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622958:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50a00/0xdd99f5c4777dc5f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc5ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.622973:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758909.622975:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758909.622977:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758909.622987:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211784320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758909.623015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758909.623047:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784320 00000100:00100000:0.0:1782758909.623051:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784320 00010000:00010000:0.0:1782758909.623065:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 19 pid: 5793 timeout: 3078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758909.623083:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1782758909.623089:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211784320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758909.623099:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758909.623103:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 19 pid: 5793 timeout: 3078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623113:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 19 pid: 5793 timeout: 3078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623128:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623136:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623148:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623155:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623419:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623433:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623440:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758909.623444:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623451:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623460:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758909.623469:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758909.623535:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211784320:12345-0@lo:103:ldlm_bl.0 Request processed in 445us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758909.623542:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:1.0:1782758909.623813:0:109503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc5ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc5f8 expref: 18 pid: 5793 timeout: 3078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758909.623851:0:109503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109503:1869355211784192:0@lo:104: 00010000:00010000:1.0:1782758909.623867:0:109503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.623876:0:109503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.623882:0:109503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758909.623889:0:109503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc606 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758909.627521:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211784320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758910.573997:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758911.211998:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758911.212007:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758911.212012:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758911.212068:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758911.212079:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758911.212090:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758911.212117:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211784448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758911.212198:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758911.212264:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758911.212338:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784448 00000100:00100000:0.0:1782758911.212347:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784448 00000100:00100000:0.0:1782758911.212403:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:0.0:1782758911.212413:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211784448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758911.212427:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758911.212440:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc60d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758911.212462:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758911.212472:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758911.212482:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782758911.212523:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211784448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758911.212530:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1782758911.212737:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211784448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758911.212751:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758911.212760:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758911.212783:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758911.212789:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758911.212796:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758911.596951:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758911.918730:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211784576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758911.918811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758911.923330:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784576 00000100:00100000:0.0:1782758911.923350:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784576 00000100:00100000:0.0:1782758911.923438:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1782758911.923450:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211784576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758911.923501:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758911.923600:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211784576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758911.923607:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00080000:1.0:1782758911.924064:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758911.925549:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211784576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758912.621028:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758913.206917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758913.206965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758913.207032:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903936 00000100:00100000:3.0:1782758913.207042:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903936 00000100:00100000:3.0:1782758913.211208:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:3.0:1782758913.211227:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196903936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758913.211317:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196903936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 96us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758913.211326:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:0.0:1782758913.212789:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196903808 00000100:00100000:0.0:1782758913.212802:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196903808 00000100:00100000:0.0:1782758913.212888:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1645 00000100:00100000:0.0:1782758913.212896:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196903808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758913.212950:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196903808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (5984us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758913.212957:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1645 00000100:00080000:1.0:1782758913.214275:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758913.645103:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758913.733586:0:109701:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff2c65b40 20000000:00000080:1.0:1782758913.733604:0:109701:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c7000 uarg=0000000000000000 00010000:00010000:1.0:1782758913.734536:0:109701:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782758913.734554:0:109701:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782758913.734572:0:109701:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758913.734592:0:109701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.734610:0:109701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.734618:0:109701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.734663:0:109701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.734680:0:109701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 18 pid: 5794 timeout: 3082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758913.734698:0:109701:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109701:1869355211784704:0@lo:104: 00000100:00100000:1.0:1782758913.734775:0:109701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758913.734893:0:109701:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a840 going to sleep for 11 seconds 00000100:00100000:3.0:1782758913.735147:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784704 00000100:00100000:3.0:1782758913.735171:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784704 00000100:00100000:3.0:1782758913.735229:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1782758913.735240:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109701:x1869355211784704:12345-0@lo:104: 00010000:00010000:3.0:1782758913.735257:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735347:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758913.735354:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109701:x1869355211784704:12345-0@lo:104: Request processed in 116us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758913.735618:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00010000:00010000:3.0:1782758913.735647:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758913.735653:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735661:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758913.735665:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735675:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758913.735682:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758913.735688:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758913.735724:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735731:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758913.735754:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735761:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc60d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc614 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.735777:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758913.735779:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758913.735781:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758913.735800:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211784832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758913.735881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758913.735933:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784832 00000100:00100000:3.0:1782758913.735937:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784832 00010000:00010000:3.0:1782758913.735968:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 3082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758913.736067:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1782758913.736075:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211784832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758913.736090:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758913.736096:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 3082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736107:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 3082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736125:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736133:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736265:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736275:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736281:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736287:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736293:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758913.736298:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736305:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736315:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758913.736327:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758913.736691:0:109701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc614 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc60d expref: 19 pid: 5794 timeout: 3082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758913.736704:0:109701:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109701:1869355211784704:0@lo:104: 00010000:00010000:1.0:1782758913.736726:0:109701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.736735:0:109701:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.736741:0:109701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758913.736747:0:109701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc61b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758913.737122:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211784832:12345-0@lo:103:ldlm_bl.0 Request processed in 1046us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758913.737131:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1782758913.737410:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211784832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758913.971465:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211785344:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.971677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758913.971737:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758913.971744:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211784960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.971769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758913.971787:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211785472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.971810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758913.971879:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211785088:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758913.972063:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758913.972068:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211785216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758913.972190:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785344 00000100:00100000:2.0:1782758913.972198:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785344 00000100:00100000:2.0:1782758913.972256:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211784960 00000100:00100000:2.0:1782758913.972260:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211784960 00000100:00100000:2.0:1782758913.972279:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785088 00000100:00100000:2.0:1782758913.972281:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785088 00000100:00100000:2.0:1782758913.972301:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1782758913.972309:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211785344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972370:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211785344:12345-0@lo:400:kworker.0 Request processed in 61us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758913.972377:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1782758913.972394:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1782758913.972401:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211784960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972427:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211784960:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758913.972433:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1782758913.972444:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1782758913.972450:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211785088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972480:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211785088:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758913.972485:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1782758913.972511:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785472 00000100:00100000:2.0:1782758913.972514:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785472 00000100:00100000:2.0:1782758913.972676:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785216 00000100:00100000:2.0:1782758913.972681:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785216 00000100:00100000:2.0:1782758913.972708:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1782758913.972714:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972750:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211785472:12345-0@lo:400:kworker.0 Request processed in 36us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758913.972755:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1782758913.972766:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1782758913.972772:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211785216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.972800:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211785216:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758913.972806:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00080000:2.0:1782758913.972864:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758913.972869:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758913.972871:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758913.973054:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211785216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.973068:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211785088:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.973100:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211784960:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.973198:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211785472:0@lo:400:kworker.0 00000100:00100000:2.0:1782758913.973212:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211785344:0@lo:400:kworker.0 00000100:00100000:0.0:1782758914.477058:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758914.477086:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211785600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758914.477186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758914.477425:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785600 00000100:00100000:1.0:1782758914.477434:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785600 00000100:00100000:1.0:1782758914.477489:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1782758914.477499:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211785600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758914.477536:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758914.477585:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211785600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758914.477592:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1782758914.478339:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211785600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758914.668149:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758915.180065:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758915.180074:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758915.180079:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758915.180146:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758915.180160:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758915.180172:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758915.180202:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211785728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758915.180281:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758915.180352:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758915.181283:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785728 00000100:00100000:3.0:1782758915.181294:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785728 00000100:00100000:3.0:1782758915.181443:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1782758915.181454:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211785728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758915.181471:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758915.181488:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc622 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758915.181514:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758915.181526:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758915.181535:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782758915.181593:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211785728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758915.181600:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1782758915.181937:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211785728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758915.181956:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758915.181965:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758915.181991:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758915.181997:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758915.182004:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758915.695222:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758916.717029:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758917.051456:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758917.051549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758917.051633:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785856 00000100:00100000:1.0:1782758917.051641:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785856 00000100:00100000:1.0:1782758917.053882:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1782758917.053916:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211785856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758917.053967:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758917.054064:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211785856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758917.054072:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00080000:2.0:1782758917.054134:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758917.054372:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211785856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758917.741627:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758918.325442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758918.325498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758918.325605:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904192 00000100:00100000:2.0:1782758918.325616:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904192 00000100:00100000:2.0:1782758918.325703:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00100000:2.0:1782758918.325714:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196904192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758918.325868:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196904192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758918.325877:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00100000:0.0:1782758918.325967:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904064 00000100:00100000:0.0:1782758918.325972:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904064 00000100:00100000:0.0:1782758918.326012:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1647 00000100:00100000:0.0:1782758918.326020:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196904064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758918.326049:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196904064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758918.326055:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1647 00000100:00080000:3.0:1782758918.326173:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758918.764225:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782758918.822358:0:109898:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25c: test yaml-compliance for nodemap ========================================================== 14:48:36 (1782758916) 00000100:00100000:2.0:1782758919.087299:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211785984:0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.087392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758919.087449:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211786496:0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.087478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758919.087503:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782758919.087509:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211786112:0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.087529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758919.087546:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211786624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.087571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758919.087606:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211785984 00000100:00100000:2.0:1782758919.087615:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211785984 00000100:00100000:2.0:1782758919.087681:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:2.0:1782758919.087691:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211785984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.087772:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211785984:12345-0@lo:400:kworker.0 Request processed in 82us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758919.087780:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:2.0:1782758919.087850:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786496 00000100:00100000:2.0:1782758919.087854:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786496 00000100:00100000:0.0:1782758919.087993:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786624 00000100:00100000:0.0:1782758919.087999:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786624 00000100:00100000:1.0:1782758919.088059:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211786240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.088103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758919.088137:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758919.088144:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211786368:0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.088166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758919.088202:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786112 00000100:00100000:1.0:1782758919.088206:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786112 00000100:00100000:1.0:1782758919.088240:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786240 00000100:00100000:1.0:1782758919.088245:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786240 00000100:00100000:2.0:1782758919.091331:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1782758919.091350:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211786112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.091464:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211786112:12345-0@lo:400:kworker.0 Request processed in 120us (3932us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758919.091472:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1782758919.091499:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:2.0:1782758919.091507:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211786496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.091538:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211786496:12345-0@lo:400:kworker.0 Request processed in 32us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758919.091545:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:2.0:1782758919.091582:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786368 00000100:00100000:2.0:1782758919.091591:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786368 00000100:00080000:3.0:1782758919.092361:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758919.092368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758919.092373:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758919.092551:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1782758919.092563:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211786240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.092631:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211786240:12345-0@lo:400:kworker.0 Request processed in 70us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758919.092638:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1782758919.092708:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211786240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.092799:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211786112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.092814:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211785984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758919.092859:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211786496:0@lo:400:kworker.0 00000100:00100000:0.0:1782758919.093552:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1782758919.093562:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211786624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758919.093628:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211786624:12345-0@lo:400:kworker.0 Request processed in 69us (6055us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758919.093635:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:1.0:1782758919.093982:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211786624:0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.094268:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:2.0:1782758919.094278:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211786368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758919.094338:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211786368:12345-0@lo:400:kworker.0 Request processed in 62us (6171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758919.094344:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:1.0:1782758919.094419:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211786368:0@lo:400:kworker.0 00000100:00100000:0.0:1782758919.597979:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758919.598022:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211786752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758919.598130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758919.598296:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786752 00000100:00100000:1.0:1782758919.598305:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786752 00000100:00100000:1.0:1782758919.598363:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1782758919.598374:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211786752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758919.598414:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758919.598463:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211786752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758919.598469:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1782758919.598635:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211786752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758919.793221:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758919.868923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758919.869229:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904320 00000100:00100000:2.0:1782758919.869249:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904320 00000100:00100000:2.0:1782758919.869345:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1273 00000100:00100000:2.0:1782758919.869357:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:66673:x1869355196904320:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782758919.869384:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758919.869414:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6505d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.869494:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.869511:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.869524:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782758919.879781:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758919.879795:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782758919.880226:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758919.880276:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695400/0xdd99f5c4777dc630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6505d expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758919.880304:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6505d expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758919.880313:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:3.0:1782758919.880316:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782758919.880319:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:3.0:1782758919.880928:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904320:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11570us (12025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758919.880940:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1273 00000100:00100000:3.0:1782758919.891610:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758919.892092:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904448 00000100:00100000:1.0:1782758919.892108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904448 00000100:00100000:1.0:1782758919.892628:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:1.0:1782758919.892647:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904448:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782758919.892681:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758919.903638:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc63e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65064 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905591:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905614:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905626:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905642:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905649:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905656:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905985:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905993:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.905999:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906005:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758919.906011:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906018:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906030:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:1.0:1782758919.906034:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758919.906038:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906043:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dc645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906056:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906061:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906067:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906071:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758919.906074:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906080:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906086:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6cb9a5d (ffff9171889c5f00) 00010000:00010000:1.0:1782758919.906088:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758919.906091:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906097:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc64c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906137:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc63e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65064 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906148:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:1.0:1782758919.906150:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758919.906153:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc63e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65064 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.906162:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782758919.906262:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 13621us (14669us total) trans 0 rc 301/301 00000100:00100000:1.0:1782758919.906272:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1274 00000100:00100000:1.0:1782758919.925281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758919.925403:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904576 00000100:00100000:0.0:1782758919.925415:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904576 00000100:00100000:0.0:1782758919.926133:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:0.0:1782758919.926152:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904576:12345-192.168.204.31@tcp:700:lfs.0 00000100:00100000:0.0:1782758919.926260:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904576:12345-192.168.204.31@tcp:700:lfs.0 Request processed in 114us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758919.926269:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1782758919.930232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758919.930568:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904832 00000100:00100000:1.0:1782758919.930585:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904832 00000100:00100000:1.0:1782758919.930662:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1275 00000100:00100000:1.0:1782758919.930673:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:66673:x1869355196904832:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1782758919.930746:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758919.930778:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694c00/0xdd99f5c4777dc637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6505d expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.930800:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:1.0:1782758919.930812:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782758919.931189:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.931203:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.931212:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.931224:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.931230:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.931235:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782758919.935575:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782758919.935598:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.935610:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.935618:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.935624:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782758919.935629:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.936228:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.936250:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782758919.936253:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782758919.936260:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758919.936267:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc653 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782758919.936292:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c8b7684 reply state 0000000017e73c65 transno 4294967786 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758919.936303:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782758919.937617:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+7:66673:x1869355196904832:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 6928us (7379us total) trans 4294967786 rc 0/0 00000100:00100000:1.0:1782758919.938749:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1275 00010000:00010000:2.0:1782758919.940084:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940101:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940109:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940115:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782758919.940121:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940128:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940147:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6cb9a5d (ffff9171889c5e00) 00010000:00010000:2.0:1782758919.940150:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782758919.940155:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758919.940166:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc65a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758920.816240:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:0.0:1782758921.230241:0:109946:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1782758921.230249:0:109946:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000001:00080000:2.0:1782758921.716718:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967786 is committed 00010000:00010000:3.0:1782758921.840065:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758922.157084:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758922.157110:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211786880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758922.157183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758922.157400:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211786880 00000100:00100000:1.0:1782758922.157409:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211786880 00000100:00080000:0.0:1782758922.157976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758922.158223:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1782758922.158241:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211786880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758922.158289:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758922.158361:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211786880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758922.158369:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1782758922.158428:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211786880:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782758922.279547:0:109995:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffddd67ce0 20000000:00000080:3.0:1782758922.279565:0:109995:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171a0d13800 uarg=0000000000000000 10000000:01000000:3.0:1782758922.280366:0:109995:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758922.280387:0:109995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758922.280405:0:109995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758922.280413:0:109995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758922.280459:0:109995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758922.280474:0:109995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 18 pid: 5793 timeout: 3090 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758922.280490:0:109995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109995:1869355211787008:0@lo:104: 00000100:00100000:3.0:1782758922.280558:0:109995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758922.280633:0:109995:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24840 going to sleep for 11 seconds 00000100:00100000:1.0:1782758922.280794:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787008 00000100:00100000:1.0:1782758922.280804:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787008 00000100:00100000:1.0:1782758922.281039:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1782758922.281050:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109995:x1869355211787008:12345-0@lo:104: 00010000:00010000:1.0:1782758922.281067:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758922.281144:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758922.281151:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:109995:x1869355211787008:12345-0@lo:104: Request processed in 104us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758922.281159:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1782758922.281252:0:109995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109995:1869355211787008:0@lo:104: 00010000:00010000:2.0:1782758922.281268:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758922.281275:0:109995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281278:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281294:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758922.281299:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281309:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758922.281317:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758922.281323:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758922.281360:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281367:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758922.281402:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281410:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777dc622 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc629 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281425:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758922.281428:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758922.281430:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758922.281472:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758922.281486:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211787136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758922.281523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758922.281603:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787136 00000100:00100000:2.0:1782758922.281607:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787136 00010000:00010000:2.0:1782758922.281627:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 3090 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758922.281662:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1782758922.281681:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211787136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758922.281693:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758922.281697:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 3090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281708:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 3090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281722:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc629 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc622 expref: 19 pid: 5793 timeout: 3090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281735:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281743:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281756:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281762:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281768:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281774:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281779:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758922.281784:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281791:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281813:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758922.281957:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758922.281993:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211787136:12345-0@lo:103:ldlm_bl.0 Request processed in 324us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758922.282002:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1782758922.282072:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211787136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758922.282110:0:109995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758922.282118:0:109995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758922.282124:0:109995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc661 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758922.863972:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758923.174528:0:110043:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa74f4a10 20000000:00000080:3.0:1782758923.174550:0:110043:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbcfc800 uarg=0000000000000000 10000000:01000000:3.0:1782758923.175269:0:110043:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758923.175294:0:110043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175312:0:110043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175323:0:110043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175329:0:110043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175336:0:110043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175344:0:110043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175350:0:110043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758923.175356:0:110043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175364:0:110043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175379:0:110043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175387:0:110043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.175394:0:110043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc668 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758923.445616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758923.445673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758923.445717:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905088 00000100:00100000:3.0:1782758923.445728:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905088 00000100:00100000:3.0:1782758923.445801:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2146 00000100:00100000:3.0:1782758923.445812:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196905088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758923.446807:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196905088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 991us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758923.449069:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2146 00000100:00100000:3.0:1782758923.449144:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196904960 00000100:00100000:3.0:1782758923.449156:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196904960 00000100:00100000:3.0:1782758923.450559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1649 00000100:00100000:3.0:1782758923.450578:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196904960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758923.450686:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196904960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758923.450694:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1649 00000100:00080000:0.0:1782758923.455033:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782758923.757806:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758923.757839:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758923.757844:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758923.757900:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758923.757911:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758923.757922:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758923.757948:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211787264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758923.758030:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758923.758087:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758923.759729:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787264 00000100:00100000:3.0:1782758923.759743:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787264 00000100:00100000:3.0:1782758923.759799:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1782758923.759809:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211787264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758923.759852:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758923.759871:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc66f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.759898:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.759908:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.759916:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782758923.759976:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211787264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758923.759982:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:2.0:1782758923.760259:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211787264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758923.760279:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758923.760289:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758923.760314:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758923.760319:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758923.760325:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758923.884170:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758924.207692:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211787392:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.207784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758924.207914:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787392 00000100:00100000:2.0:1782758924.207917:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211787904:0@lo:400:kworker.0 00000100:00100000:1.0:1782758924.207922:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787392 00000100:00100000:2.0:1782758924.207947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758924.207977:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1782758924.207984:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782758924.207987:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211787392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.207990:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211787776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.208013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758924.208047:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211787392:12345-0@lo:400:kworker.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758924.208052:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787904 00000100:00100000:1.0:1782758924.208055:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1782758924.208056:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787904 00000100:00100000:1.0:1782758924.208081:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787776 00000100:00100000:1.0:1782758924.208084:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787776 00000100:00100000:2.0:1782758924.208089:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:2.0:1782758924.208094:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211787904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758924.208120:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1782758924.208129:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211787904:12345-0@lo:400:kworker.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758924.208136:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:1.0:1782758924.208136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211787776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758924.208161:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758924.208167:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758924.208170:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211787776:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758924.208179:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1782758924.208193:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211787776:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.208205:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211787392:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.208213:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211787904:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.209540:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211787520:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.209604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758924.210612:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758924.210625:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211787648:0@lo:400:kworker.0 00000100:00100000:2.0:1782758924.210680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758924.210940:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787648 00000100:00100000:3.0:1782758924.210950:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787648 00000100:00100000:3.0:1782758924.211025:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:3.0:1782758924.211036:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758924.211104:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211787648:12345-0@lo:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758924.211112:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00080000:3.0:1782758924.211148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758924.211187:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211787648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758924.214818:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211787520 00000100:00100000:1.0:1782758924.215169:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211787520 00000100:00100000:1.0:1782758924.216303:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:1.0:1782758924.216314:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758924.216411:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211787520:12345-0@lo:400:kworker.0 Request processed in 99us (6808us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758924.216418:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:1.0:1782758924.216503:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211787520:0@lo:400:kworker.0 00000100:00080000:3.0:1782758924.217718:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782758924.228779:0:110092:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefed0c7e0 20000000:00000080:1.0:1782758924.228804:0:110092:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e4400 uarg=0000000000000000 10000000:01000000:1.0:1782758924.229095:0:110092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758924.229120:0:110092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758924.229142:0:110092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758924.229152:0:110092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758924.229202:0:110092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758924.229216:0:110092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 18 pid: 5794 timeout: 3092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758924.229233:0:110092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110092:1869355211788032:0@lo:104: 00000100:00100000:1.0:1782758924.229317:0:110092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758924.229455:0:110092:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3d240 going to sleep for 11 seconds 00000100:00100000:3.0:1782758924.229618:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788032 00000100:00100000:3.0:1782758924.229638:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788032 00000100:00100000:3.0:1782758924.229730:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1782758924.229742:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110092:x1869355211788032:12345-0@lo:104: 00010000:00010000:3.0:1782758924.229757:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758924.229868:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758924.229875:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110092:x1869355211788032:12345-0@lo:104: Request processed in 136us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758924.229885:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00010000:00010000:2.0:1782758924.229945:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782758924.229952:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.229961:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758924.229965:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.229976:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758924.229984:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758924.229996:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758924.230034:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230041:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758924.230067:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230074:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694a00/0xdd99f5c4777dc66f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc676 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230092:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758924.230093:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758924.230095:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758924.230114:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211788160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758924.230147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758924.230192:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788160 00000100:00100000:2.0:1782758924.230196:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788160 00010000:00010000:2.0:1782758924.230219:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 19 pid: 5794 timeout: 3092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758924.230242:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1782758924.230248:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211788160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758924.230261:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758924.230266:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 19 pid: 5794 timeout: 3092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230277:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 19 pid: 5794 timeout: 3092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230297:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230307:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230323:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230330:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230337:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230342:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230347:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758924.230352:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230360:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230367:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758924.230378:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758924.230403:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211788160:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758924.230410:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1782758924.230467:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211788160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758924.230585:0:110092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc676 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc66f expref: 18 pid: 5794 timeout: 3092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758924.230595:0:110092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110092:1869355211788032:0@lo:104: 00010000:00010000:0.0:1782758924.230613:0:110092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758924.230622:0:110092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758924.230644:0:110092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758924.230649:0:110092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc67d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758924.721747:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211788288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758924.721866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758924.722088:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788288 00000100:00100000:3.0:1782758924.722100:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788288 00000100:00100000:3.0:1782758924.722180:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1782758924.722191:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211788288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758924.722233:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758924.722304:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211788288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758924.722310:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1782758924.722365:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211788288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758924.908290:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758925.185908:0:110140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeaef99050 20000000:00000080:1.0:1782758925.185927:0:110140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e4400 uarg=0000000000000000 10000000:01000000:1.0:1782758925.186159:0:110140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758925.186182:0:110140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186197:0:110140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186208:0:110140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186215:0:110140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186222:0:110140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186229:0:110140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186235:0:110140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758925.186239:0:110140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186247:0:110140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186258:0:110140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186265:0:110140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.186274:0:110140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777dc684 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758925.485124:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782758925.485134:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782758925.485140:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782758925.485204:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758925.485218:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758925.485233:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758925.485263:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211788416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782758925.485360:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758925.485497:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1782758925.485806:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788416 00000100:00100000:3.0:1782758925.485815:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788416 00000100:00100000:3.0:1782758925.486163:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1782758925.486174:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211788416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758925.486192:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758925.486212:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc68b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758925.486241:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758925.486254:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758925.486266:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690000, rc 0) 00000100:00100000:3.0:1782758925.486329:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211788416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758925.486337:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:2.0:1782758925.486421:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211788416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758925.486440:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758925.486449:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758925.486478:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758925.486484:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758925.486492:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758925.939108:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758926.074312:0:110188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8b70db30 20000000:00000080:0.0:1782758926.074335:0:110188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c5000 uarg=0000000000000000 10000000:01000000:0.0:1782758926.074543:0:110188:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758926.074561:0:110188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.074581:0:110188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.074590:0:110188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.074645:0:110188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.074659:0:110188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 18 pid: 5793 timeout: 3094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758926.074675:0:110188:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110188:1869355211788544:0@lo:104: 00000100:00100000:0.0:1782758926.074786:0:110188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758926.074871:0:110188:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758926.075173:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782758926.075186:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788544 00000100:00100000:1.0:1782758926.075193:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788544 00000100:00100000:1.0:1782758926.075244:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1782758926.075254:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170812ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110188:x1869355211788544:12345-0@lo:104: 00010000:00010000:1.0:1782758926.075269:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758926.075330:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782758926.075336:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170812ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110188:x1869355211788544:12345-0@lo:104: Request processed in 84us (550us total) trans 0 rc 0/0 00010000:00010000:2.0:1782758926.075340:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782758926.075343:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00010000:00010000:2.0:1782758926.075347:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075355:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782758926.075359:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075366:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782758926.075373:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758926.075378:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758926.075419:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075426:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758926.075457:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075468:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694600/0xdd99f5c4777dc68b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc692 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075481:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758926.075483:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758926.075485:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758926.075493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758926.075504:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211788672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782758926.075541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758926.075574:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788672 00000100:00100000:2.0:1782758926.075578:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788672 00010000:00010000:2.0:1782758926.075607:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 19 pid: 5793 timeout: 3094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758926.075627:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1782758926.075633:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211788672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758926.075642:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758926.075646:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 19 pid: 5793 timeout: 3094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075655:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 19 pid: 5793 timeout: 3094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075670:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075677:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075692:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075699:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075706:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075712:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075716:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758926.075720:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075727:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075734:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758926.075741:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758926.075765:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211788672:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758926.075771:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1782758926.075801:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211788672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758926.077583:0:110188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690000/0xdd99f5c4777dc692 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc68b expref: 18 pid: 5793 timeout: 3094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758926.077613:0:110188:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110188:1869355211788544:0@lo:104: 00010000:00010000:0.0:1782758926.077636:0:110188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.077646:0:110188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.077652:0:110188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758926.077657:0:110188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dc699 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758926.956436:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782758927.153339:0:110237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeec6eb3c0 20000000:00000080:1.0:1782758927.153359:0:110237:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170812ea800 uarg=0000000000000000 10000000:01000000:1.0:1782758927.153880:0:110237:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782758927.153902:0:110237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153918:0:110237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153927:0:110237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153934:0:110237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153941:0:110237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153949:0:110237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153955:0:110237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758927.153959:0:110237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153966:0:110237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153979:0:110237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153987:0:110237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758927.153993:0:110237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc6a0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758927.212029:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758927.212037:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758927.212041:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758927.212092:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758927.212104:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758927.212115:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758927.212146:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211788800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758927.212227:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758927.212280:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916840 going to sleep for 11 seconds 00000100:00100000:2.0:1782758927.213745:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788800 00000100:00100000:2.0:1782758927.213759:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788800 00000100:00100000:2.0:1782758927.214358:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1782758927.214371:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211788800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758927.214393:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758927.214415:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc6a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758927.214545:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758927.214558:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758927.214567:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758927.214658:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211788800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 289us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758927.214666:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1782758927.215138:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211788800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758927.215160:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758927.215171:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758927.215191:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758927.215196:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758927.215203:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758927.278434:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782758927.278457:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211788928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758927.278525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758927.278606:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211788928 00000100:00100000:3.0:1782758927.278615:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211788928 00000100:00100000:3.0:1782758927.278672:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1782758927.278681:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211788928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758927.278720:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758927.278764:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211788928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758927.278772:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00080000:3.0:1782758927.278792:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758927.278840:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211788928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782758927.980418:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758928.563994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758928.564052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758928.564186:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905344 00000100:00100000:2.0:1782758928.564197:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905344 00000100:00100000:2.0:1782758928.564269:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:2.0:1782758928.564279:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196905344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758928.564353:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196905344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758928.564360:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:0.0:1782758928.564707:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905216 00000100:00100000:0.0:1782758928.564712:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905216 00000100:00100000:0.0:1782758928.564751:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1653 00000100:00100000:0.0:1782758928.564759:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758928.564792:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758928.564799:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1653 00000100:00080000:3.0:1782758928.565068:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758929.004174:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758929.324362:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211789312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758929.324468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758929.324624:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758929.324631:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211789440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758929.324665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758929.324714:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789312 00000100:00100000:0.0:1782758929.324725:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789312 00000100:00100000:0.0:1782758929.324799:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1782758929.324810:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.325616:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211789056:0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.325670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758929.325703:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211789568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.325725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758929.325747:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758929.325753:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211789184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.325773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758929.325784:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211789696:0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.325803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758929.326031:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789056 00000100:00100000:2.0:1782758929.326038:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789056 00000100:00100000:2.0:1782758929.326080:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1782758929.326088:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211789056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.326151:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211789056:12345-0@lo:400:kworker.0 Request processed in 63us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758929.326159:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1782758929.326196:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789568 00000100:00100000:2.0:1782758929.326199:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789568 00000100:00100000:2.0:1782758929.326224:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789184 00000100:00100000:2.0:1782758929.326227:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789184 00000100:00100000:2.0:1782758929.326238:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1782758929.326243:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211789568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.326271:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211789568:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758929.326277:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1782758929.326286:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:2.0:1782758929.326290:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.326311:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211789184:12345-0@lo:400:kworker.0 Request processed in 21us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758929.326316:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:2.0:1782758929.326369:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211789184:0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.326379:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211789056:0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.326387:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211789568:0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.326538:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789440 00000100:00100000:3.0:1782758929.326543:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789440 00000100:00100000:3.0:1782758929.326578:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789696 00000100:00100000:3.0:1782758929.326581:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789696 00000100:00100000:3.0:1782758929.326602:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1782758929.326608:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211789440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.326647:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211789440:12345-0@lo:400:kworker.0 Request processed in 40us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758929.326653:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1782758929.326663:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1782758929.326669:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211789696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758929.326692:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211789696:12345-0@lo:400:kworker.0 Request processed in 23us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758929.326697:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1782758929.326979:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211789312:12345-0@lo:400:kworker.0 Request processed in 2170us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758929.326987:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00080000:0.0:1782758929.327016:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758929.327020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758929.327022:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758929.327047:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211789440:0@lo:400:kworker.0 00000100:00100000:0.0:1782758929.327058:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211789312:0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.327144:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211789696:0@lo:400:kworker.0 00000100:00100000:2.0:1782758929.836238:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211789824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758929.836340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758929.836575:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789824 00000100:00100000:1.0:1782758929.836586:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789824 00000100:00100000:1.0:1782758929.836717:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1782758929.836730:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211789824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758929.836778:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758929.837112:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211789824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 383us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758929.837125:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1782758929.837154:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211789824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758930.028006:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758930.494426:0:110385:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdac0ce280 20000000:00000080:2.0:1782758930.494451:0:110385:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718853e000 uarg=0000000000000000 10000000:01000000:2.0:1782758930.495038:0:110385:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758930.495139:0:110385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.495164:0:110385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.495175:0:110385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.495230:0:110385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.495250:0:110385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 18 pid: 5796 timeout: 3098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758930.495271:0:110385:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110385:1869355211789952:0@lo:104: 00000100:00100000:2.0:1782758930.495373:0:110385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758930.495448:0:110385:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782758930.495535:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211789952 00000100:00100000:3.0:1782758930.495545:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211789952 00000100:00100000:3.0:1782758930.495679:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1782758930.495695:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110385:x1869355211789952:12345-0@lo:104: 00010000:00010000:3.0:1782758930.495716:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758930.495846:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758930.495855:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110385:x1869355211789952:12345-0@lo:104: Request processed in 164us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758930.495864:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1782758930.495892:0:110385:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110385:1869355211789952:0@lo:104: 00010000:00010000:0.0:1782758930.495928:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758930.495945:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.495960:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758930.495965:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.495976:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758930.495984:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758930.495991:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758930.496034:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.496042:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758930.496069:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.496076:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691800/0xdd99f5c4777dc6a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.496096:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758930.496098:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758930.496100:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758930.496126:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211790080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758930.496136:0:110385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758930.496177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758930.496557:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790080 00000100:00100000:2.0:1782758930.496563:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790080 00010000:00010000:2.0:1782758930.496589:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 3098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758930.496632:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1782758930.496639:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211790080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758930.496659:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758930.496665:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 3098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496678:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 3098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496697:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc6ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc6a7 expref: 19 pid: 5796 timeout: 3098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496714:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496725:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496744:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496764:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496772:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496781:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496792:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758930.496798:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496807:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496859:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758930.496871:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782758930.496907:0:110385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.496921:0:110385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758930.496928:0:110385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc6b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758930.497790:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211790080:12345-0@lo:103:ldlm_bl.0 Request processed in 1144us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758930.497802:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1782758930.497981:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211790080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758931.053852:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758931.725557:0:110434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce6208d60 20000000:00000080:2.0:1782758931.725574:0:110434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bc193000 uarg=0000000000000000 10000000:01000000:2.0:1782758931.725801:0:110434:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758931.725852:0:110434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725869:0:110434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725879:0:110434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725886:0:110434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725893:0:110434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725900:0:110434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725906:0:110434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758931.725910:0:110434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725918:0:110434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725931:0:110434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725939:0:110434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758931.725944:0:110434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6bc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758932.077253:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758932.077263:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758932.077268:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758932.077317:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758932.077330:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758932.077342:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758932.077368:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211790208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758932.077438:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758932.077503:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782758932.077624:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790208 00000100:00100000:2.0:1782758932.077632:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790208 00000100:00100000:2.0:1782758932.077691:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1782758932.077701:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211790208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758932.077717:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758932.077731:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc6c3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758932.077765:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758932.077776:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758932.077787:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758932.077865:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211790208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758932.077873:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1782758932.077924:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211790208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758932.077940:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758932.077951:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782758932.077972:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782758932.077977:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758932.077984:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758932.082408:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758932.396085:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211790336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758932.396156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758932.396276:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790336 00000100:00100000:0.0:1782758932.396285:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790336 00000100:00100000:0.0:1782758932.396345:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1782758932.396356:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211790336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758932.396390:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758932.396440:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211790336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758932.396451:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:3.0:1782758932.396515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758932.396553:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211790336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758933.099962:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758933.691621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758933.691688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758933.691753:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905600 00000100:00100000:3.0:1782758933.691763:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905600 00000100:00100000:3.0:1782758933.691842:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2154 00000100:00100000:3.0:1782758933.691854:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196905600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758933.691926:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196905600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758933.691934:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2154 00000100:00080000:3.0:1782758933.691954:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758933.694556:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905472 00000100:00100000:0.0:1782758933.694572:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905472 00000100:00100000:0.0:1782758933.694647:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1656 00000100:00100000:0.0:1782758933.694656:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758933.694745:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758933.694753:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1656 00010000:00010000:2.0:1782758934.135165:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758934.444078:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211790592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758934.444240:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211791104:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758934.444299:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758934.444305:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211790720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758934.444366:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790592 00000100:00100000:0.0:1782758934.444376:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790592 00000100:00100000:0.0:1782758934.444426:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790720 00000100:00100000:0.0:1782758934.444441:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790720 00000100:00100000:0.0:1782758934.444474:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1782758934.444482:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211790592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444532:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211790592:12345-0@lo:400:kworker.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758934.444540:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1782758934.444558:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1782758934.444566:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211790720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444593:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211790720:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758934.444599:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1782758934.444617:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791104 00000100:00100000:0.0:1782758934.444621:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791104 00000100:00100000:0.0:1782758934.444646:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1782758934.444652:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211791104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444679:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211791104:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758934.444684:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00080000:0.0:1782758934.444705:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758934.444709:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758934.444745:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211790720:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444758:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211790592:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.444767:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211791104:0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445086:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211790848:0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758934.445164:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782758934.445170:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211790464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758934.445222:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211790976:0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758934.445265:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790464 00000100:00100000:3.0:1782758934.445269:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790464 00000100:00100000:3.0:1782758934.445296:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1782758934.445302:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211790464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445334:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211790464:12345-0@lo:400:kworker.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758934.445340:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1782758934.445367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790976 00000100:00100000:3.0:1782758934.445371:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790976 00000100:00100000:3.0:1782758934.445396:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:3.0:1782758934.445402:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211790976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445429:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211790976:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758934.445450:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00080000:3.0:1782758934.445471:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758934.445486:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211790464:0@lo:400:kworker.0 00000100:00100000:3.0:1782758934.445496:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211790976:0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.445602:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211790848 00000100:00100000:0.0:1782758934.445606:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211790848 00000100:00100000:0.0:1782758934.445650:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1782758934.445656:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211790848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758934.445696:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211790848:12345-0@lo:400:kworker.0 Request processed in 40us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758934.445703:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1782758934.445729:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211790848:0@lo:400:kworker.0 00000100:00080000:3.0:1782758934.446330:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758934.959087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211791232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758934.959162:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758934.959246:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791232 00000100:00100000:2.0:1782758934.959256:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791232 00000100:00100000:2.0:1782758934.959309:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1782758934.959319:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211791232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758934.959360:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758934.959404:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211791232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758934.959411:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1782758934.959477:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211791232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758935.153860:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782758935.975191:0:110631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfcf26d90 20000000:00000080:0.0:1782758935.975221:0:110631:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc3800 uarg=0000000000000000 00010000:00010000:0.0:1782758935.986145:0:110631:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782758935.986166:0:110631:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782758935.986180:0:110631:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782758935.986199:0:110631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758935.986217:0:110631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758935.986224:0:110631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758935.986263:0:110631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758935.986279:0:110631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 18 pid: 5794 timeout: 3104 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758935.986296:0:110631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110631:1869355211791360:0@lo:104: 00000100:00100000:1.0:1782758935.990757:0:110631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758935.990841:0:110631:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059a840 going to sleep for 11 seconds 00000100:00100000:3.0:1782758935.990979:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791360 00000100:00100000:3.0:1782758935.990989:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791360 00000100:00100000:3.0:1782758935.991049:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1782758935.991059:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110631:x1869355211791360:12345-0@lo:104: 00010000:00010000:3.0:1782758935.991075:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991136:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758935.991142:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110631:x1869355211791360:12345-0@lo:104: Request processed in 86us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758935.991152:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00010000:00010000:3.0:1782758935.991173:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782758935.991178:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991187:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782758935.991190:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991198:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782758935.991205:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758935.991210:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782758935.991247:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991254:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782758935.991274:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991281:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51600/0xdd99f5c4777dc6c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6ca expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991298:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758935.991300:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758935.991302:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758935.991339:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211791488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782758935.991371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758935.991423:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791488 00000100:00100000:3.0:1782758935.991427:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791488 00010000:00010000:3.0:1782758935.991446:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 19 pid: 5794 timeout: 3104 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758935.991467:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1782758935.991473:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211791488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758935.991485:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782758935.991490:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 19 pid: 5794 timeout: 3104 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991501:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 19 pid: 5794 timeout: 3104 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991521:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991529:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991555:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991563:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991571:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991578:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991585:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782758935.991590:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991598:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991607:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758935.991617:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782758935.991644:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211791488:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758935.991651:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1782758935.991688:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211791488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758935.992436:0:110631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777dc6ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc6c3 expref: 18 pid: 5794 timeout: 3104 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758935.992450:0:110631:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110631:1869355211791360:0@lo:104: 00010000:00010000:1.0:1782758935.992468:0:110631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758935.992478:0:110631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758935.992485:0:110631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758935.992491:0:110631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc6d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758936.172113:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758937.196913:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758937.516352:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211791616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758937.516492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758937.516615:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791616 00000100:00100000:1.0:1782758937.516631:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791616 00000100:00100000:1.0:1782758937.516726:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1782758937.516737:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211791616:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758937.516815:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782758937.517119:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758937.517301:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211791616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 565us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758937.517309:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1782758937.528799:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211791616:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782758937.580245:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782758937.580931:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782758937.580939:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782758937.580990:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758937.581002:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758937.581014:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758937.581058:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211791744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782758937.581137:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758937.581212:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a05c6240 going to sleep for 11 seconds 00000100:00100000:2.0:1782758937.581388:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791744 00000100:00100000:2.0:1782758937.581395:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791744 00000100:00100000:2.0:1782758937.581455:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:2.0:1782758937.581464:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211791744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758937.581480:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758937.581495:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc6d8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758937.581518:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758937.581527:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758937.581536:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782758937.581591:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211791744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758937.581599:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:0.0:1782758937.581705:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211791744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758937.581732:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758937.581740:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758937.581760:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758937.581765:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758937.581773:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758938.221849:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758938.807681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758938.807742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758938.807857:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905728 00000100:00100000:0.0:1782758938.807872:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905728 00000100:00100000:0.0:1782758938.807950:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1659 00000100:00100000:0.0:1782758938.807962:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758938.808071:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196905728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758938.808080:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1659 00000100:00100000:2.0:1782758938.808302:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905856 00000100:00100000:2.0:1782758938.808307:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905856 00000100:00100000:2.0:1782758938.808380:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2158 00000100:00100000:2.0:1782758938.808388:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196905856:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758938.808429:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2363:x1869355196905856:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758938.808436:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2158 00000100:00080000:3.0:1782758938.809197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758939.253435:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758939.564490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782758939.565857:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782758939.565889:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211792000:0@lo:400:kworker.0 00000100:00100000:2.0:1782758939.565993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758939.566109:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792000 00000100:00100000:2.0:1782758939.566119:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792000 00000100:00100000:2.0:1782758939.566199:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1782758939.566208:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758939.566273:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211792000:12345-0@lo:400:kworker.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758939.566280:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1782758939.566343:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211792000:0@lo:400:kworker.0 00000100:00100000:2.0:1782758939.577671:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211791872:0@lo:400:kworker.0 00000100:00100000:2.0:1782758939.577784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758939.578157:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211791872 00000100:00100000:3.0:1782758939.578168:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211791872 00000100:00100000:3.0:1782758939.578237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:3.0:1782758939.578248:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211791872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758939.578345:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211791872:12345-0@lo:400:kworker.0 Request processed in 99us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758939.578353:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:2.0:1782758939.584222:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211791872:0@lo:400:kworker.0 00000100:00100000:2.0:1782758939.588384:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211792512:0@lo:400:kworker.0 00000100:00100000:1.0:1782758939.588416:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211792128:0@lo:400:kworker.0 00000100:00100000:3.0:1782758939.588953:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211792384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758939.589102:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211792256:0@lo:400:kworker.0 00000100:00100000:1.0:1782758939.592006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758939.593943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758939.594260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758939.594323:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792128 00000100:00100000:3.0:1782758939.594347:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792128 00000100:00100000:3.0:1782758939.594421:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792384 00000100:00100000:3.0:1782758939.594425:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792384 00000100:00100000:3.0:1782758939.594453:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1782758939.594463:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211792128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758939.594544:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211792128:12345-0@lo:400:kworker.0 Request processed in 82us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758939.594553:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1782758939.594572:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1782758939.594578:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758939.594613:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211792384:12345-0@lo:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758939.594619:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00080000:3.0:1782758939.594637:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758939.594699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211792128:0@lo:400:kworker.0 00000100:00100000:3.0:1782758939.594739:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211792384:0@lo:400:kworker.0 00000100:00100000:0.0:1782758939.601109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758939.601279:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792512 00000100:00100000:2.0:1782758939.601292:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792512 00000100:00100000:0.0:1782758939.601299:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792256 00000100:00100000:0.0:1782758939.601303:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792256 00000100:00100000:0.0:1782758939.601437:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1782758939.601450:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211792256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758939.601538:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211792256:12345-0@lo:400:kworker.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758939.601546:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1782758939.601625:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211792256:0@lo:400:kworker.0 00000100:00080000:3.0:1782758939.610307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758939.610364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758939.612744:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1782758939.612773:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211792512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758939.612972:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211792512:12345-0@lo:400:kworker.0 Request processed in 212us (19037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758939.612981:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:2.0:1782758939.615789:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211792512:0@lo:400:kworker.0 00000100:00100000:3.0:1782758940.076024:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211792640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758940.076106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758940.076212:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792640 00000100:00100000:2.0:1782758940.076222:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792640 00000100:00100000:2.0:1782758940.076280:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1782758940.076289:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211792640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758940.076338:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758940.076388:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211792640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758940.076396:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1782758940.076483:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211792640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758940.268128:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758941.196318:0:110829:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee33c18e0 20000000:00000080:2.0:1782758941.196341:0:110829:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc3c00 uarg=0000000000000000 10000000:01000000:2.0:1782758941.196846:0:110829:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758941.196868:0:110829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.196899:0:110829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.196910:0:110829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.196957:0:110829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.196970:0:110829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 18 pid: 5794 timeout: 3109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758941.196990:0:110829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110829:1869355211792768:0@lo:104: 00000100:00100000:2.0:1782758941.197061:0:110829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758941.197127:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792768 00000100:00100000:3.0:1782758941.197134:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792768 00000100:00100000:2.0:1782758941.197135:0:110829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782758941.197184:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1782758941.197193:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110829:x1869355211792768:12345-0@lo:104: 00010000:00010000:3.0:1782758941.197207:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758941.197271:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758941.197278:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:110829:x1869355211792768:12345-0@lo:104: Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758941.197284:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00010000:0.0:1782758941.197364:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758941.197372:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197379:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758941.197383:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197392:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758941.197400:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758941.197406:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758941.197444:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197451:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758941.197474:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197481:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dc6d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197498:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758941.197500:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758941.197503:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758941.197516:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211792896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758941.197552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758941.197590:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211792896 00000100:00100000:0.0:1782758941.197594:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211792896 00010000:00010000:0.0:1782758941.197613:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 19 pid: 5794 timeout: 3109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758941.197635:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1782758941.197641:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9380050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211792896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758941.197650:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758941.197654:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 19 pid: 5794 timeout: 3109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197664:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 19 pid: 5794 timeout: 3109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197680:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197689:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197702:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197710:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197716:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197728:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197734:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758941.197738:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197745:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197753:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758941.197761:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758941.197791:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9380050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211792896:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758941.197797:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1782758941.197886:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211792896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758941.198159:0:110829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc6d8 expref: 18 pid: 5794 timeout: 3109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758941.198169:0:110829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110829:1869355211792768:0@lo:104: 00010000:00010000:2.0:1782758941.198186:0:110829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.198194:0:110829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.198200:0:110829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758941.198206:0:110829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694600/0xdd99f5c4777dc6e6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758941.292866:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758942.284798:0:110878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed120af40 20000000:00000080:2.0:1782758942.284818:0:110878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb1400 uarg=0000000000000000 00010000:00010000:2.0:1782758942.285367:0:110878:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782758942.285385:0:110878:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782758942.285401:0:110878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758942.285422:0:110878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285438:0:110878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285449:0:110878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285455:0:110878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285462:0:110878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285468:0:110878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285473:0:110878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758942.285477:0:110878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285485:0:110878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285497:0:110878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285504:0:110878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758942.285509:0:110878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc6ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758942.324442:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758942.641544:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211793024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758942.641634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758942.642090:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793024 00000100:00100000:0.0:1782758942.642101:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793024 00000100:00100000:0.0:1782758942.642163:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1782758942.642174:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211793024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758942.642217:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758942.642290:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211793024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758942.642299:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:0.0:1782758942.642518:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758942.642564:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211793024:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1782758942.956455:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758942.956464:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758942.956468:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758942.956517:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758942.956529:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758942.956541:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758942.956569:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211793152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758942.956654:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758942.956716:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171907e70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782758942.958877:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793152 00000100:00100000:1.0:1782758942.958892:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793152 00000100:00100000:1.0:1782758942.958953:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1782758942.958964:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211793152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758942.958982:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758942.959004:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc6f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758942.959035:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758942.959049:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758942.959059:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782758942.959133:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211793152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758942.959140:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1782758942.961838:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211793152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758942.961869:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758942.961882:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758942.961906:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758942.961912:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758942.961925:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758943.341594:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758943.924975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758943.925009:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906112 00000100:00100000:2.0:1782758943.925021:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906112 00000100:00100000:0.0:1782758943.925027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758943.925110:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2162 00000100:00100000:3.0:1782758943.925117:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196905984 00000100:00100000:3.0:1782758943.925123:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196905984 00000100:00100000:2.0:1782758943.925124:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196906112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758943.925169:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1662 00000100:00100000:3.0:1782758943.925178:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196905984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758943.925220:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2364:x1869355196905984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758943.925232:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1662 00000100:00100000:2.0:1782758943.925232:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2364:x1869355196906112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758943.925253:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2162 00000100:00080000:2.0:1782758943.925277:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758944.371007:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758944.685115:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211793664:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.685186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688434:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758944.688459:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211793280:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.688551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688609:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211793792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.688639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688677:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211793408:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.688701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688720:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211793920:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.688747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688769:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782758944.688776:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211793536:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.688800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758944.688855:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793664 00000100:00100000:0.0:1782758944.688864:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793664 00000100:00100000:2.0:1782758944.689116:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793792 00000100:00100000:2.0:1782758944.689121:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793792 00000100:00100000:2.0:1782758944.689172:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793408 00000100:00100000:2.0:1782758944.689176:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793408 00000100:00100000:2.0:1782758944.689195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793536 00000100:00100000:2.0:1782758944.689198:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793536 00000100:00100000:2.0:1782758944.689216:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1782758944.689225:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211793792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.689302:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211793792:12345-0@lo:400:kworker.0 Request processed in 78us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758944.689310:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1782758944.689342:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1782758944.689349:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211793408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.689384:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211793408:12345-0@lo:400:kworker.0 Request processed in 35us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758944.689390:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1782758944.689403:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1782758944.689410:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211793536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.689437:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211793536:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758944.689442:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00080000:2.0:1782758944.689461:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758944.689609:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793280 00000100:00100000:1.0:1782758944.689614:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793280 00000100:00100000:1.0:1782758944.689650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1782758944.689657:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211793280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758944.689694:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211793280:12345-0@lo:400:kworker.0 Request processed in 38us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758944.689700:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:0.0:1782758944.689806:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211793920 00000100:00100000:0.0:1782758944.689811:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211793920 00000100:00100000:0.0:1782758944.689858:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1782758944.689865:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211793664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782758944.689974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758944.689976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758944.690021:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211793536:0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.690034:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211793408:0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.690160:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211793280:0@lo:400:kworker.0 00000100:00100000:2.0:1782758944.690171:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211793792:0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.690601:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211793664:12345-0@lo:400:kworker.0 Request processed in 736us (5413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758944.690609:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1782758944.690628:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1782758944.690636:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211793920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758944.690669:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211793920:12345-0@lo:400:kworker.0 Request processed in 35us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758944.690675:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:2.0:1782758944.690956:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211793664:0@lo:400:kworker.0 00000100:00100000:3.0:1782758944.691030:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211793920:0@lo:400:kworker.0 00000100:00100000:3.0:1782758945.196054:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758945.196081:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758945.196163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758945.196338:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794048 00000100:00100000:2.0:1782758945.196348:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794048 00000100:00100000:2.0:1782758945.196408:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1782758945.196419:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211794048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758945.196465:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758945.196530:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211794048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758945.196705:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758945.196802:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00010000:00010000:0.0:1782758945.388674:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758946.413980:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758946.544257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758946.545303:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906240 00000100:00100000:2.0:1782758946.545319:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906240 00000100:00100000:2.0:1782758946.545448:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1276 00000100:00100000:2.0:1782758946.545461:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:67066:x1869355196906240:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:2.0:1782758946.545485:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758946.545565:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6506b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.545650:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.545667:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.545681:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758946.545977:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758946.545984:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1782758946.546098:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.546125:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dc702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6506b expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.546143:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6506b expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758946.546153:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782758946.546156:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758946.546160:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695600, rc 0) 00000100:00100000:2.0:1782758946.546264:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:67066:x1869355196906240:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 805us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758946.546273:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1276 00000100:00080000:0.0:1782758946.546454:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782758947.437161:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758947.757475:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211794176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758947.757552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758947.758855:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794176 00000100:00100000:0.0:1782758947.758868:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794176 00000100:00100000:0.0:1782758947.758935:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1782758947.758946:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211794176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758947.758987:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782758947.761477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758947.770526:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211794176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11567us (12960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758947.770543:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1782758947.776944:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211794176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758947.808422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758947.808473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758947.808773:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906368 00000100:00100000:0.0:1782758947.808786:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906368 00000100:00100000:0.0:1782758947.808904:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906496 00000100:00100000:0.0:1782758947.808907:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906496 00000100:00100000:0.0:1782758947.808939:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:0.0:1782758947.808949:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+11:2363:x1869355196906368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758947.808968:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758947.808992:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65002 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758947.809019:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758947.809088:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196906368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 140us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758947.809096:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1782758947.809109:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+10:2363:x1869355196906496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782758947.809120:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758947.809133:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6502c expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758947.809144:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758947.809167:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+9:2363:x1869355196906496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758947.810511:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1782758947.818146:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1782758947.822267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758947.822325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758947.822459:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906752 00000100:00100000:2.0:1782758947.822471:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906752 00000100:00100000:2.0:1782758947.822538:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1782758947.822549:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+8:2362:x1869355196906752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782758947.822568:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758947.822594:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695c00/0xdd99f5c4777dc52d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65033 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758947.822614:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758947.822754:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196906880 00000100:00100000:0.0:1782758947.822758:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196906880 00000100:00100000:0.0:1782758947.822790:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1277 00000100:00100000:0.0:1782758947.822797:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+6:2360:x1869355196906880:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782758947.822854:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc534 00000020:00010000:0.0:1782758947.822864:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9171b760f800: total 0 00000100:00080000:0.0:1782758947.822869:0:7487:0:(import.c:65:import_set_state_nolock()) ffff9171b7608000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758947.822890:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967786 00000100:00100000:2.0:1782758947.823372:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+7:2362:x1869355196906752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 823us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758947.823381:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1782758947.825009:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28523624-e8ee-4ffc-a0c3-eabe66c3aef1+5:2360:x1869355196906880:12345-192.168.204.31@tcp:39:umount.0 Request processed in 2198us (2669us total) trans 4294967787 rc 0/0 00000100:00100000:0.0:1782758947.825025:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1277 00000020:00010000:0.0:1782758947.825065:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9171b760f800: total 0 00010000:00010000:0.0:1782758947.825127:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171b760f800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782758947.825177:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:0.0:1782758947.825182:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782758947.825190:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181695600/0xdd99f5c4777dc709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6506b expref: 4 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758947.825220:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171b760f800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782758947.825233:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758947.825235:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758947.825237:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758947.855086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758947.855390:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907136 00000100:00100000:3.0:1782758947.855402:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907136 00000100:00100000:3.0:1782758947.855469:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1664 00000100:00100000:3.0:1782758947.855481:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+7:2360:x1869355196907136:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782758947.855542:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc511 00000020:00010000:3.0:1782758947.855552:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9171bb692800: total 0 00000100:00080000:3.0:1782758947.855560:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9171bb696000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782758947.855684:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adcdaf9e-8a6b-4257-bb38-d6c55dc444fd+3:2360:x1869355196907136:12345-192.168.204.31@tcp:251:umount.0 Request processed in 205us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758947.855692:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1664 00000020:00010000:0.0:1782758947.855868:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9171bb692800: total 0 00010000:00010000:0.0:1782758947.855873:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758947.855924:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171bb692800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782758947.855965:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf64ffb expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758947.855985:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171bb692800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782758947.855994:0:5788:0:(genops.c:906:class_export_put()) final put ffff9171bb692800/adcdaf9e-8a6b-4257-bb38-d6c55dc444fd 00010000:00010000:0.0:1782758947.856005:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758947.856007:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758947.856009:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758947.857203:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bb692800/adcdaf9e-8a6b-4257-bb38-d6c55dc444fd for MGS 00000020:00000080:3.0:1782758947.857262:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bb696000 for MGS 00000100:00100000:1.0:1782758948.244182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.244277:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907264 00000100:00100000:3.0:1782758948.244287:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907264 00000100:00100000:3.0:1782758948.244341:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1665 00000100:00100000:3.0:1782758948.244350:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1869355196907264:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:3.0:1782758948.244382:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 2ccce785-e83d-4e63-a00f-536c0d53af2c@192.168.204.31@tcp t0 exp 0000000000000000 cur 3016 last 0 00000020:00000080:3.0:1782758948.244415:0:5793:0:(genops.c:1406:class_connect()) connect: client 2ccce785-e83d-4e63-a00f-536c0d53af2c, cookie 0xdd99f5c4777dc710 00000100:00080000:3.0:1782758948.244461:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917186a5c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758948.244558:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+5:2360:x1869355196907264:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 207us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.244566:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1665 00000100:00100000:3.0:1782758948.260003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.260131:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907392 00000100:00100000:1.0:1782758948.260144:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907392 00000100:00100000:1.0:1782758948.260217:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1666 00000100:00100000:1.0:1782758948.260230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+5:67088:x1869355196907392:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758948.260251:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758948.260274:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65080 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.260305:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65080 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.260319:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65080 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.260330:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782758948.260410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+6:67088:x1869355196907392:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 182us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.260420:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1666 00000100:00100000:2.0:1782758948.264725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.264889:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907520 00000100:00100000:1.0:1782758948.264899:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907520 00000100:00100000:1.0:1782758948.264958:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1667 00000100:00100000:1.0:1782758948.264970:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+6:67088:x1869355196907520:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782758948.265297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+6:67088:x1869355196907520:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 327us (581us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782758948.265307:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1667 00000100:00100000:2.0:1782758948.272694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.272875:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907648 00000100:00100000:3.0:1782758948.272887:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907648 00000100:00100000:3.0:1782758948.272958:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1668 00000100:00100000:3.0:1782758948.272970:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+6:67088:x1869355196907648:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782758948.272992:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758948.273013:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65087 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758948.273046:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65087 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758948.273062:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65087 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758948.273074:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691200, rc 0) 00000100:00100000:3.0:1782758948.273312:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+7:67088:x1869355196907648:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 191us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.273323:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1668 00000100:00100000:3.0:1782758948.278050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758948.278312:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907776 00000100:00100000:2.0:1782758948.278327:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907776 00000100:00100000:2.0:1782758948.278402:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1669 00000100:00100000:2.0:1782758948.278413:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+7:67088:x1869355196907776:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782758948.278960:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67088:x1869355196907776:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 546us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758948.278969:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1669 00000100:00100000:2.0:1782758948.290802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.291026:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196907904 00000100:00100000:1.0:1782758948.291039:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196907904 00000100:00100000:1.0:1782758948.291108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1670 00000100:00100000:1.0:1782758948.291120:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67088:x1869355196907904:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782758948.291416:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67088:x1869355196907904:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 298us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.291426:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1670 00000100:00100000:1.0:1782758948.298309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.298773:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908032 00000100:00100000:3.0:1782758948.298787:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908032 00000100:00100000:3.0:1782758948.298878:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1671 00000100:00100000:3.0:1782758948.298889:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67107:x1869355196908032:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782758948.299237:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67107:x1869355196908032:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 349us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.299246:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1671 00000100:00100000:3.0:1782758948.321568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758948.321902:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908160 00000100:00100000:2.0:1782758948.321914:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908160 00000100:00100000:2.0:1782758948.321979:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1672 00000100:00100000:2.0:1782758948.321990:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67107:x1869355196908160:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782758948.322292:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67107:x1869355196908160:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 303us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758948.322304:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1672 00000100:00100000:2.0:1782758948.345635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.345751:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908288 00000100:00100000:1.0:1782758948.345765:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908288 00000100:00100000:1.0:1782758948.345867:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1673 00000100:00100000:1.0:1782758948.345878:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:67088:x1869355196908288:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758948.345897:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758948.345915:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf650b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.345951:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b1 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.345962:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b1 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.345971:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782758948.346035:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+9:67088:x1869355196908288:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 159us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.346041:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1673 00000100:00100000:1.0:1782758948.357484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.357622:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908416 00000100:00100000:3.0:1782758948.357636:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908416 00000100:00100000:3.0:1782758948.357701:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1674 00000100:00100000:3.0:1782758948.357711:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+9:67088:x1869355196908416:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782758948.357742:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782758948.357778:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782758948.357783:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782758948.357786:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782758948.357789:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782758948.359360:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+9:67088:x1869355196908416:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1641us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758948.359375:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1674 00000100:00100000:2.0:1782758948.362297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.362522:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908544 00000100:00100000:1.0:1782758948.362533:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908544 00000100:00100000:1.0:1782758948.362595:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1675 00000100:00100000:1.0:1782758948.362605:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+9:67088:x1869355196908544:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782758948.362624:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782758948.362643:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc72c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf650b8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.362675:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b8 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.362687:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b8 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758948.362696:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782758948.362763:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67088:x1869355196908544:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 159us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.363702:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1675 00000100:00100000:1.0:1782758948.366098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758948.366208:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908672 00000100:00100000:0.0:1782758948.366219:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908672 00000100:00100000:0.0:1782758948.366273:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1676 00000100:00100000:0.0:1782758948.366283:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67088:x1869355196908672:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782758948.366617:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67088:x1869355196908672:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 334us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758948.366625:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1676 00000100:00100000:0.0:1782758948.369285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.369396:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908800 00000100:00100000:1.0:1782758948.369406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908800 00000100:00100000:1.0:1782758948.369468:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1677 00000100:00100000:1.0:1782758948.369479:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67088:x1869355196908800:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782758948.369945:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67088:x1869355196908800:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 466us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.369953:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1677 00000100:00100000:2.0:1782758948.376046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.378201:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196908928 00000100:00100000:3.0:1782758948.378216:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196908928 00000100:00100000:3.0:1782758948.378282:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1678 00000100:00100000:3.0:1782758948.378292:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67114:x1869355196908928:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782758948.378627:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67114:x1869355196908928:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 334us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.378635:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1678 00000100:00100000:2.0:1782758948.392294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758948.396301:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909056 00000100:00100000:1.0:1782758948.396316:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909056 00000100:00100000:1.0:1782758948.396394:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1679 00000100:00100000:1.0:1782758948.396406:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67114:x1869355196909056:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782758948.396721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:67114:x1869355196909056:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 315us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.396729:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1679 00000100:00100000:1.0:1782758948.409198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.409292:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909184 00000100:00100000:3.0:1782758948.409302:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909184 00000100:00100000:3.0:1782758948.409354:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1278 00000100:00100000:3.0:1782758948.409362:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355196909184:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782758948.409392:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bfc7d065-2ce7-47cb-be34-4d8e1232856a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3016 last 0 00000020:00000080:3.0:1782758948.409438:0:5802:0:(genops.c:1406:class_connect()) connect: client bfc7d065-2ce7-47cb-be34-4d8e1232856a, cookie 0xdd99f5c4777dc733 00000004:00100000:3.0:1782758948.409475:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782758948.409619:0:5802:0:(import.c:65:import_set_state_nolock()) ffff91719035f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758948.409694:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2360:x1869355196909184:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 331us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.409702:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1278 00000100:00100000:2.0:1782758948.415645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758948.415733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758948.415923:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909440 00000100:00100000:0.0:1782758948.415934:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909440 00000100:00100000:0.0:1782758948.416008:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909312 00000100:00100000:0.0:1782758948.416012:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909312 00000100:00100000:0.0:1782758948.416037:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1279 00000100:00100000:0.0:1782758948.416046:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+7:67088:x1869355196909440:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782758948.416106:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782758948.416191:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+7:67088:x1869355196909440:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 145us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758948.416199:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1279 00000100:00100000:0.0:1782758948.416218:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1280 00000100:00100000:0.0:1782758948.416224:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:0:x1869355196909312:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782758948.416239:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782758948.416262:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:0:x1869355196909312:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758948.416269:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1280 00000100:00080000:2.0:1782758948.416600:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758948.417899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758948.417983:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909568 00000100:00100000:2.0:1782758948.417991:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909568 00000100:00100000:2.0:1782758948.418034:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1281 00000100:00100000:2.0:1782758948.418043:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67088:x1869355196909568:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782758948.418566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67088:x1869355196909568:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 522us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758948.418574:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1281 00000100:00100000:0.0:1782758948.421565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758948.421603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758948.421635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758948.421744:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909696 00000100:00100000:3.0:1782758948.421755:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909696 00000100:00100000:3.0:1782758948.421798:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909824 00000100:00100000:3.0:1782758948.421801:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909824 00000100:00100000:3.0:1782758948.421849:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 708 00000100:00100000:3.0:1782758948.421857:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196909696:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782758948.421891:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bfc7d065-2ce7-47cb-be34-4d8e1232856a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3016 last 0 00000020:00000080:3.0:1782758948.421925:0:6598:0:(genops.c:1406:class_connect()) connect: client bfc7d065-2ce7-47cb-be34-4d8e1232856a, cookie 0xdd99f5c4777dc73a 00002000:00100000:3.0:1782758948.421967:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfc7d065-2ce7-47cb-be34-4d8e1232856a/ffff917082a78000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758948.421982:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758948.422257:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782758948.422290:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758948.422354:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2360:x1869355196909696:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 495us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.422361:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 708 00000100:00100000:3.0:1782758948.422378:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 709 00000100:00100000:3.0:1782758948.422382:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196909824:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782758948.422398:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bfc7d065-2ce7-47cb-be34-4d8e1232856a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3016 last 0 00000020:00000080:3.0:1782758948.422416:0:6598:0:(genops.c:1406:class_connect()) connect: client bfc7d065-2ce7-47cb-be34-4d8e1232856a, cookie 0xdd99f5c4777dc741 00002000:00100000:3.0:1782758948.422422:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfc7d065-2ce7-47cb-be34-4d8e1232856a/ffff917082a79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758948.422440:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758948.422625:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782758948.422639:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171b369f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758948.422662:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2360:x1869355196909824:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 278us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758948.422669:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 709 00000100:00100000:1.0:1782758948.422758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196909952 00000100:00100000:1.0:1782758948.422764:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196909952 00000100:00100000:1.0:1782758948.422805:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:1.0:1782758948.422813:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67088:x1869355196909952:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782758948.423018:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782758948.423135:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67088:x1869355196909952:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 323us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758948.423143:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 130 00010000:00010000:3.0:1782758948.462680:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758949.494242:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758949.805601:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211794560:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.805739:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211794304:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.805812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.805891:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211794816:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.805918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.805945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758949.805952:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211794688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.805978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.806008:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211794432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.806052:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211794944:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.806103:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794304 00000100:00100000:3.0:1782758949.806112:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794304 00000100:00100000:3.0:1782758949.806168:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:3.0:1782758949.806177:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211794304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806453:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211794304:12345-0@lo:400:kworker.0 Request processed in 275us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.806461:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:3.0:1782758949.806496:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794816 00000100:00100000:3.0:1782758949.806500:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794816 00000100:00100000:3.0:1782758949.806535:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794432 00000100:00100000:3.0:1782758949.806539:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794432 00000100:00100000:3.0:1782758949.806558:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1782758949.806564:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211794816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806597:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211794816:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.806604:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1782758949.806616:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1782758949.806621:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211794432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806724:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211794432:12345-0@lo:400:kworker.0 Request processed in 30us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.806735:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1782758949.806766:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794688 00000100:00100000:3.0:1782758949.806770:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794688 00000100:00100000:3.0:1782758949.806797:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794944 00000100:00100000:3.0:1782758949.806800:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794944 00000100:00100000:3.0:1782758949.806819:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1782758949.806846:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211794688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806880:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211794688:12345-0@lo:400:kworker.0 Request processed in 35us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.806886:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1782758949.806896:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1782758949.806902:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211794944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806931:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211794944:12345-0@lo:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.806937:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1782758949.806972:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211794688:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806983:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211794304:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.806993:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211794816:0@lo:400:kworker.0 00000100:00080000:3.0:1782758949.807032:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758949.807036:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758949.807039:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758949.807061:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211794432:0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.807071:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211794944:0@lo:400:kworker.0 00000100:00100000:0.0:1782758949.807169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758949.808044:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211794560 00000100:00100000:3.0:1782758949.808058:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211794560 00000100:00100000:3.0:1782758949.808116:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1782758949.808125:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211794560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758949.808195:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211794560:12345-0@lo:400:kworker.0 Request processed in 71us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758949.808202:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1782758949.808254:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211794560:0@lo:400:kworker.0 00000100:00080000:0.0:1782758949.809002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758950.316011:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758950.316036:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211795072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758950.319512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758950.319596:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795072 00000100:00100000:3.0:1782758950.319607:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795072 00000100:00100000:3.0:1782758950.319663:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1782758950.319673:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211795072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758950.319721:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758950.319775:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211795072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758950.319783:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1782758950.320174:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211795072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758950.508397:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758951.532047:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782758952.398256:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000001:00080000:3.0:1782758952.398275:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967787 is committed 00000020:00000080:3.0:1782758952.398280:0:5824:0:(genops.c:906:class_export_put()) final put ffff9171b760f800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 00000001:00100000:3.0:1782758952.398298:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:1.0:1782758952.399089:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b760f800/28523624-e8ee-4ffc-a0c3-eabe66c3aef1 for lustre-MDT0000 00000020:00000080:1.0:1782758952.399231:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b7608000 for lustre-MDT0000 00010000:00010000:1.0:1782758952.557412:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758952.879669:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758952.879697:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211795200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758952.879773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758952.879869:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795200 00000100:00100000:0.0:1782758952.879877:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795200 00000100:00100000:0.0:1782758952.879933:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1782758952.879941:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211795200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758952.879976:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758952.880022:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211795200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758952.880029:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00080000:0.0:1782758952.880049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758952.880097:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211795200:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782758952.972238:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000001:00100000:1.0:1782758952.997499:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00010000:00010000:0.0:1782758953.580171:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758953.658538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758953.658593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758953.658636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758953.658662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758953.658690:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910464 00000100:00100000:3.0:1782758953.658699:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910464 00000100:00100000:0.0:1782758953.658845:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910208 00000100:00100000:0.0:1782758953.658850:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910208 00000100:00100000:0.0:1782758953.659639:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00100000:0.0:1782758953.659651:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758953.659751:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758953.659759:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00080000:0.0:1782758953.659790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782758953.659795:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758953.660867:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910336 00000100:00100000:0.0:1782758953.660877:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910336 00000100:00100000:0.0:1782758953.660930:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1679 00000100:00100000:0.0:1782758953.660939:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758953.660989:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758953.660996:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1679 00000100:00100000:0.0:1782758953.661011:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1680 00000100:00100000:0.0:1782758953.661017:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758953.661041:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2362:x1869355196910336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758953.661047:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1680 00000100:00100000:0.0:1782758953.661080:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910080 00000100:00100000:0.0:1782758953.661084:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910080 00000100:00100000:0.0:1782758953.661125:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1681 00000100:00100000:0.0:1782758953.661132:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:2362:x1869355196910080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758953.661156:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:2362:x1869355196910080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758953.661161:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1681 00000100:00080000:0.0:1782758953.661678:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758954.604074:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758954.924687:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211795456:0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.924758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758954.924778:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211795712:0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.924845:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211795968:0@lo:400:kworker.0 00000100:00100000:3.0:1782758954.924856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758954.924909:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211795584:0@lo:400:kworker.0 00000100:00100000:0.0:1782758954.924975:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211795328:0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.927150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758954.927259:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795456 00000100:00100000:2.0:1782758954.927268:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795456 00000100:00100000:2.0:1782758954.927337:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1782758954.927347:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211795456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.927423:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211795456:12345-0@lo:400:kworker.0 Request processed in 78us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758954.927431:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1782758954.928043:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795712 00000100:00100000:2.0:1782758954.928049:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795712 00000100:00100000:2.0:1782758954.928164:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795968 00000100:00100000:2.0:1782758954.928169:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795968 00000100:00100000:2.0:1782758954.928198:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1782758954.928206:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211795712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.928252:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211795712:12345-0@lo:400:kworker.0 Request processed in 47us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758954.928259:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1782758954.928271:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1782758954.928278:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211795968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.928309:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211795968:12345-0@lo:400:kworker.0 Request processed in 32us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758954.928671:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00080000:2.0:1782758954.928697:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758954.928702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782758954.928740:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211795456:0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.928753:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211795968:0@lo:400:kworker.0 00000100:00100000:3.0:1782758954.931621:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211795712:0@lo:400:kworker.0 00000100:00100000:1.0:1782758954.933889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758954.936582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758954.936652:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211795840:0@lo:400:kworker.0 00000100:00100000:0.0:1782758954.936702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758954.936782:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795328 00000100:00100000:1.0:1782758954.936792:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795328 00000100:00100000:1.0:1782758954.936879:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1782758954.936889:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211795328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758954.936947:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211795328:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758954.936954:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1782758954.942211:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211795328:0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.943921:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795584 00000100:00100000:2.0:1782758954.943949:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795584 00000100:00100000:2.0:1782758954.944076:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211795840 00000100:00100000:2.0:1782758954.944080:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211795840 00000100:00080000:0.0:1782758954.944209:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758954.944262:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:1.0:1782758954.944338:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1782758954.948746:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211795584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758954.948900:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211795584:12345-0@lo:400:kworker.0 Request processed in 4628us (15018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758954.948912:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:0.0:1782758954.949450:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211795584:0@lo:400:kworker.0 00000100:00100000:1.0:1782758954.949773:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758954.949860:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211795840:12345-0@lo:400:kworker.0 Request processed in 5513us (13157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758954.949868:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1782758954.951740:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211795840:0@lo:400:kworker.0 00000100:00100000:0.0:1782758955.436731:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211796096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758955.436818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758955.437184:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796096 00000100:00100000:1.0:1782758955.437194:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796096 00000100:00100000:1.0:1782758955.437250:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1782758955.437260:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211796096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782758955.437297:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758955.437535:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211796096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 275us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758955.437544:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1782758955.437650:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211796096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758955.631115:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758956.462215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758956.462455:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910592 00000100:00100000:2.0:1782758956.462537:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910592 00000100:00100000:2.0:1782758956.462614:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1282 00000100:00100000:2.0:1782758956.462624:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:67586:x1869355196910592:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:2.0:1782758956.462644:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758956.462666:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dc748 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf650e2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.462750:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.462764:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.462778:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782758956.463269:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782758956.463274:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:0.0:1782758956.463410:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1782758956.464178:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.464219:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694600/0xdd99f5c4777dc748 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650e2 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.464237:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650e2 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758956.464245:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782758956.464249:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782758956.464252:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758956.465948:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67586:x1869355196910592:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 3314us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758956.465960:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1282 00000100:00100000:0.0:1782758956.470522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758956.470668:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910720 00000100:00100000:3.0:1782758956.470679:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910720 00000100:00100000:3.0:1782758956.470738:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 131 00000100:00100000:3.0:1782758956.470749:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67586:x1869355196910720:12345-192.168.204.31@tcp:33:lsof.0 00000004:00200000:3.0:1782758956.471301:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782758956.471307:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000100:00100000:3.0:1782758956.471567:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:67586:x1869355196910720:12345-192.168.204.31@tcp:33:lsof.0 Request processed in 816us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758956.471576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 131 00010000:00010000:0.0:1782758956.652073:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758957.679734:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758957.997364:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782758957.998782:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211796224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758957.998908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758957.999220:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796224 00000100:00100000:1.0:1782758957.999232:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796224 00000100:00100000:1.0:1782758957.999330:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1782758957.999343:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211796224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758957.999408:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758957.999480:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211796224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758957.999488:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1782758957.999578:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211796224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782758958.001179:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782758958.700123:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758958.774610:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758958.774655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758958.774695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758958.774725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758958.774820:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911104 00000100:00100000:2.0:1782758958.774866:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911104 00000100:00100000:2.0:1782758958.774931:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911232 00000100:00100000:2.0:1782758958.774935:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911232 00000100:00100000:2.0:1782758958.774971:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1683 00000100:00100000:2.0:1782758958.774983:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2361:x1869355196911104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758958.775072:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2361:x1869355196911104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758958.775080:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1683 00000100:00100000:2.0:1782758958.775098:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1684 00000100:00100000:2.0:1782758958.775105:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2361:x1869355196911232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758958.775128:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2361:x1869355196911232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758958.775135:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1684 00000100:00080000:0.0:1782758958.775331:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758958.775335:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758958.775504:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910848 00000100:00100000:3.0:1782758958.775509:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910848 00000100:00100000:3.0:1782758958.775546:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1683 00000100:00100000:3.0:1782758958.775553:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:2361:x1869355196910848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758958.775599:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:2361:x1869355196910848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758958.775607:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1683 00000100:00100000:1.0:1782758958.775642:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196910976 00000100:00100000:1.0:1782758958.775656:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196910976 00000100:00100000:1.0:1782758958.775783:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2173 00000100:00100000:1.0:1782758958.775796:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2361:x1869355196910976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782758958.776160:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758958.776219:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2361:x1869355196910976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 425us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758958.776228:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2173 00000100:00100000:2.0:1782758959.012045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758959.012109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758959.012210:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911488 00000100:00100000:0.0:1782758959.012226:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911488 00000100:00100000:0.0:1782758959.012316:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911360 00000100:00100000:0.0:1782758959.012320:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911360 00000100:00100000:0.0:1782758959.012359:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:0.0:1782758959.012372:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+11:2363:x1869355196911488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758959.012394:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758959.012421:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dc725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b1 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758959.012445:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758959.012513:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+10:2363:x1869355196911488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 143us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758959.012522:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:0.0:1782758959.012543:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1782758959.012550:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+9:2364:x1869355196911360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758959.012560:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758959.012570:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dc71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65087 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758959.012580:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758959.012599:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:2364:x1869355196911360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758959.012605:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:2.0:1782758959.017897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758959.017990:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911616 00000100:00100000:0.0:1782758959.018004:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911616 00000100:00100000:0.0:1782758959.018106:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:0.0:1782758959.018119:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+8:2361:x1869355196911616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782758959.018141:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758959.018170:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dc72c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650b8 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758959.018191:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758959.018269:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ccce785-e83d-4e63-a00f-536c0d53af2c+7:2361:x1869355196911616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758959.018287:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1782758959.024555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758959.024674:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911744 00000100:00100000:0.0:1782758959.024690:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911744 00000100:00100000:0.0:1782758959.024778:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 710 00000100:00100000:0.0:1782758959.024792:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2360:x1869355196911744:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782758959.024875:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc741 00000100:00080000:0.0:1782758959.024889:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171b369f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758959.024961:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1782758959.025453:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc7d065-2ce7-47cb-be34-4d8e1232856a+2:2360:x1869355196911744:12345-192.168.204.31@tcp:9:umount.0 Request processed in 662us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758959.025464:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 710 00010000:00010000:3.0:1782758959.025755:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758959.033264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758959.033714:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196911872 00000100:00100000:0.0:1782758959.033728:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196911872 00000100:00100000:0.0:1782758959.033862:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 711 00000100:00100000:0.0:1782758959.033876:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+5:2360:x1869355196911872:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782758959.033923:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc73a 00000100:00080000:0.0:1782758959.033938:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758959.034015:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1782758959.034452:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc7d065-2ce7-47cb-be34-4d8e1232856a+2:2360:x1869355196911872:12345-192.168.204.31@tcp:9:umount.0 Request processed in 576us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758959.034462:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 711 00010000:00010000:3.0:1782758959.034756:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758959.060426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758959.060643:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912128 00000100:00100000:0.0:1782758959.060657:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912128 00000100:00100000:0.0:1782758959.060734:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1283 00000100:00100000:0.0:1782758959.060745:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+6:2360:x1869355196912128:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782758959.061198:0:5801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc733 00000020:00010000:0.0:1782758959.061215:0:5801:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917186a5b800: total 0 00000100:00080000:0.0:1782758959.061222:0:5801:0:(import.c:65:import_set_state_nolock()) ffff91719035f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758959.061250:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967787 00000020:00010000:1.0:1782758959.061969:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917186a5b800: total 0 00010000:00010000:1.0:1782758959.062032:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917186a5b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782758959.062075:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:1.0:1782758959.062080:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782758959.062093:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc74f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650e2 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758959.062123:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917186a5b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782758959.062137:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758959.062140:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758959.062142:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758959.062614:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc7d065-2ce7-47cb-be34-4d8e1232856a+3:2360:x1869355196912128:12345-192.168.204.31@tcp:39:umount.0 Request processed in 1867us (2214us total) trans 4294967788 rc 0/0 00000100:00100000:0.0:1782758959.062628:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1283 00000100:00100000:1.0:1782758959.104915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758959.105033:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912384 00000100:00100000:3.0:1782758959.105047:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912384 00000100:00100000:3.0:1782758959.105131:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1684 00000100:00100000:3.0:1782758959.105143:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+7:2360:x1869355196912384:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782758959.105203:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc710 00000020:00010000:3.0:1782758959.105212:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917186a59000: total 0 00000100:00080000:3.0:1782758959.105218:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917186a5c000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782758959.105341:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ccce785-e83d-4e63-a00f-536c0d53af2c+3:2360:x1869355196912384:12345-192.168.204.31@tcp:251:umount.0 Request processed in 199us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758959.105351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1684 00000020:00010000:0.0:1782758959.106921:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917186a59000: total 0 00010000:00010000:0.0:1782758959.107052:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917186a59000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782758959.107118:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65080 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758959.107144:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917186a59000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782758959.107156:0:5788:0:(genops.c:906:class_export_put()) final put ffff917186a59000/2ccce785-e83d-4e63-a00f-536c0d53af2c 00010000:00010000:0.0:1782758959.107179:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758959.107181:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758959.107183:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758959.107391:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917186a59000/2ccce785-e83d-4e63-a00f-536c0d53af2c for MGS 00000020:00000080:3.0:1782758959.107465:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917186a5c000 for MGS 00010000:00010000:3.0:1782758959.736148:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758960.045690:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211796352:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.045808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.045921:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211796864:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.045994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.046030:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758960.046037:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211796736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.046107:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211796480:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.046152:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211796992:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.046194:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758960.046200:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211796608:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758960.046262:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796352 00000100:00100000:3.0:1782758960.046271:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796352 00000100:00100000:3.0:1782758960.046326:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1782758960.046338:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046403:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211796352:12345-0@lo:400:kworker.0 Request processed in 66us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046411:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1782758960.046464:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796864 00000100:00100000:3.0:1782758960.046468:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796864 00000100:00100000:3.0:1782758960.046506:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796480 00000100:00100000:3.0:1782758960.046509:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796480 00000100:00100000:3.0:1782758960.046525:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796608 00000100:00100000:3.0:1782758960.046528:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796608 00000100:00100000:3.0:1782758960.046542:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:3.0:1782758960.046547:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211796864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046582:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211796864:12345-0@lo:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046589:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:3.0:1782758960.046601:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:3.0:1782758960.046607:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211796480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046637:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211796480:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046643:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:3.0:1782758960.046655:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:3.0:1782758960.046660:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211796608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046683:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211796608:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046689:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:3.0:1782758960.046707:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796736 00000100:00100000:3.0:1782758960.046711:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796736 00000100:00100000:3.0:1782758960.046737:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211796992 00000100:00100000:3.0:1782758960.046740:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211796992 00000100:00100000:3.0:1782758960.046759:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1782758960.046764:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211796736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046797:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211796736:12345-0@lo:400:kworker.0 Request processed in 33us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046803:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1782758960.046814:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:3.0:1782758960.046843:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211796992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046872:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211796992:12345-0@lo:400:kworker.0 Request processed in 52us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.046878:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00080000:3.0:1782758960.046911:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782758960.046915:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758960.046918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758960.046976:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211796608:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046988:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211796480:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.046997:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211796992:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.047040:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211796736:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.047049:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211796352:0@lo:400:kworker.0 00000100:00100000:3.0:1782758960.047058:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211796864:0@lo:400:kworker.0 00000020:00000080:2.0:1782758960.528322:0:111325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1a9e7030 20000000:00000080:2.0:1782758960.528351:0:111325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2c000 uarg=0000000000000000 10000000:01000000:2.0:1782758960.533802:0:111325:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758960.535015:0:111325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758960.535045:0:111325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758960.535057:0:111325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758960.535117:0:111325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758960.535138:0:111325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 18 pid: 5794 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758960.535157:0:111325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111325:1869355211797120:0@lo:104: 00000100:00100000:2.0:1782758960.535387:0:111325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758960.535506:0:111325:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181358780 going to sleep for 11 seconds 00000100:00100000:3.0:1782758960.536978:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797120 00000100:00100000:3.0:1782758960.536997:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797120 00000100:00100000:3.0:1782758960.537132:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1782758960.537145:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111325:x1869355211797120:12345-0@lo:104: 00010000:00010000:3.0:1782758960.537170:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758960.537355:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782758960.537363:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111325:x1869355211797120:12345-0@lo:104: Request processed in 221us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758960.537372:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00010000:00010000:1.0:1782758960.537429:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758960.537441:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537451:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758960.537456:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537468:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758960.537478:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758960.537485:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782758960.537542:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537549:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782758960.537577:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537585:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc6f4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc6fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537610:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758960.537612:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758960.537615:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758960.537642:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211797248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782758960.537706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758960.537768:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797248 00000100:00100000:1.0:1782758960.537773:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797248 00010000:00010000:1.0:1782758960.537799:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 19 pid: 5794 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758960.537856:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1782758960.537864:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9382450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211797248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782758960.537878:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782758960.537884:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 19 pid: 5794 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537895:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 19 pid: 5794 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537933:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537943:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537962:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537971:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537978:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537989:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.537995:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782758960.537999:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.538007:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.538016:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758960.538027:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782758960.538059:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9382450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211797248:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758960.538067:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1782758960.538177:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211797248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758960.542097:0:111325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc6fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc6f4 expref: 18 pid: 5794 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758960.542131:0:111325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111325:1869355211797120:0@lo:104: 00010000:00010000:0.0:1782758960.542184:0:111325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758960.542199:0:111325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758960.542206:0:111325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758960.542213:0:111325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695600/0xdd99f5c4777dc756 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758960.562339:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782758960.562376:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211797376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758960.562482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758960.562766:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797376 00000100:00100000:0.0:1782758960.562779:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797376 00000100:00100000:0.0:1782758960.562870:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1782758960.562881:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211797376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758960.562941:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758960.563013:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211797376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758960.563025:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1782758960.563081:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211797376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758960.748118:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782758961.651664:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782758961.651673:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782758961.651678:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782758961.651738:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.651752:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.651763:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758961.651795:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211797504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782758961.651896:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758961.651970:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782758961.651994:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797504 00000100:00100000:0.0:1782758961.652002:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797504 00000100:00100000:0.0:1782758961.652056:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1782758961.652065:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211797504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758961.652080:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758961.652093:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc75d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.652119:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.652136:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.652146:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51a00, rc 0) 00000100:00100000:0.0:1782758961.652186:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211797504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758961.652193:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1782758961.652258:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211797504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782758961.652276:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.652286:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758961.652309:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782758961.652315:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.652323:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782758961.685034:0:111373:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc782e7970 20000000:00000080:3.0:1782758961.685053:0:111373:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b58800 uarg=0000000000000000 10000000:01000000:3.0:1782758961.685292:0:111373:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758961.685316:0:111373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.685337:0:111373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.685349:0:111373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.685393:0:111373:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.685407:0:111373:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 18 pid: 5796 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758961.685424:0:111373:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111373:1869355211797632:0@lo:104: 00000100:00100000:3.0:1782758961.685502:0:111373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758961.685569:0:111373:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193cd9600 going to sleep for 11 seconds 00000100:00100000:2.0:1782758961.685765:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797632 00000100:00100000:2.0:1782758961.685774:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797632 00000100:00100000:2.0:1782758961.685868:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1782758961.685880:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111373:x1869355211797632:12345-0@lo:104: 00010000:00010000:2.0:1782758961.685894:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758961.685975:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782758961.685982:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111373:x1869355211797632:12345-0@lo:104: Request processed in 105us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758961.685990:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00010000:00010000:0.0:1782758961.686552:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782758961.686561:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686569:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782758961.686573:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686583:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782758961.686591:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782758961.686597:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782758961.686631:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686638:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782758961.686668:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686675:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51c00/0xdd99f5c4777dc75d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc764 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686690:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758961.686691:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758961.686693:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758961.686701:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758961.686726:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211797760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758961.686766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758961.686812:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797760 00000100:00100000:0.0:1782758961.686817:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797760 00010000:00010000:0.0:1782758961.686867:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 19 pid: 5796 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758961.686893:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1782758961.686914:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211797760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782758961.686926:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782758961.686931:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 19 pid: 5796 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686942:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 19 pid: 5796 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686960:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686969:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686985:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.686993:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687000:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687006:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687012:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782758961.687017:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687024:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687033:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758961.687043:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782758961.687072:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211797760:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758961.687079:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1782758961.687117:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211797760:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758961.688136:0:111373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51a00/0xdd99f5c4777dc764 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc75d expref: 18 pid: 5796 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758961.688152:0:111373:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111373:1869355211797632:0@lo:104: 00010000:00010000:3.0:1782758961.688170:0:111373:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.688178:0:111373:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.688183:0:111373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758961.688188:0:111373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc76b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758961.774660:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782758962.579257:0:111421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb6e11070 20000000:00000080:2.0:1782758962.579275:0:111421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2daa400 uarg=0000000000000000 10000000:01000000:2.0:1782758962.579511:0:111421:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782758962.579537:0:111421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579554:0:111421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579565:0:111421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579572:0:111421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579578:0:111421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579587:0:111421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579594:0:111421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758962.579598:0:111421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579607:0:111421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579621:0:111421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579630:0:111421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758962.579636:0:111421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc772 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1782758962.705713:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000001:00080000:1.0:1782758962.705732:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967788 is committed 00000020:00000080:1.0:1782758962.705736:0:5824:0:(genops.c:906:class_export_put()) final put ffff917186a5b800/bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:2.0:1782758962.708328:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917186a5b800/bfc7d065-2ce7-47cb-be34-4d8e1232856a for lustre-MDT0000 00000020:00000080:2.0:1782758962.708418:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91719035f800 for lustre-MDT0000 00010000:00010000:0.0:1782758962.798514:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758963.116392:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758963.116420:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211797888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758963.116498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758963.116572:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211797888 00000100:00100000:2.0:1782758963.116580:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211797888 00000100:00100000:2.0:1782758963.122011:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1782758963.122031:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211797888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782758963.122081:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758963.122179:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211797888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (5681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758963.122186:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1782758963.122250:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211797888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758963.126910:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1782758963.244864:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758963.244883:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758963.244889:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758963.244934:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758963.244947:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758963.244958:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758963.244985:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211798016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758963.245055:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758963.245107:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6480 going to sleep for 11 seconds 00000100:00100000:3.0:1782758963.245168:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798016 00000100:00100000:3.0:1782758963.245177:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798016 00000100:00100000:3.0:1782758963.245236:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1782758963.245245:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211798016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758963.245259:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782758963.245273:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc779 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758963.245297:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758963.245310:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758963.245319:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782758963.245360:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211798016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758963.245367:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1782758963.245415:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211798016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782758963.245430:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758963.245438:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782758963.245459:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782758963.245464:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758963.245471:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1782758963.247703:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:0.0:1782758963.247712:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082a78000/bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:0.0:1782758963.247736:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082a78000/bfc7d065-2ce7-47cb-be34-4d8e1232856a for lustre-OST0000 00000020:00000080:0.0:1782758963.247783:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082a7a800 for lustre-OST0000 00000001:00100000:3.0:1782758963.249986:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:3.0:1782758963.249996:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082a79800/bfc7d065-2ce7-47cb-be34-4d8e1232856a 00000020:00000080:0.0:1782758963.250134:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082a79800/bfc7d065-2ce7-47cb-be34-4d8e1232856a for lustre-OST0001 00000020:00000080:0.0:1782758963.250341:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b369f000 for lustre-OST0001 00010000:00010000:0.0:1782758963.820946:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758964.844031:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758965.164199:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211798528:0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.164275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758965.164352:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782758965.164359:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211798144:0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.164396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758965.164421:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211798656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.164443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758965.164471:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798144 00000100:00100000:1.0:1782758965.164478:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798144 00000100:00100000:1.0:1782758965.164525:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1782758965.164534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211798144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758965.164666:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798528 00000100:00100000:3.0:1782758965.164671:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798528 00000100:00100000:3.0:1782758965.164711:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1782758965.164719:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758965.164812:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211798400:0@lo:400:kworker.0 00000100:00100000:0.0:1782758965.164920:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211798272:0@lo:400:kworker.0 00000100:00100000:3.0:1782758965.168036:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211798528:12345-0@lo:400:kworker.0 Request processed in 3306us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758965.168053:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00080000:3.0:1782758965.168102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758965.168318:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211798144:12345-0@lo:400:kworker.0 Request processed in 3783us (3919us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758965.168327:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1782758965.168386:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798656 00000100:00100000:1.0:1782758965.168396:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798656 00000100:00100000:1.0:1782758965.168486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:1.0:1782758965.168494:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211798656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.168542:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211798656:12345-0@lo:400:kworker.0 Request processed in 50us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758965.168548:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:1.0:1782758965.168600:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211798144:0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.168614:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211798656:0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.168625:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211798528:0@lo:400:kworker.0 00000100:00100000:2.0:1782758965.171009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758965.171072:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798400 00000100:00100000:2.0:1782758965.171080:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798400 00000100:00080000:3.0:1782758965.171139:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758965.171707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758965.171784:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211798784:0@lo:400:kworker.0 00000100:00100000:0.0:1782758965.171864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758965.172083:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798784 00000100:00100000:1.0:1782758965.172090:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798784 00000100:00100000:1.0:1782758965.172140:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1782758965.172160:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211798784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.172220:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211798784:12345-0@lo:400:kworker.0 Request processed in 71us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758965.172227:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00080000:0.0:1782758965.172290:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758965.172321:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211798784:0@lo:400:kworker.0 00000100:00100000:3.0:1782758965.172438:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798272 00000100:00100000:3.0:1782758965.172443:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798272 00000100:00100000:2.0:1782758965.172564:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:2.0:1782758965.172575:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211798400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758965.172633:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211798400:12345-0@lo:400:kworker.0 Request processed in 61us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758965.172640:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:1.0:1782758965.172696:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211798400:0@lo:400:kworker.0 00000100:00100000:3.0:1782758965.175704:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:1.0:1782758965.176098:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211798272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758965.176226:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211798272:12345-0@lo:400:kworker.0 Request processed in 508us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758965.176235:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1782758965.176678:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211798272:0@lo:400:kworker.0 00000100:00100000:0.0:1782758965.682855:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211798912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758965.682929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758965.684479:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211798912 00000100:00100000:0.0:1782758965.684491:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211798912 00000100:00100000:0.0:1782758965.684547:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1782758965.684556:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211798912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758965.684600:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758965.684681:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211798912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758965.684689:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1782758965.684791:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211798912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782758965.869072:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782758966.785623:0:111618:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeb658d10 20000000:00000080:3.0:1782758966.785644:0:111618:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312c800 uarg=0000000000000000 10000000:01000000:3.0:1782758966.786207:0:111618:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782758966.786649:0:111618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.786669:0:111618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.786678:0:111618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.786722:0:111618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.786737:0:111618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 18 pid: 5794 timeout: 3135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782758966.786753:0:111618:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111618:1869355211799040:0@lo:104: 00000100:00100000:3.0:1782758966.786978:0:111618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758966.787089:0:111618:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782758966.787491:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799040 00000100:00100000:0.0:1782758966.787499:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799040 00000100:00100000:0.0:1782758966.787622:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1782758966.787632:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111618:x1869355211799040:12345-0@lo:104: 00010000:00010000:0.0:1782758966.787646:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758966.787769:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782758966.787775:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:111618:x1869355211799040:12345-0@lo:104: Request processed in 145us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758966.787784:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1782758966.787973:0:111618:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111618:1869355211799040:0@lo:104: 00010000:00010000:3.0:1782758966.788002:0:111618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758966.789134:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782758966.789146:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758966.789157:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782758966.789162:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758966.789175:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782758966.789183:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758966.789189:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782758966.789463:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.789470:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782758966.789614:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.789622:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4600/0xdd99f5c4777dc779 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc780 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.789643:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758966.789645:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758966.789647:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758966.789686:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758966.789705:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211799168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782758966.789770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758966.789972:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799168 00000100:00100000:2.0:1782758966.789980:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799168 00010000:00010000:2.0:1782758966.790012:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 3135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782758966.790036:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1782758966.790044:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211799168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782758966.790058:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782758966.790063:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 3135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790075:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 3135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790095:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dc780 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc779 expref: 19 pid: 5794 timeout: 3135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790108:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790117:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790132:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790139:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790145:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790151:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790157:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782758966.790161:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.790168:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.792172:0:111618:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782758966.792190:0:111618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.794629:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.794653:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dc787 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758966.794673:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782758966.794764:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211799168:12345-0@lo:103:ldlm_bl.0 Request processed in 4717us (4990us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758966.794775:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1782758966.794976:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211799168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782758966.891980:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782758967.916745:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782758968.108990:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782758968.109000:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782758968.109006:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782758968.109062:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758968.109075:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758968.109087:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782758968.109125:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211799296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782758968.109196:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758968.109383:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799296 00000100:00100000:2.0:1782758968.109392:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799296 00000100:00100000:2.0:1782758968.109444:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1782758968.109453:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211799296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782758968.109468:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758968.109483:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc78e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758968.109507:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758968.109519:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758968.109527:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694800, rc 0) 00000100:00100000:2.0:1782758968.109564:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211799296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758968.109576:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1782758968.109677:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771540 going to sleep for 11 seconds 00000100:00100000:1.0:1782758968.109706:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211799296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782758968.109722:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758968.109732:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782758968.109763:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782758968.109769:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782758968.109787:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782758968.241146:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211799424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782758968.241258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758968.242017:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799424 00000100:00100000:3.0:1782758968.242033:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799424 00000100:00100000:3.0:1782758968.242115:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1782758968.242128:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211799424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758968.242175:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782758968.242446:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758968.243526:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211799424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1396us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758968.243539:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1782758968.243900:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211799424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782758968.943196:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758969.966856:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758970.286276:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211799552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.286391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758970.286477:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782758970.286484:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211799680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.286517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758970.286583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799552 00000100:00100000:0.0:1782758970.286593:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799552 00000100:00100000:0.0:1782758970.286668:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:0.0:1782758970.286680:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211799552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.287036:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211799552:12345-0@lo:400:kworker.0 Request processed in 355us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.287045:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:0.0:1782758970.287121:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211799552:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.287172:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799680 00000100:00100000:0.0:1782758970.287177:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799680 00000100:00100000:0.0:1782758970.287215:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1782758970.287222:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211799680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.287263:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211799680:12345-0@lo:400:kworker.0 Request processed in 42us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.287269:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1782758970.287304:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211799680:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.288525:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782758970.288653:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758970.288675:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211799936:0@lo:400:kworker.0 00000100:00100000:2.0:1782758970.288764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758970.291717:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799936 00000100:00100000:3.0:1782758970.291745:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799936 00000100:00100000:3.0:1782758970.291868:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:3.0:1782758970.291881:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211799936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758970.292028:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211799936:12345-0@lo:400:kworker.0 Request processed in 149us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758970.292038:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00080000:3.0:1782758970.292069:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758970.292124:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211799936:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.293033:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211799808:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.293120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758970.293130:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211800064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758970.293164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758970.293195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211799808 00000100:00100000:0.0:1782758970.293202:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211799808 00000100:00100000:0.0:1782758970.293257:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800064 00000100:00100000:0.0:1782758970.293261:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800064 00000100:00100000:0.0:1782758970.293288:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:0.0:1782758970.293295:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211799808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.293344:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211799808:12345-0@lo:400:kworker.0 Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.293351:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:0.0:1782758970.293370:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1782758970.293376:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211800064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.301037:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211800064:12345-0@lo:400:kworker.0 Request processed in 7644us (7855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.301060:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1782758970.301144:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211800192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.301252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758970.301569:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800192 00000100:00100000:0.0:1782758970.301581:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800192 00000100:00100000:0.0:1782758970.301720:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:0.0:1782758970.301741:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211800192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.302015:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211800192:12345-0@lo:400:kworker.0 Request processed in 285us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.302023:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00080000:0.0:1782758970.302050:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758970.302056:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758970.302105:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211800192:0@lo:400:kworker.0 00000100:00100000:0.0:1782758970.302152:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211799808:0@lo:400:kworker.0 00000100:00100000:3.0:1782758970.312052:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211800064:0@lo:400:kworker.0 00000100:00100000:3.0:1782758970.808074:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758970.808196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758970.808516:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800320 00000100:00100000:2.0:1782758970.808530:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800320 00000100:00100000:2.0:1782758970.808687:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1782758970.808701:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211800320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758970.809189:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758970.809272:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211800320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 573us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758970.809282:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1782758970.811075:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782758970.861909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758970.865886:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912512 00000100:00100000:1.0:1782758970.865907:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912512 00000100:00100000:1.0:1782758970.865988:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1691 00000100:00100000:1.0:1782758970.865999:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1869355196912512:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782758970.866048:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 72bbbe59-e3a8-42af-8a26-956092d71e33@192.168.204.31@tcp t0 exp 0000000000000000 cur 3039 last 0 00000020:00000080:1.0:1782758970.866089:0:5793:0:(genops.c:1406:class_connect()) connect: client 72bbbe59-e3a8-42af-8a26-956092d71e33, cookie 0xdd99f5c4777dc79c 00000100:00080000:1.0:1782758970.866161:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917081afc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782758970.866274:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+5:2360:x1869355196912512:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 275us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758970.866284:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1691 00000100:00100000:2.0:1782758970.873484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.873607:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912640 00000100:00100000:0.0:1782758970.873631:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912640 00000100:00100000:0.0:1782758970.873706:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1692 00000100:00100000:0.0:1782758970.873728:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+5:67769:x1869355196912640:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782758970.873755:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758970.873791:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf650f7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.874117:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650f7 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.874130:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650f7 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.874141:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782758970.874219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+6:67769:x1869355196912640:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 503us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.874228:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1692 00000100:00100000:2.0:1782758970.883039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.883602:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912768 00000100:00100000:0.0:1782758970.883626:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912768 00000100:00100000:0.0:1782758970.883775:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00100000:0.0:1782758970.883787:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+6:67769:x1869355196912768:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782758970.884281:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+6:67769:x1869355196912768:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 492us (1256us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782758970.884292:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00100000:2.0:1782758970.890618:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.890806:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196912896 00000100:00100000:0.0:1782758970.890863:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196912896 00000100:00100000:0.0:1782758970.890933:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1694 00000100:00100000:0.0:1782758970.890944:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+6:67769:x1869355196912896:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782758970.890969:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758970.890992:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf650fe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.891034:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650fe expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.891049:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650fe expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.891060:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782758970.891164:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+7:67769:x1869355196912896:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 219us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.891175:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1694 00000100:00100000:2.0:1782758970.895099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.895951:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913024 00000100:00100000:0.0:1782758970.895973:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913024 00000100:00100000:0.0:1782758970.896090:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1695 00000100:00100000:0.0:1782758970.896104:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+7:67769:x1869355196913024:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782758970.897263:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67769:x1869355196913024:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 1155us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.897276:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1695 00000100:00100000:2.0:1782758970.919908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758970.920345:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913152 00000100:00100000:1.0:1782758970.920363:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913152 00000100:00100000:1.0:1782758970.920462:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1696 00000100:00100000:1.0:1782758970.920476:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67769:x1869355196913152:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782758970.921156:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67769:x1869355196913152:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 674us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758970.921169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1696 00000100:00100000:2.0:1782758970.946759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.946919:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913280 00000100:00100000:0.0:1782758970.946936:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913280 00000100:00100000:0.0:1782758970.947018:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:0.0:1782758970.947030:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67787:x1869355196913280:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758970.947703:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67787:x1869355196913280:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 671us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.947726:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:2.0:1782758970.975598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758970.978574:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913408 00000100:00100000:1.0:1782758970.978600:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913408 00000100:00100000:1.0:1782758970.978742:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1698 00000100:00100000:1.0:1782758970.978758:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67787:x1869355196913408:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782758970.983479:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67787:x1869355196913408:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 4705us (7878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758970.983504:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1698 00010000:00010000:0.0:1782758970.993014:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758970.996559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758970.996693:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913536 00000100:00100000:0.0:1782758970.996706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913536 00000100:00100000:0.0:1782758970.996785:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1699 00000100:00100000:0.0:1782758970.996797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+8:67769:x1869355196913536:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782758970.996865:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782758970.996895:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc7b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65128 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.996933:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65128 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.996948:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65128 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782758970.996960:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782758970.997034:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+9:67769:x1869355196913536:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 239us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758970.997041:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1699 00000100:00100000:0.0:1782758971.006140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758971.006274:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913664 00000100:00100000:2.0:1782758971.006289:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913664 00000100:00100000:2.0:1782758971.006360:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1700 00000100:00100000:2.0:1782758971.006373:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+9:67769:x1869355196913664:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782758971.006417:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782758971.006451:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782758971.006456:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782758971.006461:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782758971.006464:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782758971.010414:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+9:67769:x1869355196913664:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 4025us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.010439:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1700 00000100:00100000:1.0:1782758971.022237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758971.022508:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913792 00000100:00100000:2.0:1782758971.022520:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913792 00000100:00100000:2.0:1782758971.022660:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00100000:2.0:1782758971.022672:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+9:67769:x1869355196913792:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782758971.022694:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782758971.022726:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694000/0xdd99f5c4777dc7b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6512f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758971.022766:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694000/0xdd99f5c4777dc7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6512f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758971.022779:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694000/0xdd99f5c4777dc7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6512f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782758971.022790:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694000, rc 0) 00000100:00100000:2.0:1782758971.024179:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67769:x1869355196913792:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 1497us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758971.024191:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00100000:2.0:1782758971.041095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.041206:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196913920 00000100:00100000:0.0:1782758971.041218:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196913920 00000100:00100000:0.0:1782758971.041291:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1702 00000100:00100000:0.0:1782758971.041302:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67769:x1869355196913920:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782758971.041779:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67769:x1869355196913920:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 477us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.041788:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1702 00000100:00100000:3.0:1782758971.050431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758971.051065:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914048 00000100:00100000:2.0:1782758971.051075:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914048 00000100:00100000:2.0:1782758971.051144:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1703 00000100:00100000:2.0:1782758971.051155:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67769:x1869355196914048:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782758971.051425:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67769:x1869355196914048:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 270us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758971.051434:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1703 00000100:00100000:2.0:1782758971.072169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758971.075921:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914176 00000100:00100000:1.0:1782758971.075948:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914176 00000100:00100000:2.0:1782758971.077400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1704 00000100:00100000:2.0:1782758971.077422:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67791:x1869355196914176:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782758971.077928:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67791:x1869355196914176:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 512us (5774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758971.077939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1704 00000100:00100000:3.0:1782758971.105299:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.105423:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914304 00000100:00100000:0.0:1782758971.105438:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914304 00000100:00100000:0.0:1782758971.105644:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1705 00000100:00100000:0.0:1782758971.105661:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67791:x1869355196914304:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782758971.106800:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:67791:x1869355196914304:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 1137us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.106812:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1705 00000100:00100000:2.0:1782758971.114620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.117086:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914432 00000100:00100000:0.0:1782758971.117106:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914432 00000100:00100000:0.0:1782758971.117190:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1284 00000100:00100000:0.0:1782758971.117201:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1869355196914432:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782758971.117238:0:7487:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b63da415-9fe7-432d-aaab-047a80aa0861@192.168.204.31@tcp t0 exp 0000000000000000 cur 3039 last 0 00000020:00000080:0.0:1782758971.117305:0:7487:0:(genops.c:1406:class_connect()) connect: client b63da415-9fe7-432d-aaab-047a80aa0861, cookie 0xdd99f5c4777dc7bf 00000004:00100000:0.0:1782758971.117341:0:7487:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782758971.117737:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917189077000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758971.119502:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+6:2360:x1869355196914432:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 2282us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758971.121609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782758971.121758:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914560 00000100:00100000:3.0:1782758971.121777:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914560 00000100:00080000:1.0:1782758971.121954:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758971.122406:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1284 00000100:00100000:3.0:1782758971.127641:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1285 00000100:00100000:2.0:1782758971.129448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758971.129695:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+6:0:x1869355196914560:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782758971.129922:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1782758971.130098:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+6:0:x1869355196914560:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 2438us (8502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758971.130109:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1285 00000100:00100000:1.0:1782758971.130150:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914688 00000100:00100000:1.0:1782758971.130160:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914688 00000100:00100000:0.0:1782758971.130543:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1286 00000100:00100000:0.0:1782758971.130557:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196914688:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782758971.136959:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782758971.137204:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196914688:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 6642us (8639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.137218:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1286 00000100:00100000:2.0:1782758971.146169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.152400:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914816 00000100:00100000:0.0:1782758971.152421:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914816 00000100:00100000:0.0:1782758971.152598:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1287 00000100:00100000:0.0:1782758971.152613:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196914816:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782758971.152804:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196914816:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 193us (6778us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.152814:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1287 00000100:00100000:2.0:1782758971.163629:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758971.163690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.163875:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915200 00000100:00100000:0.0:1782758971.163891:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915200 00000100:00100000:0.0:1782758971.163960:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:0.0:1782758971.163972:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196915200:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782758971.164327:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782758971.164519:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:67769:x1869355196915200:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 547us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.164530:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:3.0:1782758971.164762:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196914944 00000100:00100000:3.0:1782758971.164770:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196914944 00000100:00100000:3.0:1782758971.164810:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:3.0:1782758971.164817:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196914944:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782758971.164883:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b63da415-9fe7-432d-aaab-047a80aa0861@192.168.204.31@tcp t0 exp 0000000000000000 cur 3039 last 0 00000020:00000080:3.0:1782758971.164927:0:9120:0:(genops.c:1406:class_connect()) connect: client b63da415-9fe7-432d-aaab-047a80aa0861, cookie 0xdd99f5c4777dc7c6 00002000:00100000:3.0:1782758971.164945:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b63da415-9fe7-432d-aaab-047a80aa0861/ffff917186a5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782758971.164985:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782758971.165264:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782758971.165304:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917186a59000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782758971.165358:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+6:2360:x1869355196914944:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 540us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758971.165367:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:1.0:1782758971.167421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758971.167523:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915072 00000100:00100000:0.0:1782758971.167535:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915072 00000100:00100000:0.0:1782758971.167597:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 713 00000100:00100000:0.0:1782758971.167608:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196915072:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782758971.167652:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b63da415-9fe7-432d-aaab-047a80aa0861@192.168.204.31@tcp t0 exp 0000000000000000 cur 3039 last 0 00000020:00000080:0.0:1782758971.167696:0:6598:0:(genops.c:1406:class_connect()) connect: client b63da415-9fe7-432d-aaab-047a80aa0861, cookie 0xdd99f5c4777dc7cd 00002000:00100000:0.0:1782758971.167721:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b63da415-9fe7-432d-aaab-047a80aa0861/ffff917189071800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782758971.167736:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782758971.168129:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782758971.168171:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917189071000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782758971.168266:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:2360:x1869355196915072:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 657us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758971.168277:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 713 00010000:00010000:0.0:1782758972.014303:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782758972.911319:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00010000:00010000:1.0:1782758973.037187:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758973.367421:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758973.367530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758973.367639:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800448 00000100:00100000:3.0:1782758973.367650:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800448 00000100:00100000:3.0:1782758973.367749:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1782758973.367760:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211800448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782758973.367854:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758973.367914:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211800448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758973.367923:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1782758973.367992:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211800448:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782758973.369740:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1782758973.374913:0:111817:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_26 skipping SLOW test 26 00000001:00100000:2.0:1782758973.470535:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000001:00100000:2.0:1782758973.525352:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00010000:00010000:0.0:1782758974.060316:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758975.085232:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758975.405256:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211800704:0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.405351:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211800576:0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.405444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758975.405492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758975.405533:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211801088:0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.405552:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211801216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.405580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758975.405614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758975.409470:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211800832:0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.409528:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800576 00000100:00100000:1.0:1782758975.409545:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800576 00000100:00100000:1.0:1782758975.409605:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1782758975.409617:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211800576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.409730:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211800576:12345-0@lo:400:kworker.0 Request processed in 104us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758975.409745:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1782758975.409797:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800704 00000100:00100000:1.0:1782758975.409801:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800704 00000100:00100000:1.0:1782758975.409846:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801088 00000100:00100000:1.0:1782758975.409851:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801088 00000100:00100000:1.0:1782758975.409881:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:1.0:1782758975.409887:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211800704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.409927:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211800704:12345-0@lo:400:kworker.0 Request processed in 40us (4438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758975.409945:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:1.0:1782758975.409960:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1782758975.409966:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.409999:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211801088:12345-0@lo:400:kworker.0 Request processed in 33us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758975.410005:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00080000:1.0:1782758975.410032:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758975.410066:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211800704:0@lo:400:kworker.0 00000100:00100000:3.0:1782758975.410728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758975.410780:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758975.410791:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211800960:0@lo:400:kworker.0 00000100:00100000:3.0:1782758975.411031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758975.411098:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801216 00000100:00100000:3.0:1782758975.411107:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801216 00000100:00100000:3.0:1782758975.411188:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800960 00000100:00100000:3.0:1782758975.411193:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800960 00000100:00100000:2.0:1782758975.411210:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211800576:0@lo:400:kworker.0 00000100:00100000:3.0:1782758975.411226:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:3.0:1782758975.411237:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211801216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.411240:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211801088:0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.411301:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1782758975.411309:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211801216:12345-0@lo:400:kworker.0 Request processed in 73us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758975.411315:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211800960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758975.411322:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00080000:3.0:1782758975.411355:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758975.411361:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758975.411373:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211800960:12345-0@lo:400:kworker.0 Request processed in 63us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758975.411382:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1782758975.411396:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211801216:0@lo:400:kworker.0 00000100:00100000:2.0:1782758975.411421:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211800960:0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.412323:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211800832 00000100:00100000:1.0:1782758975.412332:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211800832 00000100:00100000:1.0:1782758975.412414:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1782758975.412424:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758975.412573:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211800832:12345-0@lo:400:kworker.0 Request processed in 150us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758975.412584:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00080000:3.0:1782758975.413373:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782758975.413575:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211800832:0@lo:400:kworker.0 00000100:00100000:0.0:1782758975.921211:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782758975.921235:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782758975.921316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758975.921512:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801344 00000100:00100000:2.0:1782758975.921520:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801344 00000100:00100000:2.0:1782758975.921574:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1782758975.921583:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758975.921637:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758975.921684:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758975.921692:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1782758975.921957:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801344:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782758975.996199:0:111868:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27a skipping excluded test 27a (base 27) 00010000:00010000:3.0:1782758976.115661:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758976.184319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758976.184383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758976.184437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758976.184488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758976.184540:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915712 00000100:00100000:2.0:1782758976.184551:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915712 00000100:00100000:1.0:1782758976.188805:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915456 00000100:00100000:1.0:1782758976.188837:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915456 00000100:00100000:1.0:1782758976.188918:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2186 00000100:00100000:1.0:1782758976.188930:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758976.189023:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (4714us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758976.189030:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2186 00000100:00100000:0.0:1782758976.189509:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915328 00000100:00100000:0.0:1782758976.189514:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915328 00000100:00100000:2.0:1782758976.189743:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915584 00000100:00100000:2.0:1782758976.189748:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915584 00000100:00100000:2.0:1782758976.189781:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00100000:2.0:1782758976.189790:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758976.189848:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (5468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758976.189858:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1693 00000100:00100000:2.0:1782758976.189874:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1694 00000100:00100000:2.0:1782758976.189881:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758976.189905:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196915584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758976.189911:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1694 00000100:00080000:2.0:1782758976.189932:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758976.189937:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758976.189940:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782758976.190452:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1707 00000100:00100000:0.0:1782758976.190462:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196915328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758976.191271:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196915328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 806us (6834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758976.191281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1707 00010000:00010000:3.0:1782758977.138859:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782758977.716192:0:111916:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27aa skipping excluded test 27aa (base 27) 00010000:00010000:2.0:1782758978.156342:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758978.478515:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758978.478719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758978.479119:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801472 00000100:00100000:0.0:1782758978.479139:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801472 00000100:00100000:0.0:1782758978.479197:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1782758978.479208:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782758978.479244:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782758978.479541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782758978.479699:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 492us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758978.479707:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1782758978.480902:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782758979.183178:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782758979.813385:0:111965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27ab skipping excluded test 27ab (base 27) 00010000:00010000:3.0:1782758980.205284:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758980.524209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211801600:0@lo:400:kworker.0 00000100:00100000:2.0:1782758980.524284:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801984:0@lo:400:kworker.0 00000100:00100000:0.0:1782758980.524321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758980.524414:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211801856:0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.524461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758980.524557:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211801728:0@lo:400:kworker.0 00000100:00100000:0.0:1782758980.525554:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211802112:0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.529877:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801856 00000100:00100000:1.0:1782758980.529896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801856 00000100:00100000:1.0:1782758980.530000:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1782758980.530013:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.530118:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211801856:12345-0@lo:400:kworker.0 Request processed in 108us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758980.530126:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00080000:1.0:1782758980.530170:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758980.531732:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211801856:0@lo:400:kworker.0 00000100:00100000:2.0:1782758980.531804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758980.531845:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801600 00000100:00100000:1.0:1782758980.531854:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801600 00000100:00100000:1.0:1782758980.531899:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1782758980.531908:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211801600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.531981:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211801600:12345-0@lo:400:kworker.0 Request processed in 73us (7662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758980.531988:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1782758980.532523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758980.532581:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211802240:0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.533336:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801728 00000100:00100000:1.0:1782758980.533346:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801728 00000100:00100000:3.0:1782758980.533394:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211801984 00000100:00100000:3.0:1782758980.533401:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211801984 00000100:00100000:1.0:1782758980.533402:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1782758980.533414:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758980.533462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758980.533468:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:3.0:1782758980.533477:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758980.533556:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211801984:12345-0@lo:400:kworker.0 Request processed in 79us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758980.533564:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:2.0:1782758980.533580:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802240 00000100:00100000:2.0:1782758980.533585:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802240 00000100:00080000:3.0:1782758980.533596:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782758980.533602:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782758980.533685:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:2.0:1782758980.533693:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211802240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758980.533731:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211802240:12345-0@lo:400:kworker.0 Request processed in 40us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758980.533738:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:2.0:1782758980.533777:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211802240:0@lo:400:kworker.0 00000100:00100000:3.0:1782758980.534013:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211801984:0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.534451:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211801728:12345-0@lo:400:kworker.0 Request processed in 1039us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758980.534460:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:0.0:1782758980.537233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758980.537306:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211801600:0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.538200:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802112 00000100:00100000:1.0:1782758980.538229:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802112 00000100:00100000:1.0:1782758980.538361:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:1.0:1782758980.538374:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211802112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758980.538504:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211802112:12345-0@lo:400:kworker.0 Request processed in 133us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758980.538512:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00080000:2.0:1782758980.538812:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758980.540606:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211802112:0@lo:400:kworker.0 00000100:00100000:3.0:1782758980.543372:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211801728:0@lo:400:kworker.0 00000100:00100000:3.0:1782758981.036108:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758981.036143:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211802368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758981.036249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758981.036464:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802368 00000100:00100000:0.0:1782758981.036475:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802368 00000100:00100000:0.0:1782758981.036555:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1782758981.036567:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211802368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782758981.036617:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782758981.036680:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211802368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758981.036688:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1782758981.036917:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211802368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758981.228086:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758981.303553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758981.303604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758981.303635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758981.303662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758981.303695:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916096 00000100:00100000:2.0:1782758981.303705:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916096 00000100:00100000:2.0:1782758981.303782:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916224 00000100:00100000:2.0:1782758981.303786:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916224 00000100:00100000:2.0:1782758981.303811:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:2.0:1782758981.303843:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196916096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758981.303928:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196916096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758981.303937:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1697 00000100:00100000:2.0:1782758981.303953:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1698 00000100:00100000:2.0:1782758981.303960:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196916224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758981.303985:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196916224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758981.303992:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1698 00000100:00100000:2.0:1782758981.304009:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915968 00000100:00100000:2.0:1782758981.304012:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915968 00000100:00100000:2.0:1782758981.304041:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2190 00000100:00100000:2.0:1782758981.304048:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196915968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758981.304076:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196915968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758981.304082:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2190 00000100:00080000:2.0:1782758981.304104:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758981.304108:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782758981.304110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782758981.304566:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196915840 00000100:00100000:3.0:1782758981.304572:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196915840 00000100:00100000:3.0:1782758981.304603:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1709 00000100:00100000:3.0:1782758981.304610:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196915840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758981.304646:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196915840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758981.304652:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1709 00000001:02000400:3.0:1782758981.942231:0:112014:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27ac skipping excluded test 27ac (base 27) 00010000:00010000:1.0:1782758982.252068:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782758983.276172:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758983.596044:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211802496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758983.596144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758983.596276:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802496 00000100:00100000:1.0:1782758983.596287:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802496 00000100:00100000:1.0:1782758983.596393:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1782758983.596404:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211802496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758983.596452:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782758983.598574:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758983.604164:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211802496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7747us (8005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758983.604183:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1782758983.612380:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211802496:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782758983.924773:0:112063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27b skipping excluded test 27b (base 27) 00010000:00010000:2.0:1782758984.300097:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758985.324246:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758985.645187:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211802880:0@lo:400:kworker.0 00000100:00100000:2.0:1782758985.645260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758985.645317:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782758985.645324:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211803008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758985.645350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758985.645383:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802880 00000100:00100000:2.0:1782758985.645389:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802880 00000100:00100000:2.0:1782758985.645450:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:2.0:1782758985.645460:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211802880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758985.645512:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211802880:12345-0@lo:400:kworker.0 Request processed in 53us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758985.645519:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:2.0:1782758985.645542:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803008 00000100:00100000:2.0:1782758985.645545:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803008 00000100:00100000:2.0:1782758985.645570:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1782758985.645577:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211803008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782758985.645608:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211803008:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758985.645615:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1782758985.645655:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211803008:0@lo:400:kworker.0 00000100:00100000:2.0:1782758985.645667:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211802880:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646489:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211802624:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758985.646576:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211803136:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758985.646623:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758985.646630:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211802752:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758985.646673:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211803264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782758985.646728:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758985.646732:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758985.646744:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803136 00000100:00100000:0.0:1782758985.646749:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803136 00000100:00100000:0.0:1782758985.646785:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802752 00000100:00100000:0.0:1782758985.646788:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802752 00000100:00100000:0.0:1782758985.646809:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1782758985.646817:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211803136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646882:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211803136:12345-0@lo:400:kworker.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758985.646889:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1782758985.646904:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1782758985.646910:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211802752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.646939:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211802752:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758985.646945:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1782758985.646965:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803264 00000100:00100000:0.0:1782758985.646969:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803264 00000100:00100000:0.0:1782758985.646994:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1782758985.647001:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211803264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.647035:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211803264:12345-0@lo:400:kworker.0 Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758985.647041:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00080000:0.0:1782758985.647060:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758985.647062:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758985.647085:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211802752:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.647096:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211803264:0@lo:400:kworker.0 00000100:00100000:0.0:1782758985.647105:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211803136:0@lo:400:kworker.0 00000100:00100000:1.0:1782758985.647461:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211802624 00000100:00100000:1.0:1782758985.647466:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211802624 00000100:00100000:1.0:1782758985.647494:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1782758985.647501:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211802624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758985.647540:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211802624:12345-0@lo:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758985.647546:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:0.0:1782758985.648042:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211802624:0@lo:400:kworker.0 00000001:02000400:3.0:1782758985.962455:0:112111:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27c skipping excluded test 27c (base 27) 00000100:00100000:3.0:1782758986.158249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758986.158270:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211803392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758986.158335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782758986.159782:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803392 00000100:00100000:2.0:1782758986.159793:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803392 00000100:00100000:2.0:1782758986.160111:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1782758986.160123:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211803392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782758986.160166:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782758986.160245:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211803392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758986.160252:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1782758986.160305:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211803392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782758986.354494:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758986.422364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758986.422410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758986.422457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758986.422559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782758986.422598:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916352 00000100:00100000:2.0:1782758986.422608:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916352 00000100:00100000:2.0:1782758986.422668:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1711 00000100:00100000:2.0:1782758986.422678:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196916352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758986.422748:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196916352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758986.422757:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1711 00000100:00100000:3.0:1782758986.423145:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916736 00000100:00100000:3.0:1782758986.423150:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916736 00000100:00100000:3.0:1782758986.423202:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916608 00000100:00100000:3.0:1782758986.423206:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916608 00000100:00100000:3.0:1782758986.423230:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00100000:3.0:1782758986.423238:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758986.423277:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758986.423285:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1701 00000100:00100000:3.0:1782758986.423299:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1702 00000100:00100000:3.0:1782758986.423306:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782758986.423331:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758986.423337:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1702 00000100:00100000:1.0:1782758986.424128:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916480 00000100:00100000:1.0:1782758986.424134:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916480 00000100:00100000:1.0:1782758986.424194:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2194 00000100:00100000:1.0:1782758986.424204:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758986.424252:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196916480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 50us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758986.424259:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2194 00000100:00080000:2.0:1782758986.424541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782758986.424547:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782758986.424549:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782758987.373526:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782758988.291606:0:112159:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27d skipping excluded test 27d (base 27) 00010000:00010000:1.0:1782758988.396627:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782758988.717283:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758988.717312:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211803520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782758988.717402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758988.717802:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803520 00000100:00100000:1.0:1782758988.717811:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803520 00000100:00100000:1.0:1782758988.717892:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1782758988.717902:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211803520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758988.717938:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758988.718849:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211803520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758988.718859:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1782758988.719159:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211803520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782758988.719682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782758989.421914:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782758990.159744:0:112208:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27e skipping excluded test 27e (base 27) 00010000:00010000:2.0:1782758990.444022:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758990.764291:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211803904:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.764406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758990.764494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758990.764500:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211804032:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.764531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758990.764574:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804032 00000100:00100000:1.0:1782758990.764584:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804032 00000100:00100000:1.0:1782758990.764649:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:1.0:1782758990.764660:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211804032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.764724:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211804032:12345-0@lo:400:kworker.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758990.764732:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:1.0:1782758990.764791:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211804032:0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.764919:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211803776:0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.764954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758990.764993:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211804288:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.765013:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803904 00000100:00100000:1.0:1782758990.765020:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803904 00000100:00100000:3.0:1782758990.765021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758990.765046:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782758990.765054:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211803648:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.765055:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803776 00000100:00100000:1.0:1782758990.765060:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803776 00000100:00100000:1.0:1782758990.765086:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:3.0:1782758990.765093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758990.765097:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211803904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.765120:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211804160:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.765148:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211803904:12345-0@lo:400:kworker.0 Request processed in 55us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758990.765154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758990.765162:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00080000:3.0:1782758990.765187:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758990.765189:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804160 00000100:00080000:3.0:1782758990.765193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758990.765194:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804160 00000100:00100000:3.0:1782758990.765207:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804288 00000100:00100000:3.0:1782758990.765214:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804288 00000100:00100000:1.0:1782758990.765222:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1782758990.765230:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.765250:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:3.0:1782758990.765260:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211804288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.765277:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211803776:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758990.765284:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1782758990.765302:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1782758990.765304:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211804288:12345-0@lo:400:kworker.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758990.765312:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.765321:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00080000:3.0:1782758990.765360:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782758990.765363:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211804160:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00080000:3.0:1782758990.765364:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782758990.765374:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1782758990.765386:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211804160:0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.765399:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211803776:0@lo:400:kworker.0 00000100:00100000:1.0:1782758990.765415:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211803904:0@lo:400:kworker.0 00000100:00100000:3.0:1782758990.765417:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211804288:0@lo:400:kworker.0 00000100:00100000:0.0:1782758990.765516:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211803648 00000100:00100000:0.0:1782758990.765520:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211803648 00000100:00100000:0.0:1782758990.765558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1782758990.765566:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211803648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758990.765619:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211803648:12345-0@lo:400:kworker.0 Request processed in 54us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758990.765625:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1782758990.765753:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211803648:0@lo:400:kworker.0 00000100:00100000:3.0:1782758991.276181:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758991.276214:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211804416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758991.276331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758991.276421:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804416 00000100:00100000:3.0:1782758991.276431:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804416 00000100:00100000:3.0:1782758991.276506:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1782758991.276517:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211804416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758991.276566:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758991.276622:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211804416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758991.276630:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1782758991.277049:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211804416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782758991.469571:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758991.544360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758991.544412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758991.544439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758991.544464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758991.544499:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916992 00000100:00100000:1.0:1782758991.544511:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916992 00000100:00100000:1.0:1782758991.544600:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2198 00000100:00100000:1.0:1782758991.544613:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196916992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758991.544743:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196916992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 131us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758991.544752:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2198 00000100:00100000:1.0:1782758991.544796:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917120 00000100:00100000:1.0:1782758991.544800:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917120 00000100:00100000:1.0:1782758991.544874:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917248 00000100:00100000:1.0:1782758991.544878:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917248 00000100:00100000:1.0:1782758991.544906:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 714 00000100:00100000:1.0:1782758991.544914:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2360:x1869355196917120:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1782758991.544941:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc7c6 00000100:00080000:1.0:1782758991.544953:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917186a59000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782758991.545004:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:2.0:1782758991.545237:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196916864 00000100:00100000:2.0:1782758991.545242:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196916864 00000100:00100000:2.0:1782758991.545280:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1713 00000100:00100000:2.0:1782758991.545289:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196916864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782758991.545335:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196916864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782758991.545342:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1713 00000100:00080000:0.0:1782758991.546084:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782758991.546091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758991.546094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782758991.546131:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 715 00000100:00100000:0.0:1782758991.546144:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2360:x1869355196917248:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782758991.546166:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc7cd 00000100:00080000:0.0:1782758991.546176:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917189071000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782758991.546219:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00010000:00010000:2.0:1782758991.548477:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758991.548498:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758991.548686:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+2:2360:x1869355196917248:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 2534us (4208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758991.548706:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 715 00000100:00100000:1.0:1782758991.553105:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b63da415-9fe7-432d-aaab-047a80aa0861+2:2360:x1869355196917120:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 8171us (8644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758991.553139:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 714 00000001:02000400:2.0:1782758992.077792:0:112256:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_27f skipping excluded test 27f (base 27) 00010000:00010000:1.0:1782758992.494039:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758993.516069:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782758993.836936:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211804544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782758993.837004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758993.838734:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804544 00000100:00100000:1.0:1782758993.838747:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804544 00000100:00080000:2.0:1782758993.838809:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758993.839775:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1782758993.839787:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211804544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758993.839837:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758993.839915:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211804544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758993.839923:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1782758993.843051:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211804544:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782758993.883025:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:0.0:1782758993.883034:0:7507:0:(genops.c:906:class_export_put()) final put ffff917189071800/b63da415-9fe7-432d-aaab-047a80aa0861 00000001:00100000:2.0:1782758993.885310:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:2.0:1782758993.885317:0:6622:0:(genops.c:906:class_export_put()) final put ffff917186a5b800/b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:3.0:1782758993.885909:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff917189071800/b63da415-9fe7-432d-aaab-047a80aa0861 for lustre-OST0001 00000020:00000080:3.0:1782758993.885962:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff917186a5b800/b63da415-9fe7-432d-aaab-047a80aa0861 for lustre-OST0000 00000020:00000080:3.0:1782758993.885983:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189071000 for lustre-OST0001 00000020:00000080:3.0:1782758993.885987:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917186a59000 for lustre-OST0000 00000001:02000400:3.0:1782758994.425207:0:112305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 28: check shared key rotation method == 14:49:51 (1782758991) 00010000:00010000:2.0:1782758994.545235:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782758995.564870:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782758995.884259:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211804672:0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.884328:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211804928:0@lo:400:kworker.0 00000100:00100000:0.0:1782758995.884358:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758995.884408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758995.884446:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211805184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.884464:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782758995.884476:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211805056:0@lo:400:kworker.0 00000100:00100000:0.0:1782758995.884495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758995.884529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782758995.884538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782758995.884554:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211804800:0@lo:400:kworker.0 00000100:00100000:0.0:1782758995.884591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758995.884596:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804672 00000100:00100000:3.0:1782758995.884607:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804672 00000100:00100000:0.0:1782758995.884617:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211805312:0@lo:400:kworker.0 00000100:00100000:0.0:1782758995.884653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758995.884696:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:3.0:1782758995.884709:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211804672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782758995.884725:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804928 00000100:00100000:0.0:1782758995.884736:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804928 00000100:00100000:0.0:1782758995.884805:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805184 00000100:00100000:0.0:1782758995.884809:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805184 00000100:00100000:3.0:1782758995.884851:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211804672:12345-0@lo:400:kworker.0 Request processed in 111us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758995.884862:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1782758995.884868:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211804800 00000100:00100000:0.0:1782758995.884874:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211804800 00000100:00100000:0.0:1782758995.884897:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1782758995.884909:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211804928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.884941:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1782758995.884984:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211804928:12345-0@lo:400:kworker.0 Request processed in 76us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758995.884993:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1782758995.885014:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1782758995.885021:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.885390:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211805184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.885439:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211805184:12345-0@lo:400:kworker.0 Request processed in 489us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758995.885447:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:3.0:1782758995.885474:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805056 00000100:00100000:3.0:1782758995.885479:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805056 00000100:00100000:3.0:1782758995.885681:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805312 00000100:00100000:3.0:1782758995.885685:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805312 00000100:00100000:1.0:1782758995.885864:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1782758995.885875:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211805056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758995.886037:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211805056:12345-0@lo:400:kworker.0 Request processed in 165us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758995.886044:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1782758995.886058:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1782758995.886064:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782758995.886097:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211805312:12345-0@lo:400:kworker.0 Request processed in 34us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758995.886104:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1782758995.886489:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211804800:12345-0@lo:400:kworker.0 Request processed in 1462us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758995.886502:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:3.0:1782758995.886541:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211805056:0@lo:400:kworker.0 00000100:00080000:0.0:1782758995.886558:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782758995.886567:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211804928:0@lo:400:kworker.0 00000100:00080000:0.0:1782758995.886567:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782758995.886576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782758995.886636:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211804800:0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.886652:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211805312:0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.886665:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211805184:0@lo:400:kworker.0 00000100:00100000:3.0:1782758995.886676:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211804672:0@lo:400:kworker.0 00000001:02000400:1.0:1782758996.387578:0:112354:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_28 need shared key feature for this test 00000100:00100000:3.0:1782758996.397104:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782758996.397134:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211805440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782758996.397243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782758996.397341:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805440 00000100:00100000:3.0:1782758996.397350:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805440 00000100:00100000:3.0:1782758996.397410:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1782758996.397421:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211805440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782758996.397472:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782758996.397528:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211805440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782758996.397536:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1782758996.397613:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211805440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782758996.588645:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782758996.675536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782758996.676049:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917376 00000100:00100000:1.0:1782758996.676064:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917376 00000100:00100000:1.0:1782758996.676131:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1715 00000100:00100000:1.0:1782758996.676143:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196917376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782758996.676259:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196917376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 116us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758996.676268:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1715 00000100:00100000:1.0:1782758996.702891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782758996.705481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917504 00000100:00100000:0.0:1782758996.705500:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917504 00000100:00100000:0.0:1782758996.705610:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2202 00000100:00100000:0.0:1782758996.705622:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196917504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782758996.705735:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196917504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 115us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782758996.705743:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2202 00000100:00080000:3.0:1782758996.714184:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782758997.612134:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782758998.642448:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782758998.672724:0:112402:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 29: check for missing shared key ====== 14:49:56 (1782758996) 00000100:00100000:1.0:1782758998.956370:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782758998.956405:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211805568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782758998.956511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782758998.957866:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805568 00000100:00100000:1.0:1782758998.957879:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805568 00000100:00100000:1.0:1782758998.957966:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1782758998.957976:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211805568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782758998.958037:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782758998.958119:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211805568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782758998.958127:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00080000:1.0:1782758998.958159:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782758998.958224:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211805568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782758999.661945:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759000.532060:0:112451:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_29 need shared key feature for this test 00010000:00010000:1.0:1782759000.686034:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759001.007089:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211805696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759001.007192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759001.007994:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211805824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.008039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759001.008089:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805824 00000100:00100000:0.0:1782759001.008098:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805824 00000100:00100000:0.0:1782759001.008156:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:0.0:1782759001.008164:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211805824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.008213:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211805824:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759001.008220:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:0.0:1782759001.008261:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211805824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759001.008996:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805696 00000100:00100000:2.0:1782759001.009004:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805696 00000100:00100000:2.0:1782759001.009053:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1782759001.009061:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211805696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.013367:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211806080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.013442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759001.013575:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211805952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.013608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759001.013648:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211805952 00000100:00100000:0.0:1782759001.013656:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211805952 00000100:00100000:0.0:1782759001.013714:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1782759001.013724:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211805952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.013779:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211805952:12345-0@lo:400:kworker.0 Request processed in 56us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759001.013787:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1782759001.013856:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211805952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.013897:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806080 00000100:00100000:0.0:1782759001.013900:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806080 00000100:00100000:0.0:1782759001.013928:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1782759001.013934:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211806080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759001.013996:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759001.014001:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759001.014021:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211806336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.014048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759001.014067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759001.014072:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211806208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.014119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759001.014156:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806336 00000100:00100000:1.0:1782759001.014159:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806336 00000100:00100000:1.0:1782759001.014188:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1782759001.014193:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211806336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.014225:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211806336:12345-0@lo:400:kworker.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759001.014231:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1782759001.014259:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806208 00000100:00100000:1.0:1782759001.014262:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806208 00000100:00100000:1.0:1782759001.014284:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:1.0:1782759001.014290:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211806208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.014317:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211806208:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759001.014323:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00080000:1.0:1782759001.014336:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759001.014339:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759001.014356:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211806208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759001.014368:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211806336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759001.014530:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211805696:12345-0@lo:400:kworker.0 Request processed in 5468us (7336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759001.014542:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1782759001.015630:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211806080:12345-0@lo:400:kworker.0 Request processed in 1692us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759001.015642:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:1.0:1782759001.015753:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211806080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759001.016615:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211805696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759001.516077:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211806464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759001.516172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759001.516300:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806464 00000100:00100000:1.0:1782759001.516318:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806464 00000100:00100000:1.0:1782759001.516378:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1782759001.516387:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211806464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759001.516425:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759001.519662:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211806464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759001.519844:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211806464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3437us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759001.519856:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00010000:00010000:3.0:1782759001.708341:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759001.782420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759001.782498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759001.782654:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917760 00000100:00100000:1.0:1782759001.782668:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917760 00000100:00100000:1.0:1782759001.782770:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2206 00000100:00100000:1.0:1782759001.782782:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196917760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759001.782908:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196917760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 126us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759001.782918:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2206 00000100:00100000:1.0:1782759001.782970:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917632 00000100:00100000:1.0:1782759001.782975:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917632 00000100:00100000:1.0:1782759001.783007:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1717 00000100:00100000:1.0:1782759001.783015:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196917632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759001.783054:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196917632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759001.783061:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1717 00000100:00080000:0.0:1782759001.783223:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782759002.505412:0:112499:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 30: check for invalid shared key ====== 14:50:00 (1782759000) 00010000:00010000:2.0:1782759002.732023:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759003.771793:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759004.065301:0:112548:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_30 need shared key feature for this test 00000100:00100000:2.0:1782759004.076940:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211806592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759004.077045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759004.077153:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806592 00000100:00100000:2.0:1782759004.077163:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806592 00000100:00100000:2.0:1782759004.077230:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1782759004.077243:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211806592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759004.077293:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759004.077351:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211806592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759004.077359:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1782759004.077421:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211806592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759004.078641:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759004.781795:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759005.809578:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759005.932413:0:112596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 30b: basic test of all different SSK flavors ========================================================== 14:50:03 (1782759003) 00000100:00100000:1.0:1782759006.124021:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211807104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.124111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759006.124167:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759006.124173:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211806976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.124202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759006.124252:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807104 00000100:00100000:1.0:1782759006.124260:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807104 00000100:00100000:1.0:1782759006.124316:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1782759006.124326:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211807104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.124385:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211807104:12345-0@lo:400:kworker.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.124393:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1782759006.124442:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806976 00000100:00100000:1.0:1782759006.124446:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806976 00000100:00100000:1.0:1782759006.124475:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:1.0:1782759006.124482:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211806976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.124515:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211806976:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.124522:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00080000:1.0:1782759006.124540:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759006.124545:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759006.124579:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211806976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.124591:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211807104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125003:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211806848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125055:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759006.125079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211807360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759006.125126:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759006.125132:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211806720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759006.125182:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211807232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759006.125231:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807360 00000100:00100000:2.0:1782759006.125236:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807360 00000100:00100000:2.0:1782759006.125272:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:2.0:1782759006.125278:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211807360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.125313:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211807360:12345-0@lo:400:kworker.0 Request processed in 35us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759006.125320:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1782759006.125525:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806848 00000100:00100000:1.0:1782759006.125530:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806848 00000100:00100000:1.0:1782759006.125558:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807232 00000100:00100000:1.0:1782759006.125560:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807232 00000100:00100000:1.0:1782759006.125575:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1782759006.125580:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211806848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.125613:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211806848:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.125619:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1782759006.125634:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1782759006.125640:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211807232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759006.125662:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211807232:12345-0@lo:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.125667:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1782759006.126144:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211806720 00000100:00100000:2.0:1782759006.126149:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211806720 00000100:00100000:2.0:1782759006.126220:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:2.0:1782759006.126227:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211806720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.126263:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211806720:12345-0@lo:400:kworker.0 Request processed in 37us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759006.126270:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00080000:2.0:1782759006.131582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759006.131660:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759006.131713:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211806720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.131735:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211807232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.131749:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211806848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.131767:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211807360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759006.636101:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759006.636124:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211807488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759006.636329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759006.636581:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807488 00000100:00100000:1.0:1782759006.636593:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807488 00000100:00100000:1.0:1782759006.636651:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1782759006.636661:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211807488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759006.636701:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759006.636757:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211807488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.636764:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1782759006.636883:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211807488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759006.832216:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759006.900500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759006.900548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759006.900563:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918016 00000100:00100000:1.0:1782759006.900584:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918016 00000100:00100000:1.0:1782759006.900672:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2210 00000100:00100000:1.0:1782759006.900683:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196918016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782759006.900725:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759006.900775:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196918016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.900784:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2210 00000100:00100000:1.0:1782759006.900862:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196917888 00000100:00100000:1.0:1782759006.900866:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196917888 00000100:00100000:1.0:1782759006.900891:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1719 00000100:00100000:1.0:1782759006.900897:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196917888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759006.900924:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196917888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759006.900931:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1719 00000001:02000400:3.0:1782759007.372034:0:112644:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_30b need shared key feature for this test 00010000:00010000:3.0:1782759007.856120:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759008.876376:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759009.105488:0:112692:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 31: client mount option '-o network' == 14:50:06 (1782759006) 00000100:00100000:1.0:1782759009.204148:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759009.204173:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211807616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759009.204253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759009.204329:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807616 00000100:00100000:1.0:1782759009.204337:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807616 00000100:00100000:1.0:1782759009.204393:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1782759009.204403:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211807616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759009.204451:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759009.204507:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211807616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759009.204516:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00080000:1.0:1782759009.204549:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759009.204592:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211807616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759009.900143:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759010.924697:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759011.244479:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211807744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759011.244556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759011.244690:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807744 00000100:00100000:0.0:1782759011.244698:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807744 00000100:00100000:0.0:1782759011.244757:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:0.0:1782759011.244767:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211807744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.245033:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211807872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.245071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759011.245114:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211807872 00000100:00100000:1.0:1782759011.245118:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211807872 00000100:00100000:1.0:1782759011.245160:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:1.0:1782759011.245167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211807872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.245206:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211807872:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759011.245213:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:1.0:1782759011.245269:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211807872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759011.246879:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211807744:12345-0@lo:400:kworker.0 Request processed in 2106us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759011.246891:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1782759011.247194:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211808000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759011.247303:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759011.247309:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211808128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759011.247365:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808128 00000100:00100000:1.0:1782759011.247372:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808128 00000100:00100000:1.0:1782759011.247418:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1782759011.247426:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247473:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211808128:12345-0@lo:400:kworker.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759011.247478:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00080000:1.0:1782759011.247497:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759011.247510:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211808384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759011.247554:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759011.247558:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211808256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759011.247601:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808384 00000100:00100000:1.0:1782759011.247619:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808384 00000100:00100000:1.0:1782759011.247649:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1782759011.247655:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211808384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247690:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211808384:12345-0@lo:400:kworker.0 Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759011.247696:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1782759011.247712:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808000 00000100:00100000:1.0:1782759011.247715:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808000 00000100:00100000:1.0:1782759011.247738:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808256 00000100:00100000:1.0:1782759011.247741:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808256 00000100:00100000:1.0:1782759011.247760:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:1.0:1782759011.247766:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211808000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247796:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211808000:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759011.247803:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:1.0:1782759011.247815:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:1.0:1782759011.247851:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211808256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247880:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211808256:12345-0@lo:400:kworker.0 Request processed in 60us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759011.247885:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00080000:1.0:1782759011.247905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759011.247908:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759011.247947:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211808128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247960:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211808000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.247992:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211808256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759011.248004:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211808384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759011.248719:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211807744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759011.760201:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211808512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759011.760284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759011.760579:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808512 00000100:00100000:0.0:1782759011.760587:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808512 00000100:00100000:0.0:1782759011.760641:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1782759011.760650:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211808512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759011.760688:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759011.760740:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211808512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759011.760747:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1782759011.760809:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211808512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759011.949091:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759012.025194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759012.025301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759012.025362:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918272 00000100:00100000:1.0:1782759012.025372:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918272 00000100:00100000:1.0:1782759012.025445:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2214 00000100:00100000:1.0:1782759012.025455:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196918272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759012.025528:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196918272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759012.025537:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2214 00000100:00080000:3.0:1782759012.025859:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759012.025926:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918144 00000100:00100000:2.0:1782759012.025931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918144 00000100:00100000:2.0:1782759012.025963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1721 00000100:00100000:2.0:1782759012.025970:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196918144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759012.026014:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196918144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759012.026021:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1721 00000001:02000400:3.0:1782759012.105505:0:112789:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_31 without lnetctl support. 00010000:00010000:3.0:1782759012.972420:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759013.771395:0:112837:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 32: check for mgssec ================== 14:50:11 (1782759011) 00010000:00010000:3.0:1782759013.997970:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759014.319535:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211808640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759014.319621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759014.319788:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808640 00000100:00100000:2.0:1782759014.319796:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808640 00000100:00100000:2.0:1782759014.319898:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1782759014.319908:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211808640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759014.319944:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759014.319991:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211808640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759014.319999:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00080000:3.0:1782759014.320072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759014.320112:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211808640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759015.020327:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759016.046605:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759016.164078:0:112936:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_32 need shared key feature for this test 00000100:00100000:3.0:1782759016.364166:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211808768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759016.364248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759016.364376:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808768 00000100:00100000:0.0:1782759016.364384:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808768 00000100:00100000:0.0:1782759016.364435:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1782759016.364444:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.364672:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211808896:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.364710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759016.364756:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211808896 00000100:00100000:1.0:1782759016.364760:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211808896 00000100:00100000:1.0:1782759016.364793:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:1.0:1782759016.364800:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.364871:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211808896:12345-0@lo:400:kworker.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759016.364878:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:1.0:1782759016.364936:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211808896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759016.365051:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211808768:12345-0@lo:400:kworker.0 Request processed in 608us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759016.365058:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:1.0:1782759016.365700:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759016.365767:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.365806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759016.365862:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211809024:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.365891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759016.365922:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809152 00000100:00100000:1.0:1782759016.365927:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809152 00000100:00100000:1.0:1782759016.365972:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1782759016.365979:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366028:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809152:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759016.366035:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1782759016.366057:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809024 00000100:00100000:1.0:1782759016.366061:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809024 00000100:00100000:1.0:1782759016.366086:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1782759016.366093:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366123:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211809024:12345-0@lo:400:kworker.0 Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759016.366130:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00080000:1.0:1782759016.366147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759016.366151:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759016.366189:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366201:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211809024:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366506:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211809408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759016.366564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759016.366570:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211809280:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759016.366616:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809280 00000100:00100000:1.0:1782759016.366620:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809280 00000100:00100000:1.0:1782759016.366650:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:1.0:1782759016.366657:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211809280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.366694:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211809280:12345-0@lo:400:kworker.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759016.366700:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00080000:1.0:1782759016.366714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759016.366734:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211809280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759016.366795:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809408 00000100:00100000:2.0:1782759016.366800:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809408 00000100:00100000:2.0:1782759016.366871:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:2.0:1782759016.366878:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211809408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759016.366917:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211809408:12345-0@lo:400:kworker.0 Request processed in 40us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759016.366923:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:2.0:1782759016.366954:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211809408:0@lo:400:kworker.0 00000100:00080000:1.0:1782759016.367011:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759016.367737:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211808768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759016.876308:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759016.876331:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759016.876405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759016.876637:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809536 00000100:00100000:2.0:1782759016.876645:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809536 00000100:00100000:2.0:1782759016.876699:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1782759016.876709:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759016.876745:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759016.876803:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759016.876810:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1782759016.876945:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759017.068143:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759017.148103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759017.148162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759017.148200:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918528 00000100:00100000:3.0:1782759017.148210:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918528 00000100:00100000:3.0:1782759017.148280:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000100:00100000:3.0:1782759017.148291:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196918528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759017.148363:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759017.148394:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918400 00000100:00100000:0.0:1782759017.148399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918400 00000100:00100000:0.0:1782759017.148448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1723 00000100:00100000:0.0:1782759017.149436:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196918400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759017.149556:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196918400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1097us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759017.149565:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1723 00000100:00100000:0.0:1782759017.149617:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196918528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1328us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759017.149625:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000001:02000400:1.0:1782759017.737560:0:112985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 33: correct srpc flags for MGS connection ========================================================== 14:50:15 (1782759015) 00010000:00010000:3.0:1782759018.092153:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759019.041377:0:113033:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_33 need shared key feature for this test 00010000:00010000:0.0:1782759019.116992:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759019.437389:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759019.437474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759019.437724:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809664 00000100:00100000:1.0:1782759019.437733:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809664 00000100:00100000:1.0:1782759019.437809:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1782759019.437820:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809664:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759019.437840:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782759019.437877:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759019.437923:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211809664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759019.437929:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1782759019.438047:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211809664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759020.140753:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759020.668184:0:113081:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 34: deny_unknown on default nodemap === 14:50:18 (1782759018) 00010000:00010000:3.0:1782759021.164060:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759021.502315:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211809792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759021.502456:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211810304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759021.502517:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759021.502525:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211809920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759021.502583:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211810432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759021.502641:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810304 00000100:00100000:0.0:1782759021.502648:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810304 00000100:00100000:0.0:1782759021.502694:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809920 00000100:00100000:0.0:1782759021.502696:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809920 00000100:00100000:0.0:1782759021.502717:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1782759021.502724:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211810304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502797:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211810304:12345-0@lo:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759021.502804:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1782759021.502844:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1782759021.502852:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211809920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502881:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211809920:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759021.502887:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1782759021.502910:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810432 00000100:00100000:0.0:1782759021.502913:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810432 00000100:00100000:0.0:1782759021.502942:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1782759021.502948:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211810432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.502980:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211810432:12345-0@lo:400:kworker.0 Request processed in 32us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759021.502986:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00080000:0.0:1782759021.503001:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759021.503005:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759021.503035:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211809920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.503044:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211810432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759021.503053:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211810304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.503195:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211809792 00000100:00100000:2.0:1782759021.503200:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211809792 00000100:00100000:2.0:1782759021.503236:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:2.0:1782759021.503244:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211809792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.503280:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211809792:12345-0@lo:400:kworker.0 Request processed in 38us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759021.503286:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00100000:0.0:1782759021.503643:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211809792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.506137:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211810048:0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.506211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759021.506260:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759021.506268:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211810176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.506295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759021.506336:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810176 00000100:00100000:2.0:1782759021.506343:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810176 00000100:00100000:2.0:1782759021.506397:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1782759021.506406:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211810176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759021.506457:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211810176:12345-0@lo:400:kworker.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759021.506464:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1782759021.506509:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211810176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759021.506789:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810048 00000100:00100000:1.0:1782759021.506795:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810048 00000100:00100000:1.0:1782759021.507692:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1782759021.507706:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211810048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759021.507791:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211810048:12345-0@lo:400:kworker.0 Request processed in 89us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759021.507802:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1782759021.507871:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211810048:0@lo:400:kworker.0 00000100:00080000:0.0:1782759021.509477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759021.509488:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759022.000049:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211810560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759022.000126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759022.000332:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810560 00000100:00100000:3.0:1782759022.000350:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810560 00000100:00100000:3.0:1782759022.000410:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1782759022.000420:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211810560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759022.000460:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759022.000515:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211810560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759022.000523:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1782759022.000680:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211810560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759022.192852:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759022.264732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759022.264807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759022.264977:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918784 00000100:00100000:0.0:1782759022.264987:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918784 00000100:00100000:0.0:1782759022.265076:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00100000:0.0:1782759022.265087:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196918784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759022.265157:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196918784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759022.265179:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00080000:3.0:1782759022.266309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759022.266888:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918656 00000100:00100000:1.0:1782759022.266898:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918656 00000100:00100000:1.0:1782759022.266954:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1725 00000100:00100000:1.0:1782759022.266965:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196918656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759022.267038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196918656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759022.267046:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1725 00000020:00000080:2.0:1782759022.441505:0:113177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc22c2c9c0 20000000:00000080:2.0:1782759022.441525:0:113177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b70800 uarg=0000000000000000 00010000:00010000:2.0:1782759022.442351:0:113177:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759022.442370:0:113177:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759022.442392:0:113177:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759022.442412:0:113177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759022.442431:0:113177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759022.442441:0:113177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759022.442483:0:113177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759022.442498:0:113177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 18 pid: 5796 timeout: 3190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759022.442514:0:113177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113177:1869355211810688:0@lo:104: 00000100:00100000:2.0:1782759022.442586:0:113177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759022.442739:0:113177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759022.442793:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759022.442806:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810688 00000100:00100000:0.0:1782759022.442814:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810688 00000100:00100000:0.0:1782759022.443374:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1782759022.443384:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb93c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113177:x1869355211810688:12345-0@lo:104: 00010000:00010000:0.0:1782759022.443397:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759022.443468:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759022.443475:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb93c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113177:x1869355211810688:12345-0@lo:104: Request processed in 93us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759022.443482:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1782759022.443627:0:113177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113177:1869355211810688:0@lo:104: 00010000:00010000:3.0:1782759022.443645:0:113177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443733:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759022.443740:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443749:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759022.443754:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443763:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759022.443771:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759022.443782:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759022.443941:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443948:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759022.443968:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443975:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4c00/0xdd99f5c4777dc78e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc795 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.443989:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759022.443991:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759022.443993:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759022.444000:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759022.444013:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211810816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759022.444050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759022.444089:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810816 00000100:00100000:1.0:1782759022.444094:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810816 00010000:00010000:1.0:1782759022.444114:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 3190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759022.444150:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1782759022.444158:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211810816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759022.444178:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759022.444183:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 3190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444198:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 3190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444212:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc795 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc78e expref: 19 pid: 5796 timeout: 3190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444224:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444234:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444247:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444254:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444261:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444267:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444272:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759022.444275:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444282:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444300:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759022.444308:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759022.444331:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211810816:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759022.444338:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1782759022.444367:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211810816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759022.444749:0:113177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759022.444758:0:113177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759022.444765:0:113177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc7d4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759023.215134:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759023.659913:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759023.659924:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759023.659931:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759023.659987:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759023.660010:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759023.660021:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759023.660048:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211810944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759023.660137:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759023.660201:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759023.660281:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211810944 00000100:00100000:0.0:1782759023.660290:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211810944 00000100:00100000:0.0:1782759023.660341:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:0.0:1782759023.660351:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211810944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759023.660365:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759023.660380:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc7db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759023.660406:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759023.660418:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759023.660427:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50000, rc 0) 00000100:00100000:0.0:1782759023.660477:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211810944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759023.660484:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1782759023.660787:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211810944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759023.660802:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759023.660811:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759023.660849:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759023.660855:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759023.660863:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759024.237203:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759024.558207:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759024.558233:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211811072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759024.558305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759024.558507:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811072 00000100:00100000:0.0:1782759024.558517:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811072 00000100:00100000:0.0:1782759024.558584:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1782759024.558592:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211811072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759024.558627:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759024.558690:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211811072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759024.558698:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1782759024.558747:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211811072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759024.558798:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759025.268202:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759026.284139:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759026.611354:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211811200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759026.611428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759026.611579:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811200 00000100:00100000:3.0:1782759026.611588:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811200 00000100:00100000:3.0:1782759026.611647:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1782759026.611657:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211811200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.612853:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211811328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.612902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759026.612933:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211811840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.612975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759026.612998:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759026.613005:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211811456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.613029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759026.613058:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811328 00000100:00100000:2.0:1782759026.613064:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811328 00000100:00100000:2.0:1782759026.613101:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811456 00000100:00100000:2.0:1782759026.613103:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811456 00000100:00100000:2.0:1782759026.613135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:2.0:1782759026.613144:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211811328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.613193:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211811328:12345-0@lo:400:kworker.0 Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759026.613199:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:2.0:1782759026.613218:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1782759026.613224:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211811456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.613252:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211811456:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759026.613258:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00080000:2.0:1782759026.613274:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759026.613299:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211811456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759026.613310:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211811328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.615915:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211811584:0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.615992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759026.616038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759026.616046:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211811712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759026.616099:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811840 00000100:00100000:1.0:1782759026.616106:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811840 00000100:00100000:1.0:1782759026.616152:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811584 00000100:00100000:1.0:1782759026.616155:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811584 00000100:00100000:1.0:1782759026.616171:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1782759026.616179:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211811840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616227:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211811840:12345-0@lo:400:kworker.0 Request processed in 48us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759026.616234:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1782759026.616253:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1782759026.616259:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211811584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616286:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211811584:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759026.616292:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1782759026.616307:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811712 00000100:00100000:1.0:1782759026.616310:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811712 00000100:00100000:1.0:1782759026.616335:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:1.0:1782759026.616341:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211811712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616368:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211811712:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759026.616373:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00080000:1.0:1782759026.616387:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759026.616391:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759026.616392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759026.616426:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211811840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616455:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211811712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759026.616463:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211811584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759026.616751:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211811200:12345-0@lo:400:kworker.0 Request processed in 5094us (5323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759026.616760:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1782759026.616924:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211811200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759027.116297:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759027.116320:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211811968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759027.116397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759027.116503:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211811968 00000100:00100000:3.0:1782759027.116511:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211811968 00000100:00100000:3.0:1782759027.116568:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1782759027.116578:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211811968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759027.116631:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759027.116689:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211811968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759027.116697:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1782759027.116778:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211811968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759027.312604:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759027.364259:0:113424:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca809cf40 20000000:00000080:0.0:1782759027.364277:0:113424:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca2000 uarg=0000000000000000 00010000:00010000:0.0:1782759027.364753:0:113424:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759027.364770:0:113424:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759027.364793:0:113424:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759027.364814:0:113424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759027.365121:0:113424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759027.365131:0:113424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759027.365176:0:113424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759027.365191:0:113424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 18 pid: 5794 timeout: 3195 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759027.365208:0:113424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113424:1869355211812096:0@lo:104: 00000100:00100000:0.0:1782759027.365275:0:113424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759027.365385:0:113424:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7a8ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759027.365488:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812096 00000100:00100000:1.0:1782759027.365497:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812096 00000100:00100000:1.0:1782759027.365578:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1782759027.365588:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113424:x1869355211812096:12345-0@lo:104: 00010000:00010000:1.0:1782759027.365602:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759027.365682:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759027.365690:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113424:x1869355211812096:12345-0@lo:104: Request processed in 103us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759027.365696:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1782759027.365767:0:113424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113424:1869355211812096:0@lo:104: 00010000:00010000:2.0:1782759027.365788:0:113424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.365844:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759027.365851:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.365858:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759027.365862:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.365871:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759027.365882:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759027.365887:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759027.365930:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.365938:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759027.365973:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.365980:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691e00/0xdd99f5c4777dc7db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366001:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759027.366002:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759027.366004:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759027.366011:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759027.366023:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211812224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759027.366057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759027.366093:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812224 00000100:00100000:3.0:1782759027.366097:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812224 00010000:00010000:3.0:1782759027.366116:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 3195 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759027.366137:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1782759027.366143:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211812224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759027.366152:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759027.366157:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 3195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366166:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 3195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366177:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc7e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc7db expref: 19 pid: 5794 timeout: 3195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366189:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366197:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366210:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366216:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366223:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366229:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366234:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759027.366237:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366244:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366255:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759027.366264:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759027.366290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211812224:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759027.366297:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1782759027.366323:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211812224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759027.366456:0:113424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759027.366465:0:113424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759027.366476:0:113424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dc7e9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759027.397011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759027.397056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759027.397186:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196918912 00000100:00100000:3.0:1782759027.397198:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196918912 00000100:00100000:3.0:1782759027.397262:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1728 00000100:00100000:3.0:1782759027.397272:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196918912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759027.397355:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196918912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759027.397363:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1728 00000100:00100000:0.0:1782759027.397644:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919040 00000100:00100000:0.0:1782759027.397649:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919040 00000100:00100000:0.0:1782759027.397728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00100000:0.0:1782759027.397736:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196919040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759027.397777:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196919040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759027.397785:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00080000:2.0:1782759027.397894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759028.338127:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759028.459972:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759028.459979:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759028.459984:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759028.460038:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759028.460051:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759028.460063:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759028.460088:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211812352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759028.460161:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759028.460226:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759028.465646:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812352 00000100:00100000:3.0:1782759028.465665:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812352 00000100:00100000:3.0:1782759028.465747:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1782759028.465758:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211812352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759028.465777:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759028.465799:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc7f0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759028.465864:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759028.465893:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759028.465903:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782759028.466003:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211812352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (5841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759028.466011:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00100000:2.0:1782759028.466629:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211812352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759028.466651:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759028.466662:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759028.466691:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759028.466697:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759028.466705:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759029.359732:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759029.684017:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759029.684039:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211812480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759029.684105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759029.692004:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812480 00000100:00100000:1.0:1782759029.692018:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812480 00000100:00100000:1.0:1782759029.692100:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1782759029.692111:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211812480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759029.692155:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759029.692242:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211812480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (8135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759029.692249:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1782759029.692313:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211812480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759029.692381:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759030.380402:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759031.404939:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759031.724489:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211812608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.724611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759031.724675:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211812736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.724684:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211813120:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.724720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759031.724730:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211812992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.724755:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211813248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.724767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759031.724791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759031.724801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759031.724810:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211812864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.724859:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812736 00000100:00100000:2.0:1782759031.724860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759031.724869:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812736 00000100:00100000:2.0:1782759031.724908:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812992 00000100:00100000:2.0:1782759031.724913:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812992 00000100:00100000:1.0:1782759031.724930:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812864 00000100:00100000:1.0:1782759031.724935:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812864 00000100:00100000:2.0:1782759031.724954:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813248 00000100:00100000:2.0:1782759031.724959:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813248 00000100:00100000:1.0:1782759031.724967:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1782759031.724977:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.724987:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1782759031.724998:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211812992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.725043:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211812992:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759031.725051:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1782759031.725066:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:2.0:1782759031.725073:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211813248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.725104:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211813248:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759031.725110:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00080000:2.0:1782759031.725125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759031.725130:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759031.725132:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759031.725156:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211812992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759031.725181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759031.725277:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211812736:12345-0@lo:400:kworker.0 Request processed in 301us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759031.725285:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:0.0:1782759031.725292:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813120 00000100:00100000:0.0:1782759031.725297:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813120 00000100:00100000:1.0:1782759031.725307:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:1.0:1782759031.725316:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211812864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759031.725337:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:0.0:1782759031.725347:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211813120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.725362:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211812864:12345-0@lo:400:kworker.0 Request processed in 47us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759031.725369:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00100000:0.0:1782759031.725405:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211813120:12345-0@lo:400:kworker.0 Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759031.725412:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:1.0:1782759031.725447:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211812736:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.725459:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211813248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.725492:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211812864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759031.725543:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211813120:0@lo:400:kworker.0 00000100:00080000:2.0:1782759031.725696:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759031.725987:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211812608 00000100:00100000:0.0:1782759031.725992:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211812608 00000100:00100000:0.0:1782759031.726026:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1782759031.726033:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211812608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759031.726075:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211812608:12345-0@lo:400:kworker.0 Request processed in 43us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759031.726082:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:1.0:1782759031.727056:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211812608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759032.236561:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211813376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759032.236638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759032.236742:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813376 00000100:00100000:0.0:1782759032.236750:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813376 00000100:00100000:0.0:1782759032.236800:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1782759032.236809:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211813376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759032.236887:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759032.236946:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211813376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759032.236955:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1782759032.236999:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211813376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759032.435093:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759032.508990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759032.509043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759032.509078:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919168 00000100:00100000:2.0:1782759032.509089:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919168 00000100:00100000:2.0:1782759032.509140:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1731 00000100:00100000:2.0:1782759032.509150:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196919168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759032.509228:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196919168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759032.509235:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1731 00000100:00100000:0.0:1782759032.509731:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919296 00000100:00100000:0.0:1782759032.509738:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919296 00000100:00100000:0.0:1782759032.509788:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00100000:0.0:1782759032.509795:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196919296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759032.509866:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196919296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759032.509873:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00080000:2.0:1782759032.510582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759033.452438:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759034.485113:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759034.796060:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759034.796085:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211813504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759034.796167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759034.796536:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813504 00000100:00100000:1.0:1782759034.796545:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813504 00000100:00100000:1.0:1782759034.796607:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1782759034.796615:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211813504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759034.796651:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759034.796707:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211813504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759034.796715:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1782759034.796774:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211813504:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759034.796960:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759035.516591:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759036.531641:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759036.848654:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211813632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.848968:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211813760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759036.853452:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211814016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.853904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759036.853973:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211814272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.854005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759036.854055:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813760 00000100:00100000:0.0:1782759036.854064:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813760 00000100:00100000:0.0:1782759036.854119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1782759036.854128:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211813760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.854349:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211813760:12345-0@lo:400:kworker.0 Request processed in 221us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759036.854357:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1782759036.854440:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211813760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.854562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759036.854608:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211814144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.854635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759036.854670:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211813888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.854696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759036.854726:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814144 00000100:00100000:1.0:1782759036.854731:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814144 00000100:00100000:1.0:1782759036.854923:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813888 00000100:00100000:1.0:1782759036.854928:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813888 00000100:00100000:1.0:1782759036.854956:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:1.0:1782759036.854963:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211814144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.855005:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211814144:12345-0@lo:400:kworker.0 Request processed in 42us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759036.855011:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:1.0:1782759036.855258:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:1.0:1782759036.855266:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211813888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.855303:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211813888:12345-0@lo:400:kworker.0 Request processed in 39us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759036.855309:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00080000:1.0:1782759036.855329:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759036.855353:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211814144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.855376:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211813888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.856953:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211813632 00000100:00100000:0.0:1782759036.856965:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211813632 00000100:00100000:0.0:1782759036.857024:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:0.0:1782759036.857034:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211813632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759036.857127:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211813632:12345-0@lo:400:kworker.0 Request processed in 95us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759036.857135:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:1.0:1782759036.857332:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211813632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759036.857996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759036.858058:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814272 00000100:00100000:2.0:1782759036.858066:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814272 00000100:00100000:2.0:1782759036.858118:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814016 00000100:00100000:2.0:1782759036.858121:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814016 00000100:00100000:2.0:1782759036.858145:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:2.0:1782759036.858153:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211814272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.858257:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:1.0:1782759036.858267:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211814016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759036.858320:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211814016:12345-0@lo:400:kworker.0 Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759036.858330:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:1.0:1782759036.858369:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211814016:0@lo:400:kworker.0 00000100:00080000:0.0:1782759036.858421:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759036.858425:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759036.858493:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211814272:12345-0@lo:400:kworker.0 Request processed in 340us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759036.858499:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1782759036.858756:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211814272:0@lo:400:kworker.0 00000020:00000080:3.0:1782759036.868423:0:113817:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5600fdc0 20000000:00000080:3.0:1782759036.868456:0:113817:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba89000 uarg=0000000000000000 00010000:00010000:3.0:1782759036.869405:0:113817:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759036.869424:0:113817:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759036.869455:0:113817:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759036.869476:0:113817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759036.869494:0:113817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759036.869502:0:113817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759036.869548:0:113817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759036.869564:0:113817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 18 pid: 5793 timeout: 3205 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759036.869582:0:113817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113817:1869355211814400:0@lo:104: 00000100:00100000:3.0:1782759036.869657:0:113817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759036.869705:0:113817:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759036.869806:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814400 00000100:00100000:0.0:1782759036.869813:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814400 00000100:00100000:0.0:1782759036.869891:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1782759036.869901:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113817:x1869355211814400:12345-0@lo:104: 00010000:00010000:0.0:1782759036.869915:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759036.870114:0:113817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:113817:1869355211814400:0@lo:104: 00010000:00010000:3.0:1782759036.870134:0:113817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759036.870560:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759036.870569:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:113817:x1869355211814400:12345-0@lo:104: Request processed in 669us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759036.870578:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:1.0:1782759036.870632:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759036.870638:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.870648:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759036.870652:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.870662:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759036.870670:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759036.870676:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759036.870759:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.870766:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759036.870920:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.870930:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc7f0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc7f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.870946:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759036.870948:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759036.870950:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759036.870994:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759036.871008:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211814528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759036.871051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759036.871421:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814528 00000100:00100000:1.0:1782759036.871437:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814528 00010000:00010000:1.0:1782759036.871465:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 3205 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759036.871497:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1782759036.871507:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211814528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759036.871521:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759036.871526:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 3205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871538:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 3205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871554:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dc7f7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc7f0 expref: 19 pid: 5793 timeout: 3205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871566:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871575:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871592:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871599:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871606:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871613:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871620:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759036.871625:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.871632:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759036.872079:0:113817:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759036.872090:0:113817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.872984:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.872998:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690800/0xdd99f5c4777dc7fe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 113817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759036.873021:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759036.873156:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211814528:12345-0@lo:103:ldlm_bl.0 Request processed in 1648us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759036.873177:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1782759036.873712:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211814528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759037.356037:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759037.356432:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211814656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759037.356513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759037.356570:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814656 00000100:00100000:2.0:1782759037.356581:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814656 00000100:00100000:2.0:1782759037.356636:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1782759037.356648:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211814656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759037.356688:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759037.356737:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211814656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759037.356745:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1782759037.356792:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211814656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759037.548071:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759037.623744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759037.623795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759037.623878:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919552 00000100:00100000:1.0:1782759037.623888:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919552 00000100:00100000:0.0:1782759037.624007:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919424 00000100:00100000:0.0:1782759037.624011:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919424 00000100:00100000:0.0:1782759037.624054:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1733 00000100:00100000:0.0:1782759037.624064:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759037.624132:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759037.624135:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00100000:0.0:1782759037.624140:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1733 00000100:00100000:1.0:1782759037.624142:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196919552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759037.624172:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196919552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759037.624178:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00080000:2.0:1782759037.625221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1782759038.316781:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759038.316790:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759038.316796:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759038.316877:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759038.316888:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759038.316899:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759038.316924:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211814784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759038.317013:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759038.317074:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759038.317259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814784 00000100:00100000:1.0:1782759038.317269:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814784 00000100:00100000:1.0:1782759038.317331:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1782759038.317340:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211814784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759038.317355:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759038.317369:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc805 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759038.317392:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759038.317413:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759038.317422:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759038.317475:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211814784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759038.317481:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:2.0:1782759038.317671:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211814784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759038.317686:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759038.317695:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759038.317719:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759038.317724:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759038.317731:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759038.572012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759039.596020:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759039.917989:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759039.918012:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211814912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759039.918074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759039.918137:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211814912 00000100:00100000:1.0:1782759039.918145:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211814912 00000100:00100000:1.0:1782759039.918192:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1782759039.918200:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211814912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759039.918246:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759039.918287:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211814912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759039.918298:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1782759039.918344:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211814912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759039.920653:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782759040.588511:0:114014:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc710878f0 20000000:00000080:1.0:1782759040.588533:0:114014:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312c000 uarg=0000000000000000 00010000:00010000:1.0:1782759040.589553:0:114014:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759040.589571:0:114014:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759040.589588:0:114014:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759040.590670:0:114014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759040.590693:0:114014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759040.590701:0:114014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759040.590745:0:114014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759040.590760:0:114014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 18 pid: 5796 timeout: 3208 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759040.590775:0:114014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114014:1869355211815040:0@lo:104: 00000100:00100000:1.0:1782759040.590912:0:114014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759040.591034:0:114014:0:(client.c:2701:ptlrpc_set_wait()) set ffff917089191d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759040.591278:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815040 00000100:00100000:2.0:1782759040.591287:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815040 00000100:00100000:2.0:1782759040.591492:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1782759040.591502:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114014:x1869355211815040:12345-0@lo:104: 00010000:00010000:2.0:1782759040.591516:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759040.591591:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759040.591811:0:114014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114014:1869355211815040:0@lo:104: 00010000:00010000:3.0:1782759040.591853:0:114014:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.591921:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759040.591929:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.591937:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759040.591941:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.591955:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759040.591962:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759040.591968:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759040.592010:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592024:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759040.592047:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592054:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51a00/0xdd99f5c4777dc805 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc80c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592070:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759040.592072:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759040.592073:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759040.592097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211815168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759040.592135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759040.592186:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815168 00000100:00100000:0.0:1782759040.592190:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815168 00010000:00010000:0.0:1782759040.592211:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 3208 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759040.592235:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1782759040.592242:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211815168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759040.592254:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759040.592259:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 3208 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592269:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 3208 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592283:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dc80c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc805 expref: 19 pid: 5796 timeout: 3208 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592296:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592305:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592320:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592327:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592346:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592352:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592366:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759040.592370:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592380:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592391:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759040.592399:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759040.592428:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211815168:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759040.592435:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1782759040.592468:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211815168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759040.592788:0:114014:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759040.592798:0:114014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759040.592808:0:114014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777dc813 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759040.593931:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114014:x1869355211815040:12345-0@lo:104: Request processed in 97us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759040.593948:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00010000:00010000:2.0:1782759040.620035:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759041.644985:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759041.771930:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759041.771940:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759041.771945:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759041.771997:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759041.772010:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759041.772023:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759041.772048:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211815296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759041.772119:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759041.772182:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759041.772199:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815296 00000100:00100000:0.0:1782759041.772208:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815296 00000100:00100000:0.0:1782759041.772261:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:0.0:1782759041.772270:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211815296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759041.772285:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759041.772300:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc81a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759041.772327:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759041.772348:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759041.772357:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50e00, rc 0) 00000100:00100000:0.0:1782759041.772412:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211815296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759041.772421:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00100000:2.0:1782759041.772439:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211815296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759041.772458:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759041.772468:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759041.772493:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759041.772499:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759041.772506:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759041.966569:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211815552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.966633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759041.966698:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759041.966705:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211815424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.966725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759041.966740:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211815936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.966760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759041.966787:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815552 00000100:00100000:1.0:1782759041.966794:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815552 00000100:00100000:1.0:1782759041.966876:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815424 00000100:00100000:1.0:1782759041.966880:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815424 00000100:00100000:1.0:1782759041.966902:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:1.0:1782759041.966911:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211815552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.966963:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211815552:12345-0@lo:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759041.966970:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00000100:00100000:1.0:1782759041.966991:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:1.0:1782759041.966997:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211815424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.967023:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211815424:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759041.967028:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:1.0:1782759041.967046:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815936 00000100:00100000:1.0:1782759041.967049:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815936 00000100:00100000:1.0:1782759041.967075:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:1.0:1782759041.967081:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211815936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.967106:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211815936:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759041.967112:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00080000:1.0:1782759041.967125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759041.967130:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759041.967168:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211815424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.967176:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211815936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.967184:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211815552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759041.967721:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211815680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759041.967755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759041.967787:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759041.967794:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211815808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759041.967839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759041.968366:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815808 00000100:00100000:3.0:1782759041.968373:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815808 00000100:00100000:3.0:1782759041.968424:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:3.0:1782759041.968433:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211815808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759041.968479:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211815808:12345-0@lo:400:kworker.0 Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759041.968486:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:3.0:1782759041.968519:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211815808:0@lo:400:kworker.0 00000100:00080000:0.0:1782759041.968587:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759041.970402:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211815680 00000100:00100000:1.0:1782759041.970420:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211815680 00000100:00100000:1.0:1782759041.970504:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:1.0:1782759041.970513:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211815680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759041.970594:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211815680:12345-0@lo:400:kworker.0 Request processed in 82us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759041.970600:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00080000:0.0:1782759041.970941:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759041.973405:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211815680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759042.477726:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211816064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759042.477820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759042.478211:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816064 00000100:00100000:3.0:1782759042.478220:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816064 00000100:00100000:3.0:1782759042.478305:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1782759042.478331:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211816064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759042.478376:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759042.478438:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211816064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759042.478457:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1782759042.479516:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211816064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759042.670377:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759042.746699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759042.746763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759042.746897:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919808 00000100:00100000:1.0:1782759042.746911:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919808 00000100:00100000:1.0:1782759042.747008:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2238 00000100:00100000:1.0:1782759042.747021:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196919808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759042.747118:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196919808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759042.747126:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2238 00000100:00080000:0.0:1782759042.747489:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759042.747966:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919680 00000100:00100000:2.0:1782759042.747973:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919680 00000100:00100000:2.0:1782759042.748027:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1736 00000100:00100000:2.0:1782759042.748036:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759042.748081:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759042.748089:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1736 00010000:00010000:2.0:1782759043.692224:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759044.680171:0:114211:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 35: Check permissions when accessing changelogs ========================================================== 14:50:42 (1782759042) 00010000:00010000:3.0:1782759044.716910:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759045.036026:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759045.036051:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211816192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759045.036123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759045.036198:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816192 00000100:00100000:0.0:1782759045.036205:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816192 00000100:00100000:0.0:1782759045.036258:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1782759045.036281:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211816192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759045.036320:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759045.036361:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211816192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759045.036369:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00080000:0.0:1782759045.036388:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759045.036437:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211816192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759045.746705:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782759046.335470:0:114308:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:0.0:1782759046.764249:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759047.084209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211816448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084481:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211816320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759047.084598:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211816832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759047.084653:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759047.084659:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211816704:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759047.084716:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816320 00000100:00100000:2.0:1782759047.084723:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816320 00000100:00100000:2.0:1782759047.084765:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1782759047.084774:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211816320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084844:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211816320:12345-0@lo:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759047.084852:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1782759047.084898:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816832 00000100:00100000:2.0:1782759047.084902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816832 00000100:00100000:2.0:1782759047.084939:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:2.0:1782759047.084946:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211816832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.084981:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211816832:12345-0@lo:400:kworker.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759047.084988:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:2.0:1782759047.085008:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816704 00000100:00100000:2.0:1782759047.085011:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816704 00000100:00100000:2.0:1782759047.085040:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1782759047.085047:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211816704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.085080:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211816704:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759047.085086:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00080000:2.0:1782759047.085105:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759047.085110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759047.085149:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211816704:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.085160:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211816320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759047.085168:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211816832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.085696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759047.085723:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211816960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.085751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759047.085815:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759047.085839:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211816576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.085872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759047.085902:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816448 00000100:00100000:1.0:1782759047.085907:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816448 00000100:00100000:1.0:1782759047.085937:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816576 00000100:00100000:1.0:1782759047.085940:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816576 00000100:00100000:1.0:1782759047.085962:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1782759047.085968:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211816448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.086008:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211816448:12345-0@lo:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759047.086014:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1782759047.086032:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:1.0:1782759047.086037:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211816576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.086064:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211816576:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759047.086069:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:1.0:1782759047.086099:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211816576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759047.086108:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211816448:0@lo:400:kworker.0 00000100:00080000:2.0:1782759047.086190:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759047.086371:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211816960 00000100:00100000:3.0:1782759047.086376:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211816960 00000100:00100000:3.0:1782759047.086461:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1782759047.086469:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211816960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759047.086509:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211816960:12345-0@lo:400:kworker.0 Request processed in 41us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759047.086514:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:1.0:1782759047.086589:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211816960:0@lo:400:kworker.0 00000100:00080000:2.0:1782759047.086630:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1782759047.087668:0:114356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffebfd11400 00000004:00000080:0.0:1782759047.087688:0:114356:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff917082cd9800 uarg=0000000000000000 00000004:00000080:0.0:1782759047.087731:0:114356:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff917082cd9800 00000040:00080000:0.0:1782759047.089224:0:114356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782759047.089430:0:114356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1782759047.089499:0:114356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:0.0:1782759047.089541:0:114356:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:0.0:1782759047.089545:0:114356:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1782759047.600713:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211817088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759047.600788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759047.603287:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817088 00000100:00100000:3.0:1782759047.603302:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817088 00000100:00100000:3.0:1782759047.603408:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1782759047.603419:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211817088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759047.603626:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759047.606362:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211817088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2936us (5564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759047.606376:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1782759047.607127:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211817088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759047.789093:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782759047.819101:0:114404:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759047.819108:0:114404:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1782759047.819149:0:114404:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782759047.819155:0:114404:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1782759047.876203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759047.876272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759047.876310:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920064 00000100:00100000:2.0:1782759047.876320:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920064 00000100:00100000:2.0:1782759047.876393:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00100000:2.0:1782759047.876404:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196920064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759047.876478:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196920064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759047.876486:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00080000:2.0:1782759047.876508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759047.876875:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196919936 00000100:00100000:1.0:1782759047.876880:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196919936 00000100:00100000:1.0:1782759047.876915:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1738 00000100:00100000:1.0:1782759047.876923:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759047.876954:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196919936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759047.876959:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1738 00010000:00010000:3.0:1782759048.815298:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759048.929350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759048.931306:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920192 00000100:00100000:0.0:1782759048.931320:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920192 00000100:00100000:0.0:1782759048.931394:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1288 00000100:00100000:0.0:1782759048.931405:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:72465:x1869355196920192:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1782759048.931425:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759048.931451:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dc828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65159 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931522:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931536:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931549:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759048.931770:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759048.931775:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759048.931888:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931915:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dc828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65159 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931935:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65159 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.931944:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70200) 00010000:00010000:0.0:1782759048.931947:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759048.931951:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782759048.932018:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:72465:x1869355196920192:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 615us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759048.932025:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1288 00000100:00100000:2.0:1782759048.937773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759048.937874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759048.937908:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920448 00000100:00100000:0.0:1782759048.937919:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920448 00000100:00100000:0.0:1782759048.937976:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:0.0:1782759048.937987:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b63da415-9fe7-432d-aaab-047a80aa0861+6:72465:x1869355196920448:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:0.0:1782759048.938070:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b63da415-9fe7-432d-aaab-047a80aa0861+6:72465:x1869355196920448:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759048.938078:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:3.0:1782759048.938150:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920320 00000100:00100000:3.0:1782759048.938156:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920320 00000100:00100000:3.0:1782759048.938293:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1289 00000100:00100000:3.0:1782759048.938302:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+6:2362:x1869355196920320:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:3.0:1782759048.938332:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1782759048.938367:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+6:2362:x1869355196920320:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 67us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759048.938375:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1289 00000100:00100000:0.0:1782759048.945305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759048.945371:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920704 00000100:00100000:3.0:1782759048.945381:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920704 00000100:00100000:3.0:1782759048.945439:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1290 00000100:00100000:3.0:1782759048.945449:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+6:72465:x1869355196920704:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759048.945499:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759048.945526:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dc82f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65159 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945540:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70200) 00010000:00010000:3.0:1782759048.945550:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759048.945866:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945879:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945889:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945943:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945950:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.945957:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759048.947082:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782759048.947255:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00000004:00200000:3.0:1782759048.947456:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782759048.947468:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947477:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947484:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947490:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759048.947494:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947501:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947514:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759048.947517:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759048.947521:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.947527:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc836 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759048.947543:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005820c249 reply state 000000008595173b transno 4294967789 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759048.947551:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759048.947637:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+7:72465:x1869355196920704:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2187us (2340us total) trans 4294967789 rc 0/0 00000100:00100000:3.0:1782759048.947646:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1290 00010000:00010000:3.0:1782759048.953860:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953876:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953885:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953891:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759048.953896:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953903:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953919:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61f65a1e (ffff9171908a1000) 00010000:00010000:3.0:1782759048.953922:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759048.953926:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.953932:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690c00/0xdd99f5c4777dc83d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759048.964569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759048.965033:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920832 00000100:00100000:1.0:1782759048.965044:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920832 00000100:00100000:1.0:1782759048.965098:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:1.0:1782759048.965107:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:72466:x1869355196920832:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759048.965129:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759048.965150:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65160 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965218:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965232:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965242:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759048.965296:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759048.965300:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759048.965321:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965342:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65160 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965357:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65160 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.965366:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:1.0:1782759048.965369:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759048.965372:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759048.965429:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+7:72466:x1869355196920832:12345-192.168.204.31@tcp:101:touch.0 Request processed in 323us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759048.965436:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1291 00000100:00100000:0.0:1782759048.967677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759048.967851:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196920960 00000100:00100000:3.0:1782759048.967861:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196920960 00000100:00100000:3.0:1782759048.967907:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1292 00000100:00100000:3.0:1782759048.967916:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+7:72466:x1869355196920960:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759048.967934:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759048.967951:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65167 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968014:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968029:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968040:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968054:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968061:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968068:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968171:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968178:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968184:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759048.968227:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782759048.968230:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759048.968251:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968265:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968272:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968278:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968284:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759048.968288:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968295:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968305:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:3.0:1782759048.968308:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759048.968312:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968318:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691c00/0xdd99f5c4777dc859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968329:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968335:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968341:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968346:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759048.968349:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968355:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968362:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61f65a1e (ffff9171908a1a00) 00010000:00010000:3.0:1782759048.968363:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759048.968366:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968371:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691a00/0xdd99f5c4777dc860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968400:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690200/0xdd99f5c4777dc852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65167 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968411:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65167 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759048.968418:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759048.968420:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759048.968422:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690800, rc 0) 00000100:00100000:3.0:1782759048.968475:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+8:72466:x1869355196920960:12345-192.168.204.31@tcp:101:touch.0 Request processed in 560us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759048.968481:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1292 00000100:00100000:1.0:1782759048.975818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759048.977538:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196921216 00000100:00100000:0.0:1782759048.977552:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196921216 00000100:00100000:0.0:1782759048.977890:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1293 00000100:00100000:0.0:1782759048.977900:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+8:72466:x1869355196921216:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759048.977920:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759048.977940:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc86e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6516e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978073:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978087:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978099:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978163:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978170:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.978176:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759048.980359:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28:0x0], index 0: 0 00010000:00010000:0.0:1782759048.980645:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.980661:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.980675:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759048.984432:0:19544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967790 00010000:00010000:0.0:1782759048.984595:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984612:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984620:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984626:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759048.984631:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984638:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984654:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:0.0:1782759048.984657:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759048.984662:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984668:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc875 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759048.984679:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc6f32a0 reply state 0000000087dfe29c transno 4294967791 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759048.984688:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759048.984736:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dc86e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6516e expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984751:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc883 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6516e expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759048.984764:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759048.984766:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759048.984768:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782759048.984857:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+12:72466:x1869355196921216:12345-192.168.204.31@tcp:101:touch.0 Request processed in 6958us (9049us total) trans 4294967791 rc 0/0 00000100:00100000:0.0:1782759048.984866:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1293 00000020:00080000:0.0:1782759048.984871:0:19544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782759048.997690:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997708:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997715:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997721:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759048.997726:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997734:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997753:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0xd78a3b74 (ffff917183a70b00) 00010000:00010000:1.0:1782759048.997756:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759048.997761:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759048.997766:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51e00/0xdd99f5c4777dc87c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0xd78a3b74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759049.001185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759049.001402:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196921472 00000100:00100000:2.0:1782759049.001413:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196921472 00000100:00100000:2.0:1782759049.001474:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1294 00000100:00100000:2.0:1782759049.001484:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+11:72466:x1869355196921472:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782759049.001554:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759049.001582:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc883 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6516e expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.001612:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759049.001625:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759049.001673:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.001689:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.001699:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759049.001957:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ebb39bc reply state 00000000ee25755d transno 4294967792 ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759049.001967:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759049.002065:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+12:72466:x1869355196921472:12345-192.168.204.31@tcp:36:touch.0 Request processed in 581us (888us total) trans 4294967792 rc 0/0 00000100:00100000:2.0:1782759049.002073:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1294 00010000:00010000:2.0:1782759049.006689:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006707:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006715:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006721:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759049.006726:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006733:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006750:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759049.006754:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759049.006758:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759049.006768:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694800/0xdd99f5c4777dc891 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759049.016975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759049.017444:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196921600 00000100:00100000:0.0:1782759049.017454:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196921600 00000100:00100000:0.0:1782759049.017565:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1295 00000100:00100000:0.0:1782759049.017576:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+11:72466:x1869355196921600:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759049.017600:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759049.017621:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc898 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65175 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759049.017678:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc898 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65175 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759049.017693:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc898 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65175 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759049.017713:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759049.017715:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759049.017719:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782759049.017781:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+12:72466:x1869355196921600:12345-192.168.204.31@tcp:101:touch.0 Request processed in 206us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759049.017792:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1295 00000100:00080000:1.0:1782759049.017936:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759049.036496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.036653:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196921728 00000100:00100000:1.0:1782759049.036663:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196921728 00000100:00100000:1.0:1782759049.036703:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 716 00000100:00100000:1.0:1782759049.036711:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196921728:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:1.0:1782759049.036741:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b63da415-9fe7-432d-aaab-047a80aa0861@192.168.204.31@tcp t0 exp 0000000000000000 cur 3117 last 0 00000020:00000080:1.0:1782759049.036775:0:6597:0:(genops.c:1406:class_connect()) connect: client b63da415-9fe7-432d-aaab-047a80aa0861, cookie 0xdd99f5c4777dc89f 00002000:00100000:1.0:1782759049.036789:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b63da415-9fe7-432d-aaab-047a80aa0861/ffff9171861f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759049.036819:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759049.037091:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782759049.037128:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9171b785b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759049.037362:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+6:2360:x1869355196921728:12345-192.168.204.31@tcp:8:touch.0 Request processed in 649us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.037371:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 716 00000100:00100000:3.0:1782759049.043286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759049.043323:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196921856 00000100:00100000:3.0:1782759049.043333:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196921856 00000100:00100000:3.0:1782759049.043391:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 717 00000100:00100000:3.0:1782759049.043402:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+6:0:x1869355196921856:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:0.0:1782759049.043892:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759049.106057:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+7:0:x1869355196921856:12345-192.168.204.31@tcp:2:touch.0 Request processed in 62646us (62772us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1782759049.106073:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 717 00000001:00100000:3.0:1782759049.106105:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000001:00080000:3.0:1782759049.106119:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00000100:00100000:1.0:1782759049.112992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759049.113102:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922112 00000100:00100000:3.0:1782759049.113112:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922112 00000100:00100000:3.0:1782759049.113178:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:3.0:1782759049.113198:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b63da415-9fe7-432d-aaab-047a80aa0861+12:72466:x1869355196922112:12345-192.168.204.31@tcp:35:touch.0 00000001:00080000:3.0:1782759049.113721:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967793 00000100:00100000:3.0:1782759049.113895:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b63da415-9fe7-432d-aaab-047a80aa0861+14:72466:x1869355196922112:12345-192.168.204.31@tcp:35:touch.0 Request processed in 706us (911us total) trans 4294967794 rc 0/0 00000100:00100000:3.0:1782759049.113904:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 133 00000020:00080000:3.0:1782759049.113910:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759049.174930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759049.174998:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922240 00000100:00100000:0.0:1782759049.175008:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922240 00000100:00100000:0.0:1782759049.175060:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1296 00000100:00100000:0.0:1782759049.175071:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922240:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1782759049.175645:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922240:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 571us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759049.175655:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1296 00000100:00100000:0.0:1782759049.182441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.182893:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922368 00000100:00100000:1.0:1782759049.182907:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922368 00000100:00100000:1.0:1782759049.182973:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1297 00000100:00100000:1.0:1782759049.182984:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922368:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1782759049.183134:0:5801:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1782759049.183233:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922368:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 250us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.183241:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1297 00000100:00100000:1.0:1782759049.186344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759049.186766:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922496 00000100:00100000:2.0:1782759049.186778:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922496 00000100:00100000:2.0:1782759049.186993:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1298 00000100:00100000:2.0:1782759049.187005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922496:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759049.187158:0:5802:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759049.187267:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922496:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 263us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759049.187275:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1298 00000100:00100000:3.0:1782759049.189428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759049.189521:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922624 00000100:00100000:0.0:1782759049.189530:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922624 00000100:00100000:0.0:1782759049.189643:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1299 00000100:00100000:0.0:1782759049.189653:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922624:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1782759049.189797:0:19544:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759049.189918:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922624:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 264us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759049.189926:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1299 00000100:00100000:0.0:1782759049.193347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.193533:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922752 00000100:00100000:1.0:1782759049.193544:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922752 00000100:00100000:1.0:1782759049.193607:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:1.0:1782759049.193619:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922752:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1782759049.194182:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922752:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 563us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.194203:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1300 00000100:00100000:2.0:1782759049.196107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.196279:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196922880 00000100:00100000:1.0:1782759049.196289:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196922880 00000100:00100000:1.0:1782759049.196387:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1301 00000100:00100000:1.0:1782759049.196399:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922880:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1782759049.196872:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196922880:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 474us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.196880:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1301 00000100:00100000:3.0:1782759049.202803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759049.203219:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923008 00000100:00100000:0.0:1782759049.203233:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923008 00000100:00100000:0.0:1782759049.203307:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1302 00000100:00100000:0.0:1782759049.203318:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196923008:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1782759049.205306:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196923008:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 1979us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759049.205322:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1302 00000100:00100000:0.0:1782759049.208757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.208857:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923136 00000100:00100000:1.0:1782759049.208867:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923136 00000100:00100000:1.0:1782759049.208929:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:1.0:1782759049.208939:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196923136:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1782759049.209126:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+14:72470:x1869355196923136:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 187us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.209134:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1303 00000100:00100000:2.0:1782759049.288321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759049.288607:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923264 00000100:00100000:1.0:1782759049.288619:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923264 00000100:00100000:1.0:1782759049.288676:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1304 00000100:00100000:1.0:1782759049.288688:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72479:x1869355196923264:12345-192.168.204.31@tcp:46:lfs.0 00000004:00000080:1.0:1782759049.288727:0:5802:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff917198163f18 uarg=0000000000000000 00000004:00000080:1.0:1782759049.288776:0:5802:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff917198163f18 00000004:00000080:1.0:1782759049.288782:0:5802:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:1.0:1782759049.288891:0:5802:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759049.288896:0:5802:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1782759049.288924:0:5802:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 4 00000040:00080000:1.0:1782759049.288988:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782759049.288994:0:5802:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1782759049.288998:0:5802:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:1.0:1782759049.289026:0:5802:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759049.289029:0:5802:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1782759049.289212:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 4 count 1 00000040:00080000:1.0:1782759049.289217:0:5802:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1782759049.289340:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+14:72479:x1869355196923264:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 653us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759049.289370:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1304 00000001:00080000:2.0:1782759049.708739:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967791 is committed 00000001:00080000:2.0:1782759049.708778:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967792 is committed 00000001:00080000:2.0:1782759049.708785:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967794 is committed 00010000:00010000:1.0:1782759049.836759:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759050.156223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759050.156294:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759050.156365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759050.156463:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817216 00000100:00100000:2.0:1782759050.156471:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817216 00000100:00100000:2.0:1782759050.156533:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1782759050.156542:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211817216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759050.156566:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759050.156931:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211817216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 387us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759050.156940:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:2.0:1782759050.156966:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759050.157039:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211817216:0@lo:13:osp-pre-0-0.0 00000004:00000400:3.0:1782759050.242811:0:114501:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1782759050.267095:0:114501:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1782759050.860054:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759051.074265:0:114549:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd37d58f90 20000000:00000080:1.0:1782759051.074288:0:114549:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718853e000 uarg=0000000000000000 10000000:01000000:1.0:1782759051.074965:0:114549:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759051.074986:0:114549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759051.075005:0:114549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759051.075013:0:114549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759051.075051:0:114549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759051.075065:0:114549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 18 pid: 5793 timeout: 3219 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759051.075080:0:114549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114549:1869355211817344:0@lo:104: 00000100:00100000:1.0:1782759051.075140:0:114549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759051.075198:0:114549:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759051.075392:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817344 00000100:00100000:2.0:1782759051.075399:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817344 00000100:00100000:2.0:1782759051.075451:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1782759051.075460:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114549:x1869355211817344:12345-0@lo:104: 00010000:00010000:2.0:1782759051.075473:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.075543:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759051.075549:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114549:x1869355211817344:12345-0@lo:104: Request processed in 91us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759051.075555:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00010000:00010000:0.0:1782759051.075867:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759051.075876:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.075886:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759051.075890:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.075900:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759051.075907:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759051.075913:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759051.075951:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.075958:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759051.075985:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.075992:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691600/0xdd99f5c4777dc81a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc821 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076007:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759051.076010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759051.076012:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759051.076183:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211817472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759051.076226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759051.076307:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817472 00000100:00100000:0.0:1782759051.076313:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817472 00010000:00010000:0.0:1782759051.076349:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 3219 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759051.076364:0:114549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114549:1869355211817344:0@lo:104: 00000100:00100000:0.0:1782759051.076385:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00010000:00010000:2.0:1782759051.076387:0:114549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759051.076395:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9383050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211817472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759051.076408:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759051.076414:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 3219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076425:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 3219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076438:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50e00/0xdd99f5c4777dc821 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc81a expref: 19 pid: 5793 timeout: 3219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076451:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076459:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076474:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076481:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076487:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076494:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076500:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759051.076505:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076513:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076531:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759051.076541:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759051.076581:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9383050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211817472:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759051.076589:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1782759051.076608:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211817472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759051.076662:0:114549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.076670:0:114549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.076676:0:114549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8a6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759051.784960:0:114597:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc52f483a0 20000000:00000080:2.0:1782759051.784981:0:114597:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718853e000 uarg=0000000000000000 10000000:01000000:2.0:1782759051.785370:0:114597:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759051.785392:0:114597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785410:0:114597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785423:0:114597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785430:0:114597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785436:0:114597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785443:0:114597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785450:0:114597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759051.785454:0:114597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785463:0:114597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785476:0:114597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785484:0:114597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759051.785493:0:114597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759051.891556:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759052.206286:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211817728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.206380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759052.206437:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211818240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.206463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759052.206485:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211817600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.206507:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211817984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.206530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759052.206544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759052.206569:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817728 00000100:00100000:0.0:1782759052.206578:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211818112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.206579:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759052.206580:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817728 00000100:00100000:2.0:1782759052.206591:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211817856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.206614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759052.206884:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818240 00000100:00100000:2.0:1782759052.206889:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818240 00000100:00100000:1.0:1782759052.206903:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818112 00000100:00100000:1.0:1782759052.206909:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818112 00000100:00100000:2.0:1782759052.206931:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817984 00000100:00100000:2.0:1782759052.206946:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817984 00000100:00100000:1.0:1782759052.206946:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:1.0:1782759052.206960:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211817728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.206977:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:2.0:1782759052.206985:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211818240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759052.207043:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:3.0:1782759052.207052:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211818112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759052.208248:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211817728:12345-0@lo:400:kworker.0 Request processed in 1286us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759052.208261:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:1.0:1782759052.208328:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211817728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759052.209556:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211818112:12345-0@lo:400:kworker.0 Request processed in 2500us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759052.209569:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:3.0:1782759052.209619:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:3.0:1782759052.209633:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211817984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759052.209683:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211817984:12345-0@lo:400:kworker.0 Request processed in 56us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759052.209690:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00100000:2.0:1782759052.211798:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211818240:12345-0@lo:400:kworker.0 Request processed in 4803us (5322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759052.211815:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00080000:2.0:1782759052.211874:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759052.211880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759052.211883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759052.211901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759052.214256:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211818240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759052.215144:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211817984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.215230:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211818112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.215269:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817600 00000100:00100000:0.0:1782759052.215275:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817600 00000100:00100000:0.0:1782759052.215338:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:0.0:1782759052.215348:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211817600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.215446:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211817600:12345-0@lo:400:kworker.0 Request processed in 98us (8914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759052.215453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:1.0:1782759052.215540:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211817600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.218947:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211817856 00000100:00100000:0.0:1782759052.218963:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211817856 00000100:00100000:0.0:1782759052.219120:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1782759052.219147:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211817856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759052.219259:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211817856:12345-0@lo:400:kworker.0 Request processed in 126us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759052.219268:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00080000:0.0:1782759052.219302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759052.219372:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211817856:0@lo:400:kworker.0 10000000:01000000:2.0:1782759052.460730:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759052.460740:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759052.460746:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759052.460799:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.460812:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.460848:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759052.460880:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211818368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759052.460966:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759052.461024:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759052.461092:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818368 00000100:00100000:0.0:1782759052.461100:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818368 00000100:00100000:0.0:1782759052.461169:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:0.0:1782759052.461179:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211818368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759052.461197:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759052.461213:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc8b4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759052.461241:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759052.461253:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759052.461264:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782759052.461313:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211818368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759052.461320:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1782759052.462006:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211818368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759052.462028:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.462038:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759052.462058:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759052.462064:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.462071:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759052.557133:0:114645:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddd3b9150 20000000:00000080:2.0:1782759052.557157:0:114645:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfef400 uarg=0000000000000000 10000000:01000000:2.0:1782759052.558226:0:114645:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759052.558257:0:114645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.558279:0:114645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.558289:0:114645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.558336:0:114645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759052.558352:0:114645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 18 pid: 5793 timeout: 3220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759052.558544:0:114645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114645:1869355211818496:0@lo:104: 00000100:00100000:2.0:1782759052.558608:0:114645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759052.558665:0:114645:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759052.558761:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818496 00000100:00100000:3.0:1782759052.558770:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818496 00000100:00100000:3.0:1782759052.558846:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1782759052.558857:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114645:x1869355211818496:12345-0@lo:104: 00010000:00010000:3.0:1782759052.558872:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759052.558949:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759052.558957:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114645:x1869355211818496:12345-0@lo:104: Request processed in 102us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759052.558966:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1782759052.558992:0:114645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114645:1869355211818496:0@lo:104: 00010000:00010000:0.0:1782759052.559014:0:114645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559076:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759052.559086:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559095:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759052.559099:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559108:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759052.559115:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759052.559131:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759052.559171:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559178:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759052.559210:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559217:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc8b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559240:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759052.559243:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759052.559244:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759052.559287:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759052.559300:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211818624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759052.559333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759052.559421:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818624 00000100:00100000:1.0:1782759052.559426:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818624 00010000:00010000:1.0:1782759052.559457:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 3220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759052.559486:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1782759052.559494:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211818624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759052.559504:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759052.559508:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 3220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559518:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 3220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559531:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc8bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc8b4 expref: 19 pid: 5793 timeout: 3220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559544:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559552:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559566:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559578:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559585:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559592:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559596:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759052.559600:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559607:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559618:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759052.559628:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759052.559666:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211818624:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759052.559672:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1782759052.559704:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211818624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759052.559776:0:114645:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759052.559783:0:114645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759052.559789:0:114645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc8c2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759052.717683:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759052.717707:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211818752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759052.717783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759052.717865:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818752 00000100:00100000:0.0:1782759052.717874:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818752 00000100:00100000:0.0:1782759052.717920:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1782759052.717930:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211818752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759052.717967:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759052.718009:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211818752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759052.718016:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1782759052.718062:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211818752:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759052.915579:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759052.982541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759052.982581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759052.982619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759052.982648:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923648 00000100:00100000:3.0:1782759052.982660:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923648 00000100:00100000:3.0:1782759052.982719:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1729 00000100:00100000:3.0:1782759052.982729:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196923648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759052.982803:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196923648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759052.982815:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1729 00000100:00080000:3.0:1782759052.982855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759052.984171:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923520 00000100:00100000:1.0:1782759052.984181:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923520 00000100:00100000:1.0:1782759052.984253:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00100000:1.0:1782759052.984263:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+8:2362:x1869355196923520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759052.984331:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+8:2362:x1869355196923520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759052.984339:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00080000:3.0:1782759052.984432:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759052.984514:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923392 00000100:00100000:2.0:1782759052.984521:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923392 00000100:00100000:2.0:1782759052.984590:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1741 00000100:00100000:2.0:1782759052.984598:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196923392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759052.984626:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196923392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759052.984632:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1741 00000020:00000080:1.0:1782759053.300724:0:114694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf64cd760 20000000:00000080:1.0:1782759053.300740:0:114694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b70c00 uarg=0000000000000000 10000000:01000000:1.0:1782759053.301046:0:114694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759053.301069:0:114694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301086:0:114694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301097:0:114694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301104:0:114694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301121:0:114694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301128:0:114694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301133:0:114694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759053.301138:0:114694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301145:0:114694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301165:0:114694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301172:0:114694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.301180:0:114694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc8c9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759053.933630:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759053.951165:0:114742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0ff770c0 20000000:00000080:3.0:1782759053.951184:0:114742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312e400 uarg=0000000000000000 10000000:01000000:3.0:1782759053.951390:0:114742:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759053.951411:0:114742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951429:0:114742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951439:0:114742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951446:0:114742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951453:0:114742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951460:0:114742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951467:0:114742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759053.951471:0:114742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951479:0:114742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951496:0:114742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951503:0:114742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759053.951508:0:114742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dc8d0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759054.251880:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759054.251889:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759054.251894:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759054.251955:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.251968:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.251981:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759054.252013:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211818880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759054.252112:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759054.252177:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759054.252206:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211818880 00000100:00100000:2.0:1782759054.252215:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211818880 00000100:00100000:2.0:1782759054.252280:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:2.0:1782759054.252293:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211818880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759054.252311:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759054.252328:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc8d7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.252359:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.252371:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.252385:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695800, rc 0) 00000100:00100000:2.0:1782759054.252586:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211818880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759054.252593:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:3.0:1782759054.256237:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211818880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759054.256273:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759054.256287:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759054.256315:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759054.256321:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759054.256329:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759054.892640:0:114794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff108a4820 20000000:00000080:3.0:1782759054.892659:0:114794:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2b9e800 uarg=0000000000000000 10000000:01000000:2.0:1782759054.893295:0:114794:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759054.893316:0:114794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.893335:0:114794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.893344:0:114794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.893385:0:114794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.893465:0:114794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 18 pid: 5796 timeout: 3223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759054.893481:0:114794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114794:1869355211819008:0@lo:104: 00000100:00100000:2.0:1782759054.893538:0:114794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759054.893619:0:114794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759054.893670:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819008 00000100:00100000:1.0:1782759054.893678:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819008 00000100:00100000:1.0:1782759054.893770:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1782759054.893781:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114794:x1869355211819008:12345-0@lo:104: 00010000:00010000:1.0:1782759054.893795:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759054.893887:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759054.893894:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114794:x1869355211819008:12345-0@lo:104: Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759054.893902:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00010000:0.0:1782759054.893964:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759054.893971:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.893978:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759054.893982:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.893991:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759054.893998:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759054.894003:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759054.894034:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894040:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759054.894059:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894066:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694c00/0xdd99f5c4777dc8d7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894092:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759054.894094:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759054.894096:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759054.894215:0:114794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114794:1869355211819008:0@lo:104: 00010000:00010000:2.0:1782759054.894235:0:114794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759054.894393:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211819136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759054.894501:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759054.894604:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819136 00000100:00100000:0.0:1782759054.894609:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819136 00010000:00010000:0.0:1782759054.894630:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 3223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759054.894689:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1782759054.894696:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211819136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759054.894707:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759054.894712:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 3223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894722:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 3223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894734:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695800/0xdd99f5c4777dc8de lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc8d7 expref: 19 pid: 5796 timeout: 3223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894747:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894755:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894768:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894774:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894781:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894788:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894794:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759054.894799:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.894805:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.894996:0:114794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759054.895004:0:114794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.896199:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.896216:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777dc8e5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759054.896234:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759054.897197:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211819136:12345-0@lo:103:ldlm_bl.0 Request processed in 2495us (2689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759054.897208:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1782759054.898809:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211819136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759054.956989:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759055.281158:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759055.281191:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211819264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759055.281259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759055.281573:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819264 00000100:00100000:2.0:1782759055.281590:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819264 00000100:00100000:2.0:1782759055.281645:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1782759055.281656:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211819264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759055.281693:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759055.281742:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211819264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759055.281749:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:2.0:1782759055.281771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759055.281809:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211819264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759055.980214:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759056.568645:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759056.568653:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759056.568658:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759056.568708:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.568719:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.568731:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759056.568756:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211819392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759056.568848:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759056.568904:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819392 00000100:00100000:1.0:1782759056.568911:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819392 00000100:00100000:1.0:1782759056.568965:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782759056.568973:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211819392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759056.568989:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759056.569003:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc8ec expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.569026:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.569038:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.569058:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782759056.569092:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211819392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759056.569100:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782759056.569166:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759056.569187:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211819392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759056.569201:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.569210:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759056.569228:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759056.569233:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759056.569240:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.004174:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759057.102812:0:114941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff19ea84a0 20000000:00000080:0.0:1782759057.103004:0:114941:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba89000 uarg=0000000000000000 10000000:01000000:0.0:1782759057.103323:0:114941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759057.103348:0:114941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.103444:0:114941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.103453:0:114941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.103499:0:114941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.103516:0:114941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 18 pid: 5794 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759057.103534:0:114941:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114941:1869355211819520:0@lo:104: 00000100:00100000:0.0:1782759057.103613:0:114941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759057.103734:0:114941:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759057.104114:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759057.104130:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819520 00000100:00100000:2.0:1782759057.104138:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819520 00000100:00100000:2.0:1782759057.104234:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1782759057.104245:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114941:x1869355211819520:12345-0@lo:104: 00010000:00010000:2.0:1782759057.104259:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759057.104328:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759057.104335:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:114941:x1869355211819520:12345-0@lo:104: Request processed in 92us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759057.104342:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:1.0:1782759057.104512:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759057.104520:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104528:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759057.104532:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104542:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759057.104549:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759057.104556:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759057.104594:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104600:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759057.104621:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104627:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777dc8ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc8f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104644:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759057.104646:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759057.104648:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759057.104671:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211819648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759057.104705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759057.104748:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819648 00000100:00100000:1.0:1782759057.104752:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819648 00010000:00010000:1.0:1782759057.104775:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 19 pid: 5794 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759057.104799:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1782759057.104805:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211819648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759057.104815:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759057.104845:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 19 pid: 5794 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104856:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 19 pid: 5794 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104876:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104884:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104899:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104907:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104914:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104920:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104925:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759057.104930:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104936:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104945:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759057.104954:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759057.104982:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211819648:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759057.104989:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00010000:00010000:0.0:1782759057.105187:0:114941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dc8f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc8ec expref: 18 pid: 5794 timeout: 3225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759057.105198:0:114941:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:114941:1869355211819520:0@lo:104: 00010000:00010000:0.0:1782759057.105218:0:114941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.105227:0:114941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.105233:0:114941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759057.105240:0:114941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50000/0xdd99f5c4777dc8fa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759057.106613:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211819648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759057.329847:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820032:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.329925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759057.329987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759057.329993:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211819904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.330021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759057.330071:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820032 00000100:00100000:0.0:1782759057.330079:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820032 00000100:00100000:0.0:1782759057.330138:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1782759057.330148:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.330210:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820032:12345-0@lo:400:kworker.0 Request processed in 63us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759057.330218:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:2.0:1782759057.330223:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211820160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.330243:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819904 00000100:00100000:0.0:1782759057.330247:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819904 00000100:00100000:2.0:1782759057.330263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759057.330357:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759057.330363:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211819776:0@lo:400:kworker.0 00000100:00100000:2.0:1782759057.330386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759057.330401:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211820288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759057.330427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759057.330502:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820288 00000100:00100000:2.0:1782759057.330506:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820288 00000100:00100000:2.0:1782759057.330548:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:2.0:1782759057.330556:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211820288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759057.330595:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211820288:12345-0@lo:400:kworker.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759057.330602:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:2.0:1782759057.330643:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211820288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759057.331202:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820160 00000100:00100000:1.0:1782759057.331209:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820160 00000100:00100000:1.0:1782759057.331301:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211819776 00000100:00100000:0.0:1782759057.331813:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1782759057.331842:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211819904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.331896:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211819904:12345-0@lo:400:kworker.0 Request processed in 75us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759057.331904:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1782759057.331924:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1782759057.331931:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211820160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.331977:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211820160:12345-0@lo:400:kworker.0 Request processed in 46us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759057.331984:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00080000:0.0:1782759057.332017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759057.332022:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759057.332025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759057.332075:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211820160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.332106:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211819904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.332117:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759057.332200:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211819776 00000100:00100000:1.0:1782759057.332239:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:1.0:1782759057.332246:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211819776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759057.332300:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211819776:12345-0@lo:400:kworker.0 Request processed in 54us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759057.332306:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1782759057.332804:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211819776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759057.837112:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759057.837135:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759057.837202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759057.837476:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820416 00000100:00100000:1.0:1782759057.837485:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820416 00000100:00100000:1.0:1782759057.837540:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1782759057.837551:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759057.837587:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759057.837640:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759057.837648:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1782759057.838244:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820416:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1782759057.898744:0:114989:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff35768930 20000000:00000080:3.0:1782759057.898763:0:114989:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917183d96400 uarg=0000000000000000 10000000:01000000:3.0:1782759057.899329:0:114989:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759057.899356:0:114989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899373:0:114989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899382:0:114989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899389:0:114989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899395:0:114989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899403:0:114989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899409:0:114989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759057.899412:0:114989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899419:0:114989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899433:0:114989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899439:0:114989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759057.899450:0:114989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc901 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 114989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759058.028024:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759058.102429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759058.102480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759058.102557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759058.102588:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923776 00000100:00100000:1.0:1782759058.102597:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923776 00000100:00100000:1.0:1782759058.102650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1744 00000100:00100000:1.0:1782759058.102660:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196923776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759058.102735:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196923776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759058.102743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1744 00000100:00100000:1.0:1782759058.102785:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924032 00000100:00100000:1.0:1782759058.102789:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924032 00000100:00100000:1.0:1782759058.102893:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1732 00000100:00100000:1.0:1782759058.102900:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196924032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759058.102932:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2361:x1869355196924032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759058.102939:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1732 00000100:00080000:1.0:1782759058.103088:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759058.103198:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196923904 00000100:00100000:3.0:1782759058.103203:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196923904 00000100:00100000:3.0:1782759058.103251:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00100000:3.0:1782759058.103259:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+8:2361:x1869355196923904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759058.103342:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+8:2361:x1869355196923904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759058.103349:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00080000:1.0:1782759058.103457:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1782759058.412916:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759058.412926:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759058.412933:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759058.412981:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759058.412993:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759058.413003:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759058.413041:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211820544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759058.413109:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759058.413156:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171896433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759058.414212:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820544 00000100:00100000:0.0:1782759058.414221:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820544 00000100:00100000:0.0:1782759058.414282:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1782759058.414292:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211820544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759058.414384:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759058.414404:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc908 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759058.414434:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759058.414446:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759058.414455:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782759058.414530:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211820544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759058.414537:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:1.0:1782759058.414733:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211820544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759058.414750:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759058.414759:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759058.414778:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759058.414783:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759058.414790:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759059.052359:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759060.081384:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759060.405682:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759060.405769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759060.406343:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820672 00000100:00100000:0.0:1782759060.406354:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820672 00000100:00080000:3.0:1782759060.406437:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759060.406504:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1782759060.406514:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759060.406551:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759060.406727:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211820672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 213us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759060.406735:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1782759060.407493:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211820672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759061.101198:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759061.318544:0:115186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2c6175e0 20000000:00000080:0.0:1782759061.318562:0:115186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171c2046800 uarg=0000000000000000 00010000:00010000:0.0:1782759061.319112:0:115186:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759061.319187:0:115186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759061.319191:0:115186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759061.319202:0:115186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50800/0xdd99f5c4777dc898 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65175 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319224:0:115186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:0.0:1782759061.319226:0:115186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759061.319230:0:115186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3690800/0xdd99f5c4777dc867 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65167 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319257:0:115186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:0.0:1782759061.319259:0:115186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759061.319263:0:115186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dc84b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65160 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319276:0:115186:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 3 locks, left on hash table 0. 10000000:01000000:0.0:1782759061.319290:0:115186:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759061.319304:0:115186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319315:0:115186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319323:0:115186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319357:0:115186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.319369:0:115186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 18 pid: 5793 timeout: 3229 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759061.319383:0:115186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115186:1869355211820800:0@lo:104: 00000100:00100000:0.0:1782759061.319446:0:115186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759061.319569:0:115186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759061.319668:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820800 00000100:00100000:1.0:1782759061.319675:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820800 00000100:00100000:1.0:1782759061.319761:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1782759061.319770:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115186:x1869355211820800:12345-0@lo:104: 00010000:00010000:1.0:1782759061.319783:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759061.319878:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759061.319885:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115186:x1869355211820800:12345-0@lo:104: Request processed in 117us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759061.319893:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00010000:00010000:2.0:1782759061.319993:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782759061.319994:0:115186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115186:1869355211820800:0@lo:104: 00010000:00010000:2.0:1782759061.320000:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320013:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:0.0:1782759061.320015:0:115186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759061.320017:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320026:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759061.320033:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759061.320040:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759061.320074:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320085:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759061.320113:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320121:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777dc908 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc90f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320135:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759061.320137:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759061.320138:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759061.320138:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211820928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759061.320167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759061.320256:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211820928 00000100:00100000:2.0:1782759061.320260:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211820928 00010000:00010000:2.0:1782759061.320280:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 3229 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759061.320300:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1782759061.320307:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211820928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759061.320317:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759061.320322:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 3229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320332:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 3229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320346:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc90f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc908 expref: 19 pid: 5793 timeout: 3229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320358:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320369:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320382:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320388:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320395:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320401:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320407:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759061.320411:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320418:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320437:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759061.320445:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759061.320481:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211820928:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759061.320487:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1782759061.320514:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211820928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759061.320560:0:115186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.320567:0:115186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759061.320574:0:115186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dc916 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759062.124523:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759062.444679:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211821440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.444776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.444864:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782759062.444870:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211821056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.444904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.444925:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211821568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.444965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.444988:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211821184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.445026:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211821696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.445063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759062.445068:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211821312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.445115:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821440 00000100:00100000:1.0:1782759062.445124:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821440 00000100:00100000:1.0:1782759062.445176:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821696 00000100:00100000:1.0:1782759062.445179:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821696 00000100:00100000:1.0:1782759062.445202:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:1.0:1782759062.445212:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211821440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445409:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211821440:12345-0@lo:400:kworker.0 Request processed in 197us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445417:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:1.0:1782759062.445449:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1782759062.445455:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211821696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445491:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211821696:12345-0@lo:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445497:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1782759062.445519:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821056 00000100:00100000:1.0:1782759062.445522:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821056 00000100:00100000:1.0:1782759062.445545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:1.0:1782759062.445551:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211821056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445580:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211821056:12345-0@lo:400:kworker.0 Request processed in 29us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:1.0:1782759062.445617:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821568 00000100:00100000:1.0:1782759062.445621:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821568 00000100:00100000:1.0:1782759062.445652:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821184 00000100:00100000:1.0:1782759062.445655:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821184 00000100:00100000:1.0:1782759062.445671:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821312 00000100:00100000:1.0:1782759062.445674:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821312 00000100:00100000:1.0:1782759062.445690:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1782759062.445695:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211821568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445725:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211821568:12345-0@lo:400:kworker.0 Request processed in 30us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445731:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1782759062.445745:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:1.0:1782759062.445751:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211821184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445777:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211821184:12345-0@lo:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445782:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:1.0:1782759062.445793:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:1.0:1782759062.445798:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211821312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445849:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211821312:12345-0@lo:400:kworker.0 Request processed in 49us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.445858:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00080000:1.0:1782759062.445876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759062.445881:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759062.445883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759062.445921:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211821312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445943:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211821184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445953:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211821696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.445991:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211821056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.446001:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211821568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759062.446009:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211821440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759062.958227:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759062.958251:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211821824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759062.958324:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759062.958881:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821824 00000100:00100000:1.0:1782759062.958889:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821824 00000100:00100000:1.0:1782759062.958948:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1782759062.958957:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211821824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759062.958990:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759062.959035:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211821824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759062.959042:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1782759062.960585:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211821824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759063.150436:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759063.221603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759063.221649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759063.221853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924160 00000100:00100000:1.0:1782759063.221858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759063.221863:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924160 00000100:00100000:0.0:1782759063.221923:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1747 00000100:00100000:0.0:1782759063.221933:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196924160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759063.222007:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2364:x1869355196924160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759063.222015:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1747 00000100:00100000:2.0:1782759063.222094:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924288 00000100:00100000:2.0:1782759063.222108:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924288 00000100:00100000:2.0:1782759063.222159:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00100000:2.0:1782759063.222166:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196924288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759063.222201:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196924288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759063.222207:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00080000:0.0:1782759063.222275:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759063.224994:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924416 00000100:00100000:3.0:1782759063.225009:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924416 00000100:00080000:0.0:1782759063.225082:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759063.225088:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1735 00000100:00100000:3.0:1782759063.225097:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196924416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759063.225177:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2364:x1869355196924416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759063.225185:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1735 10000000:01000000:0.0:1782759063.275942:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759063.275951:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759063.275956:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759063.276013:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759063.276026:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759063.276053:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759063.276080:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211821952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759063.276152:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759063.276229:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759063.276389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211821952 00000100:00100000:1.0:1782759063.276399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211821952 00000100:00100000:1.0:1782759063.276460:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:1.0:1782759063.276470:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211821952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759063.276486:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759063.276501:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc91d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759063.276526:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759063.276537:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759063.276545:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759063.276592:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211821952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759063.276599:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1782759063.277460:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211821952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759063.277481:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759063.277492:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759063.277512:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759063.277518:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759063.277526:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.173554:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759064.368141:0:115381:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc84a253f0 20000000:00000080:1.0:1782759064.368160:0:115381:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e5400 uarg=0000000000000000 00010000:00010000:1.0:1782759064.369291:0:115381:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759064.369310:0:115381:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759064.369328:0:115381:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759064.369351:0:115381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.369465:0:115381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.369474:0:115381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.369513:0:115381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.369526:0:115381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 18 pid: 5796 timeout: 3232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759064.369541:0:115381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115381:1869355211822080:0@lo:104: 00000100:00100000:1.0:1782759064.369614:0:115381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759064.369668:0:115381:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759064.370337:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822080 00000100:00100000:2.0:1782759064.370345:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822080 00000100:00100000:2.0:1782759064.370453:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1782759064.370462:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115381:x1869355211822080:12345-0@lo:104: 00010000:00010000:2.0:1782759064.370476:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759064.370760:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759064.370767:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115381:x1869355211822080:12345-0@lo:104: Request processed in 306us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759064.370775:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00010000:00010000:0.0:1782759064.370882:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759064.370901:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.370910:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759064.370914:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.370924:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759064.370932:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759064.370944:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759064.370974:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.370981:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759064.371010:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371018:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc91d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc924 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371034:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759064.371036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759064.371037:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759064.371049:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759064.371060:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211822208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759064.371097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759064.371141:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822208 00000100:00100000:0.0:1782759064.371146:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822208 00010000:00010000:0.0:1782759064.371167:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 19 pid: 5796 timeout: 3232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759064.371190:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1782759064.371196:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211822208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759064.371281:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759064.371288:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 19 pid: 5796 timeout: 3232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371304:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 19 pid: 5796 timeout: 3232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371322:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371330:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371344:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371351:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371358:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371364:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371369:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759064.371373:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371379:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371387:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759064.371401:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759064.371432:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211822208:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759064.371439:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1782759064.371475:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211822208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759064.371777:0:115381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc924 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc91d expref: 18 pid: 5796 timeout: 3232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759064.371788:0:115381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115381:1869355211822080:0@lo:104: 00010000:00010000:1.0:1782759064.371803:0:115381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.371811:0:115381:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.371817:0:115381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759064.371887:0:115381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc92b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759065.197316:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759065.516274:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759065.516300:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211822336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759065.517213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759065.517555:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822336 00000100:00100000:1.0:1782759065.517563:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822336 00000100:00100000:1.0:1782759065.517626:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1782759065.517634:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211822336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759065.517673:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759065.517724:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211822336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759065.517731:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00080000:0.0:1782759065.517796:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759065.518212:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211822336:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782759065.709053:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759065.709062:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759065.709067:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759065.709119:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759065.709130:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759065.709141:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759065.709168:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211822464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759065.709237:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759065.709296:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759065.709384:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822464 00000100:00100000:3.0:1782759065.709394:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822464 00000100:00100000:3.0:1782759065.709453:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1782759065.709465:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211822464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759065.709478:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759065.709491:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc932 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759065.709514:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759065.709524:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759065.709533:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691c00, rc 0) 00000100:00100000:3.0:1782759065.709571:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211822464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759065.709579:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:2.0:1782759065.709607:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211822464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759065.709622:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759065.709631:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759065.709650:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759065.709656:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759065.709662:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759066.220710:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759066.857709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759066.857746:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924544 00000100:00100000:3.0:1782759066.857756:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924544 00000100:00100000:3.0:1782759066.857852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1305 00000100:00100000:3.0:1782759066.857864:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:72858:x1869355196924544:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1782759066.857952:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:72858:x1869355196924544:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 90us (252us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759066.857960:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1305 00000100:00080000:0.0:1782759066.859096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759066.926764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759066.926931:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924672 00000100:00100000:0.0:1782759066.926941:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924672 00000100:00100000:0.0:1782759066.927020:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1306 00000100:00100000:0.0:1782759066.927031:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:72865:x1869355196924672:12345-192.168.204.31@tcp:46:lfs.0 00000100:00100000:0.0:1782759066.927133:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:72865:x1869355196924672:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 103us (379us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759066.927141:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1306 00010000:00010000:1.0:1782759067.249659:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759067.535146:0:115578:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa87ba6a0 20000000:00000080:1.0:1782759067.535163:0:115578:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e5400 uarg=0000000000000000 00010000:00010000:1.0:1782759067.538230:0:115578:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759067.538251:0:115578:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759067.538294:0:115578:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759067.538312:0:115578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.538328:0:115578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.538336:0:115578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.538371:0:115578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.538385:0:115578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 18 pid: 5793 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759067.538399:0:115578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115578:1869355211822592:0@lo:104: 00000100:00100000:1.0:1782759067.538529:0:115578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759067.538644:0:115578:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759067.538690:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822592 00000100:00100000:2.0:1782759067.538698:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822592 00000100:00100000:2.0:1782759067.538795:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1782759067.538807:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115578:x1869355211822592:12345-0@lo:104: 00010000:00010000:2.0:1782759067.538852:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.538915:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759067.538921:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115578:x1869355211822592:12345-0@lo:104: Request processed in 117us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.538929:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00010000:00010000:0.0:1782759067.538986:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759067.538994:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759067.539012:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759067.539016:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759067.539027:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759067.539040:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759067.539047:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759067.539078:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759067.539085:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759067.539104:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759067.539111:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695600/0xdd99f5c4777dc932 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc939 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759067.539125:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759067.539128:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759067.539129:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759067.539140:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211822720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759067.539172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759067.539292:0:115578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115578:1869355211822592:0@lo:104: 00010000:00010000:1.0:1782759067.539310:0:115578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759067.539599:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822720 00000100:00100000:2.0:1782759067.539604:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822720 00010000:00010000:2.0:1782759067.539624:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759067.539690:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1782759067.539697:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211822720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759067.539709:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759067.539714:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539724:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539738:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691c00/0xdd99f5c4777dc939 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc932 expref: 19 pid: 5793 timeout: 3235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539751:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539760:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539773:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539780:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539791:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539798:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539803:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759067.539807:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539815:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539862:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759067.539872:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759067.539909:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211822720:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.539915:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00010000:1.0:1782759067.540109:0:115578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.540118:0:115578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759067.540125:0:115578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dc940 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759067.541036:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211822720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759067.565308:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211823104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759067.565416:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759067.565423:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211822976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759067.565473:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823104 00000100:00100000:2.0:1782759067.565481:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823104 00000100:00100000:2.0:1782759067.565531:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1782759067.565541:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211823104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565592:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211823104:12345-0@lo:400:kworker.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.565599:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1782759067.565621:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822976 00000100:00100000:2.0:1782759067.565625:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822976 00000100:00100000:2.0:1782759067.565649:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00100000:2.0:1782759067.565655:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211822976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565683:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211822976:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.565690:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00100000:2.0:1782759067.565724:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211822976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565734:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211823104:0@lo:400:kworker.0 00000100:00080000:2.0:1782759067.565784:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759067.565790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759067.565799:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211823232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759067.565869:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759067.565875:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211822848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759067.565924:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211823360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.565945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759067.565973:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823232 00000100:00100000:2.0:1782759067.565976:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823232 00000100:00100000:2.0:1782759067.566002:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211822848 00000100:00100000:2.0:1782759067.566005:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211822848 00000100:00100000:3.0:1782759067.566006:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:3.0:1782759067.566014:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211823232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.566019:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1782759067.566023:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211822848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759067.566054:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211823232:12345-0@lo:400:kworker.0 Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759067.566065:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:2.0:1782759067.566414:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211822848:12345-0@lo:400:kworker.0 Request processed in 389us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.566421:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1782759067.566440:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823360 00000100:00100000:2.0:1782759067.566444:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823360 00000100:00100000:2.0:1782759067.566477:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1782759067.566483:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211823360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.566517:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211823360:12345-0@lo:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759067.566523:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00080000:2.0:1782759067.566542:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759067.566544:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759067.566572:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211822848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.566582:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211823360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759067.566591:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211823232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759068.078618:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211823488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759068.078710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759068.081402:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823488 00000100:00100000:0.0:1782759068.081416:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823488 00000100:00100000:0.0:1782759068.081484:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1782759068.081570:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211823488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759068.081612:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759068.081702:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211823488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759068.081713:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1782759068.082007:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211823488:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759068.209483:0:115627:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2f27dca0 20000000:00000080:2.0:1782759068.209501:0:115627:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc1800 uarg=0000000000000000 00010000:00010000:2.0:1782759068.209749:0:115627:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759068.209764:0:115627:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759068.209782:0:115627:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759068.209802:0:115627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210010:0:115627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210022:0:115627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210029:0:115627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210037:0:115627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210044:0:115627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210050:0:115627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759068.210055:0:115627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210063:0:115627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210077:0:115627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210085:0:115627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.210091:0:115627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777dc947 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759068.271255:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759068.348247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759068.348290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759068.348322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759068.348355:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925056 00000100:00100000:2.0:1782759068.348364:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925056 00000100:00100000:2.0:1782759068.348427:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1738 00000100:00100000:2.0:1782759068.348437:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196925056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759068.348507:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196925056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759068.348515:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1738 00000100:00080000:2.0:1782759068.348536:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759068.348626:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924800 00000100:00100000:3.0:1782759068.348631:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924800 00000100:00100000:3.0:1782759068.348659:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1750 00000100:00100000:3.0:1782759068.348665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196924800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759068.348692:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2363:x1869355196924800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759068.348699:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1750 00000100:00100000:3.0:1782759068.348725:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196924928 00000100:00100000:3.0:1782759068.348728:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196924928 00000100:00100000:3.0:1782759068.348760:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2258 00000100:00100000:3.0:1782759068.348767:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196924928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759068.349431:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:2363:x1869355196924928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 660us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759068.349440:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2258 00000100:00080000:3.0:1782759068.349490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1782759068.908979:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759068.908992:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759068.908999:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759068.909075:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759068.909092:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759068.909106:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759068.909142:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211823616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759068.909237:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759068.909302:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759068.909679:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823616 00000100:00100000:1.0:1782759068.909691:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823616 00000100:00100000:1.0:1782759068.909769:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1782759068.909783:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211823616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759068.909815:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759068.909857:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc94e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759068.909890:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759068.909904:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759068.909914:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759068.909969:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211823616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759068.909978:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:3.0:1782759068.910099:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211823616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759068.910118:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759068.910128:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759068.910154:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759068.910160:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759068.910168:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759068.951097:0:115675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdd2457b0 20000000:00000080:2.0:1782759068.951120:0:115675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc0c00 uarg=0000000000000000 00010000:00010000:2.0:1782759068.951430:0:115675:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759068.951448:0:115675:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759068.951471:0:115675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759068.951494:0:115675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.951514:0:115675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.951522:0:115675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.951572:0:115675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.951589:0:115675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 18 pid: 5793 timeout: 3237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759068.951609:0:115675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115675:1869355211823744:0@lo:104: 00000100:00100000:2.0:1782759068.951758:0:115675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759068.952055:0:115675:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759068.952155:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823744 00000100:00100000:1.0:1782759068.952166:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823744 00000100:00100000:1.0:1782759068.952267:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1782759068.952279:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115675:x1869355211823744:12345-0@lo:104: 00010000:00010000:1.0:1782759068.952297:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759068.952377:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759068.952383:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115675:x1869355211823744:12345-0@lo:104: Request processed in 107us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759068.952392:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:0.0:1782759068.952450:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759068.952459:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952467:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759068.952472:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952482:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759068.952490:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759068.952496:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759068.952535:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952543:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759068.952569:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952576:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691a00/0xdd99f5c4777dc94e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc955 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952595:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759068.952597:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759068.952599:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759068.952622:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211823872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759068.952665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759068.952719:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211823872 00000100:00100000:0.0:1782759068.952724:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211823872 00010000:00010000:0.0:1782759068.952746:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 19 pid: 5793 timeout: 3237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759068.952768:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1782759068.952775:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9383c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211823872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759068.952787:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759068.952793:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 19 pid: 5793 timeout: 3237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952814:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 19 pid: 5793 timeout: 3237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952854:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952865:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952881:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952890:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952898:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952905:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952912:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759068.952917:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952925:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952934:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759068.952946:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759068.952974:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9383c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211823872:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759068.952990:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1782759068.953073:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211823872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759068.953181:0:115675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dc955 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc94e expref: 18 pid: 5793 timeout: 3237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759068.953193:0:115675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115675:1869355211823744:0@lo:104: 00010000:00010000:2.0:1782759068.953206:0:115675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.953216:0:115675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.953221:0:115675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759068.953227:0:115675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777dc95c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759069.296431:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759070.317083:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759070.636743:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211824000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759070.636858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759070.636980:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824000 00000100:00100000:3.0:1782759070.636989:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824000 00000100:00080000:0.0:1782759070.638057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759070.638166:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1782759070.638180:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211824000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759070.638222:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759070.638295:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211824000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759070.638303:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1782759070.638415:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211824000:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759070.701271:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759070.701280:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759070.701285:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759070.701335:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759070.701349:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759070.701359:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759070.701390:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211824128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759070.701464:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759070.701569:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759070.704003:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824128 00000100:00100000:0.0:1782759070.704016:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824128 00000100:00100000:0.0:1782759070.704072:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1782759070.704959:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211824128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759070.704981:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759070.705002:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc963 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759070.705030:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759070.705041:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759070.705049:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782759070.705320:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211824128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1238us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759070.705329:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1782759070.705420:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211824128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759070.705439:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759070.705447:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759070.705470:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759070.705476:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759070.705483:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759071.341332:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759071.995812:0:115872:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa31e2c90 20000000:00000080:2.0:1782759071.995855:0:115872:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd8800 uarg=0000000000000000 00010000:00010000:2.0:1782759071.996315:0:115872:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759071.996331:0:115872:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189070000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759071.996351:0:115872:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759071.996373:0:115872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759071.996392:0:115872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759071.996408:0:115872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759071.996446:0:115872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759071.996461:0:115872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 18 pid: 5794 timeout: 3240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759071.996476:0:115872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115872:1869355211824256:0@lo:104: 00000100:00100000:2.0:1782759071.996543:0:115872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759071.996598:0:115872:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189651780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759072.000048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824256 00000100:00100000:1.0:1782759072.000067:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824256 00000100:00100000:1.0:1782759072.000157:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1782759072.000170:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115872:x1869355211824256:12345-0@lo:104: 00010000:00010000:1.0:1782759072.000195:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759072.000328:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759072.000337:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:115872:x1869355211824256:12345-0@lo:104: Request processed in 171us (3793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759072.000345:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1782759072.000593:0:115872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:115872:1869355211824256:0@lo:104: 00010000:00010000:2.0:1782759072.000627:0:115872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.001370:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759072.001379:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.001735:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3690c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759072.001753:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.001767:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759072.001774:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759072.001779:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759072.002098:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.002106:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759072.002144:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.002152:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3690c00/0xdd99f5c4777dc963 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc96a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.002170:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759072.002172:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759072.002177:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759072.002305:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211824384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759072.002372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759072.002544:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824384 00000100:00100000:3.0:1782759072.002553:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824384 00010000:00010000:3.0:1782759072.002589:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 3240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759072.002626:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1782759072.002636:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211824384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759072.002652:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759072.002657:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 3240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002669:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 3240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002684:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dc96a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc963 expref: 19 pid: 5794 timeout: 3240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002700:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002709:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002725:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002733:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002740:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002755:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002761:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759072.002766:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002778:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002797:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.002808:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759072.002888:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211824384:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759072.002896:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1782759072.002943:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211824384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759072.002974:0:115872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.002986:0:115872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759072.002994:0:115872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dc971 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 115872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759072.376991:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759072.685302:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211824640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759072.685321:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211824896:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.685456:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211824512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759072.686992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759072.686992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759072.687308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759072.687361:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211824768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.687401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759072.687434:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824512 00000100:00100000:1.0:1782759072.687443:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824512 00000100:00100000:2.0:1782759072.687477:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211825152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.687489:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:1.0:1782759072.687498:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211824512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759072.687504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759072.687543:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211824512:12345-0@lo:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759072.687551:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1782759072.687602:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824640 00000100:00100000:2.0:1782759072.687607:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824640 00000100:00100000:2.0:1782759072.687637:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824768 00000100:00100000:2.0:1782759072.687640:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824768 00000100:00100000:2.0:1782759072.687669:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:2.0:1782759072.687676:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759072.687719:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211824640:12345-0@lo:400:kworker.0 Request processed in 44us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759072.687727:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:1.0:1782759072.687997:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211824896 00000100:00100000:1.0:1782759072.688002:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211824896 00000100:00100000:1.0:1782759072.688036:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825152 00000100:00100000:1.0:1782759072.688039:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825152 00000100:00100000:1.0:1782759072.688061:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:1.0:1782759072.688067:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211824896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.688105:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211824896:12345-0@lo:400:kworker.0 Request processed in 38us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759072.688110:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:1.0:1782759072.688124:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:1.0:1782759072.688130:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211825152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.688156:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211825152:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759072.688161:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:1.0:1782759072.688445:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1782759072.688454:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211824768:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759072.688461:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759072.688464:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759072.688509:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211824768:12345-0@lo:400:kworker.0 Request processed in 56us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759072.688515:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1782759072.688571:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211824512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.688582:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211825024:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.688610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759072.688758:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211824768:0@lo:400:kworker.0 00000100:00080000:2.0:1782759072.688808:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759072.688900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825024 00000100:00100000:2.0:1782759072.688905:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825024 00000100:00100000:2.0:1782759072.688937:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:2.0:1782759072.688943:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211825024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759072.688977:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211825024:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759072.688983:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00080000:2.0:1782759072.689002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759072.689022:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211825152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.689195:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211825024:0@lo:400:kworker.0 00000100:00100000:1.0:1782759072.689230:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211824896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759072.689371:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211824640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759073.198164:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759073.198258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759073.198968:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825280 00000100:00100000:0.0:1782759073.198979:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825280 00000100:00100000:0.0:1782759073.199055:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1782759073.199068:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211825280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759073.199114:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759073.199177:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211825280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759073.199184:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1782759073.199516:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211825280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759073.388943:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759073.463179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759073.463222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759073.463262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759073.463295:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925440 00000100:00100000:3.0:1782759073.463305:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925440 00000100:00100000:3.0:1782759073.463360:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 718 00000100:00100000:3.0:1782759073.463370:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+5:2360:x1869355196925440:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782759073.463398:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc89f 00000100:00080000:3.0:1782759073.463406:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9171b785b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759073.463440:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967376 00000100:00100000:3.0:1782759073.463726:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b63da415-9fe7-432d-aaab-047a80aa0861+2:2360:x1869355196925440:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 343us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759073.463736:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 718 00000100:00080000:3.0:1782759073.463757:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759073.463770:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759073.463986:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925184 00000100:00100000:1.0:1782759073.463992:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925184 00000100:00100000:1.0:1782759073.464025:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1754 00000100:00100000:1.0:1782759073.464034:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196925184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759073.464074:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2362:x1869355196925184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759073.464080:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1754 00000100:00100000:2.0:1782759073.464248:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925312 00000100:00100000:2.0:1782759073.464253:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925312 00000100:00100000:2.0:1782759073.464468:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00100000:2.0:1782759073.464477:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196925312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759073.464520:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b63da415-9fe7-432d-aaab-047a80aa0861+5:2362:x1869355196925312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759073.464527:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00080000:3.0:1782759073.465813:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1782759073.644290:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759073.644300:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759073.644306:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759073.644362:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759073.644376:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759073.644390:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759073.644424:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211825408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759073.644504:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759073.644581:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186067840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759073.644666:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825408 00000100:00100000:1.0:1782759073.644673:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825408 00000100:00100000:1.0:1782759073.644740:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1782759073.644751:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211825408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759073.644765:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759073.644781:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dc978 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759073.644817:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759073.644848:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759073.644858:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759073.644897:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211825408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759073.644905:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:0.0:1782759073.645938:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211825408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759073.645961:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759073.645979:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759073.646002:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759073.646008:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759073.646017:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759074.412284:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782759074.801035:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:0.0:1782759074.801044:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171861f5800/b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:1.0:1782759074.801312:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff9171861f5800/b63da415-9fe7-432d-aaab-047a80aa0861 for lustre-OST0000 00000020:00000080:1.0:1782759074.801366:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b785b000 for lustre-OST0000 00000040:00080000:3.0:1782759074.820751:0:116070:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759074.820758:0:116070:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759074.820794:0:116070:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782759074.820800:0:116070:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1782759074.875350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759074.875386:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925568 00000100:00100000:3.0:1782759074.875394:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925568 00000100:00100000:3.0:1782759074.875441:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1307 00000100:00100000:3.0:1782759074.875449:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:73043:x1869355196925568:12345-192.168.204.31@tcp:46:lfs.0 00000004:00000080:3.0:1782759074.875483:0:5803:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff917198165660 uarg=0000000000000000 00000004:00000080:3.0:1782759074.875519:0:5803:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff917198165660 00000004:00000080:3.0:1782759074.875525:0:5803:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1782759074.875603:0:5803:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759074.875608:0:5803:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759074.875641:0:5803:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 4 00000040:00080000:3.0:1782759074.875752:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782759074.875758:0:5803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759074.875763:0:5803:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1782759074.875794:0:5803:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759074.875796:0:5803:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759074.876555:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759074.876564:0:5803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1782759074.876695:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b63da415-9fe7-432d-aaab-047a80aa0861+5:73043:x1869355196925568:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 1233us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759074.876706:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1307 00010000:00010000:2.0:1782759075.436010:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759075.484120:0:116119:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffc6dd62050 00000004:00000080:3.0:1782759075.484140:0:116119:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9171bbfec800 uarg=0000000000000000 00000004:00000080:3.0:1782759075.484186:0:116119:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9171bbfec800 00000004:00000080:3.0:1782759075.484193:0:116119:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1782759075.484309:0:116119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759075.484314:0:116119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759075.484501:0:116119:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 4 00000040:00080000:3.0:1782759075.484614:0:116119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782759075.484621:0:116119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759075.484659:0:116119:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1782759075.484857:0:116119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759075.484912:0:116119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759075.485529:0:116119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759075.485538:0:116119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1782759075.485564:0:116119:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:3.0:1782759075.485621:0:116119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759075.485624:0:116119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759075.486743:0:116119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1782759075.486753:0:116119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759075.486783:0:116119:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1782759075.486785:0:116119:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1782759075.491748:0:116119:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:3.0:1782759075.491922:0:116119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759075.491927:0:116119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759075.493189:0:116119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759075.493200:0:116119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:3.0:1782759075.493305:0:116119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759075.493309:0:116119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759075.494280:0:116119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1782759075.494290:0:116119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1782759075.756275:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759075.756301:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211825536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759075.756372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759075.756639:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825536 00000100:00100000:2.0:1782759075.756647:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825536 00000100:00100000:2.0:1782759075.756716:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1782759075.756727:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211825536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759075.756761:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759075.756814:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211825536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759075.756846:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:2.0:1782759075.756866:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759075.757211:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211825536:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1782759076.095239:0:116167:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759076.095251:0:116167:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1782759076.096061:0:116167:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1782759076.096073:0:116167:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1782759076.460070:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759077.216242:0:116215:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 36: control if clients can use encryption ========================================================== 14:51:15 (1782759075) 00010000:00010000:3.0:1782759077.484064:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759077.804285:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211825920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804296:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211825664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759077.804475:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211826176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759077.804526:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782759077.804532:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211825792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759077.804567:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211826304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759077.804620:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826304 00000100:00100000:1.0:1782759077.804637:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826304 00000100:00100000:1.0:1782759077.804689:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:1.0:1782759077.804698:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211826304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804750:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211826304:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759077.804762:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:0.0:1782759077.804777:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825664 00000100:00100000:0.0:1782759077.804782:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825664 00000100:00100000:2.0:1782759077.804800:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759077.804814:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1782759077.804932:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211825664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759077.804972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211825664:12345-0@lo:400:kworker.0 Request processed in 151us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759077.804988:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211826304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.804997:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211825664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.805033:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826176 00000100:00100000:1.0:1782759077.805037:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826176 00000100:00100000:1.0:1782759077.805064:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825792 00000100:00100000:1.0:1782759077.805068:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825792 00000100:00100000:0.0:1782759077.805091:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1782759077.805094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759077.805094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759077.805095:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:1.0:1782759077.805105:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211826176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759077.805139:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211825920 00000100:00100000:0.0:1782759077.805143:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211825920 00000100:00100000:3.0:1782759077.805147:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:1.0:1782759077.805151:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211826176:12345-0@lo:400:kworker.0 Request processed in 45us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759077.805163:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1782759077.805164:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759077.805178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1782759077.805186:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211825920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.805206:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211826176:0@lo:400:kworker.0 00000100:00100000:3.0:1782759077.805212:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211825792:12345-0@lo:400:kworker.0 Request processed in 55us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759077.805221:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:1.0:1782759077.805225:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211825792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759077.805230:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211825920:12345-0@lo:400:kworker.0 Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759077.805236:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1782759077.805251:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826048 00000100:00100000:1.0:1782759077.805255:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826048 00000100:00080000:0.0:1782759077.805260:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759077.805264:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759077.805265:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759077.805277:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1782759077.805283:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759077.805321:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826048:12345-0@lo:400:kworker.0 Request processed in 38us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759077.805327:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1782759077.805341:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759077.805896:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211825920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759078.316667:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759078.316694:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759078.316773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759078.317390:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826432 00000100:00100000:1.0:1782759078.317401:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826432 00000100:00100000:1.0:1782759078.317447:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1782759078.317455:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759078.317509:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759078.317565:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.317571:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1782759078.318069:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759078.457097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.457136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.457160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.457200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.457232:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196926464 00000100:00100000:2.0:1782759078.457243:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196926464 00000100:00100000:2.0:1782759078.457301:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1308 00000100:00100000:2.0:1782759078.457311:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+5:2360:x1869355196926464:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:2.0:1782759078.457343:0:19544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc7bf 00000100:00080000:2.0:1782759078.457353:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917189077000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759078.457373:0:19544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967794 00000100:00100000:1.0:1782759078.457670:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925696 00000100:00100000:1.0:1782759078.457674:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925696 00000100:00100000:0.0:1782759078.457678:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925952 00000100:00100000:0.0:1782759078.457681:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925952 00000100:00100000:1.0:1782759078.457721:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196925824 00000100:00100000:1.0:1782759078.457725:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196925824 00000100:00100000:3.0:1782759078.457781:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:3.0:1782759078.457791:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bbbe59-e3a8-42af-8a26-956092d71e33+12:2361:x1869355196925696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759078.457803:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759078.457854:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50a00/0xdd99f5c4777dc7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650fe expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759078.457871:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759078.457933:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bbbe59-e3a8-42af-8a26-956092d71e33+11:2361:x1869355196925696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 143us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759078.457951:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1782759078.458228:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b63da415-9fe7-432d-aaab-047a80aa0861+3:2360:x1869355196926464:12345-192.168.204.31@tcp:39:umount.0 Request processed in 918us (1026us total) trans 4294967795 rc 0/0 00000100:00100000:2.0:1782759078.458236:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1308 00010000:00010000:2.0:1782759078.458256:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782759078.458266:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759078.460087:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1782759078.460107:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bbbe59-e3a8-42af-8a26-956092d71e33+11:2361:x1869355196925952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759078.460124:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759078.460142:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694000/0xdd99f5c4777dc7b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6512f expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.460157:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759078.460209:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bbbe59-e3a8-42af-8a26-956092d71e33+10:2361:x1869355196925952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.460218:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:1.0:1782759078.461752:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:1.0:1782759078.461771:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bbbe59-e3a8-42af-8a26-956092d71e33+9:2361:x1869355196925824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759078.461789:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759078.461808:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51000/0xdd99f5c4777dc7b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65128 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.461840:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759078.461893:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bbbe59-e3a8-42af-8a26-956092d71e33+8:2361:x1869355196925824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (4732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.461901:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1782759078.476759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.476877:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196926720 00000100:00100000:0.0:1782759078.476891:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196926720 00000100:00100000:0.0:1782759078.476958:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1757 00000100:00100000:0.0:1782759078.476968:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+7:2360:x1869355196926720:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1782759078.477014:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc79c 00000020:00010000:0.0:1782759078.477021:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917081afe000: total 0 00000100:00080000:0.0:1782759078.477025:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917081afc000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1782759078.477091:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917081afe000: total 0 00010000:00010000:3.0:1782759078.477096:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759078.477108:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bbbe59-e3a8-42af-8a26-956092d71e33+3:2360:x1869355196926720:12345-192.168.204.31@tcp:251:umount.0 Request processed in 141us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.477116:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1757 00010000:00010000:3.0:1782759078.477147:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917081afe000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759078.477181:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dc7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf650f7 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759078.477197:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917081afe000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782759078.477208:0:7496:0:(genops.c:906:class_export_put()) final put ffff917081afe000/72bbbe59-e3a8-42af-8a26-956092d71e33 00010000:00010000:3.0:1782759078.477227:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759078.477229:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759078.477231:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759078.477362:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917081afe000/72bbbe59-e3a8-42af-8a26-956092d71e33 for MGS 00000020:00000080:0.0:1782759078.477400:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081afc000 for MGS 00010000:00010000:3.0:1782759078.508093:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759078.642207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.642326:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196926848 00000100:00100000:0.0:1782759078.642336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196926848 00000100:00100000:0.0:1782759078.642385:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1758 00000100:00100000:0.0:1782759078.642394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355196926848:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759078.642427:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fd4d7964-faf5-4b62-bb51-ca396492625e@192.168.204.31@tcp t0 exp 0000000000000000 cur 3147 last 0 00000020:00000080:0.0:1782759078.642460:0:5796:0:(genops.c:1406:class_connect()) connect: client fd4d7964-faf5-4b62-bb51-ca396492625e, cookie 0xdd99f5c4777dc986 00000100:00080000:0.0:1782759078.642509:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917182e3c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759078.642590:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+5:2360:x1869355196926848:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 194us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.642598:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1758 00000100:00100000:2.0:1782759078.649770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.649904:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196926976 00000100:00100000:1.0:1782759078.649917:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196926976 00000100:00100000:1.0:1782759078.650038:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1759 00000100:00100000:1.0:1782759078.650051:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+5:73251:x1869355196926976:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759078.650072:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759078.650094:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc98d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6518a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.650136:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6518a expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.650149:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6518a expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.650160:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759078.650227:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+6:73251:x1869355196926976:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.650236:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1759 00000100:00100000:2.0:1782759078.656073:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.657075:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927104 00000100:00100000:1.0:1782759078.657088:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927104 00000100:00100000:1.0:1782759078.657165:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1760 00000100:00100000:1.0:1782759078.657177:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+6:73251:x1869355196927104:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759078.657513:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+6:73251:x1869355196927104:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 338us (1450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759078.657523:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1760 00000100:00100000:2.0:1782759078.662493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.662595:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927232 00000100:00100000:1.0:1782759078.662606:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927232 00000100:00100000:1.0:1782759078.662681:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1761 00000100:00100000:1.0:1782759078.662692:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+6:73251:x1869355196927232:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759078.662713:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759078.662732:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65191 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.662761:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65191 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.662787:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65191 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.662797:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782759078.663047:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+7:73251:x1869355196927232:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 355us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.663055:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1761 00000100:00100000:2.0:1782759078.676383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.677535:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927360 00000100:00100000:1.0:1782759078.677550:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927360 00000100:00100000:1.0:1782759078.678209:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1762 00000100:00100000:1.0:1782759078.678225:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+7:73251:x1869355196927360:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759078.678705:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73251:x1869355196927360:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 475us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.678714:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1762 00000100:00100000:2.0:1782759078.683187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.683293:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927488 00000100:00100000:1.0:1782759078.683303:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927488 00000100:00100000:1.0:1782759078.683360:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1763 00000100:00100000:1.0:1782759078.683370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73251:x1869355196927488:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759078.685046:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73251:x1869355196927488:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 1670us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.685059:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1763 00000100:00100000:2.0:1782759078.689170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.689281:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927616 00000100:00100000:1.0:1782759078.689291:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927616 00000100:00100000:1.0:1782759078.689391:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1764 00000100:00100000:1.0:1782759078.689402:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73270:x1869355196927616:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759078.689748:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73270:x1869355196927616:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 346us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.689757:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1764 00000100:00100000:2.0:1782759078.701400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.705423:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927744 00000100:00100000:0.0:1782759078.705439:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927744 00000100:00100000:0.0:1782759078.705586:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1765 00000100:00100000:0.0:1782759078.705597:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73270:x1869355196927744:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759078.705975:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73270:x1869355196927744:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 378us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.705985:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1765 00000100:00100000:3.0:1782759078.709999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.714505:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196927872 00000100:00100000:2.0:1782759078.714528:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196927872 00000100:00100000:2.0:1782759078.714587:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1766 00000100:00100000:2.0:1782759078.714597:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+8:73251:x1869355196927872:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759078.714626:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759078.714646:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc99b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf651bb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759078.714682:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc99b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651bb expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759078.714695:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc99b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651bb expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759078.714705:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782759078.714783:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+9:73251:x1869355196927872:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 187us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.714791:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1766 00000100:00100000:1.0:1782759078.719225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.719413:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928000 00000100:00100000:2.0:1782759078.719423:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928000 00000100:00100000:2.0:1782759078.719529:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1767 00000100:00100000:2.0:1782759078.719540:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+9:73251:x1869355196928000:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782759078.719567:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782759078.719591:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782759078.719595:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782759078.719598:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782759078.719601:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782759078.720619:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+9:73251:x1869355196928000:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1067us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.720629:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1767 00000100:00100000:2.0:1782759078.726101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.726226:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928128 00000100:00100000:1.0:1782759078.726238:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928128 00000100:00100000:1.0:1782759078.726350:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1768 00000100:00100000:1.0:1782759078.726360:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+9:73251:x1869355196928128:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759078.726378:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759078.726395:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc9a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf651c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.726427:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651c2 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.726438:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651c2 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759078.726447:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782759078.726543:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73251:x1869355196928128:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 183us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.726551:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1768 00000100:00100000:1.0:1782759078.732174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.732458:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928256 00000100:00100000:2.0:1782759078.732469:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928256 00000100:00100000:2.0:1782759078.732525:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1769 00000100:00100000:2.0:1782759078.732535:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73251:x1869355196928256:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759078.732898:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73251:x1869355196928256:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 363us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.732907:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1769 00000100:00100000:3.0:1782759078.734661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.734818:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928384 00000100:00100000:0.0:1782759078.734898:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928384 00000100:00100000:0.0:1782759078.734946:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1770 00000100:00100000:0.0:1782759078.734955:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73251:x1869355196928384:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759078.735201:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73251:x1869355196928384:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 246us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.735210:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1770 00000100:00100000:3.0:1782759078.741393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.742026:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928512 00000100:00100000:1.0:1782759078.742037:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928512 00000100:00100000:1.0:1782759078.742093:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1771 00000100:00100000:1.0:1782759078.742102:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73275:x1869355196928512:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759078.742408:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73275:x1869355196928512:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 305us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.742416:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1771 00000100:00100000:1.0:1782759078.765876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.766051:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928640 00000100:00100000:2.0:1782759078.766061:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928640 00000100:00100000:2.0:1782759078.766154:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1772 00000100:00100000:2.0:1782759078.766166:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73275:x1869355196928640:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759078.767006:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+10:73275:x1869355196928640:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 838us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.767016:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1772 00000100:00100000:3.0:1782759078.772882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.773167:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928768 00000100:00100000:1.0:1782759078.773178:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928768 00000100:00100000:1.0:1782759078.773222:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1309 00000100:00100000:1.0:1782759078.773230:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1869355196928768:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759078.773262:0:5801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bc31ab11-ba12-4270-af64-c35b4f15a25b@192.168.204.31@tcp t0 exp 0000000000000000 cur 3147 last 0 00000020:00000080:1.0:1782759078.773374:0:5801:0:(genops.c:1406:class_connect()) connect: client bc31ab11-ba12-4270-af64-c35b4f15a25b, cookie 0xdd99f5c4777dc9a9 00000004:00100000:1.0:1782759078.773407:0:5801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759078.773797:0:5801:0:(import.c:65:import_set_state_nolock()) ffff917081aff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759078.774018:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2360:x1869355196928768:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 785us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.774027:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1309 00000100:00100000:3.0:1782759078.780092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.780402:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196928896 00000100:00100000:2.0:1782759078.780412:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196928896 00000100:00100000:2.0:1782759078.780512:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1310 00000100:00100000:2.0:1782759078.780523:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:0:x1869355196928896:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759078.780572:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1782759078.780674:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:0:x1869355196928896:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 152us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.780683:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1310 00000100:00080000:0.0:1782759078.780978:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759078.782803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.782997:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929024 00000100:00100000:0.0:1782759078.783005:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929024 00000100:00100000:0.0:1782759078.783066:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:0.0:1782759078.783077:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929024:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782759078.783109:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782759078.783179:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929024:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 103us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.783187:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1311 00000100:00100000:2.0:1782759078.785698:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.787174:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929152 00000100:00100000:1.0:1782759078.787190:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929152 00000100:00100000:1.0:1782759078.787319:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1312 00000100:00100000:1.0:1782759078.787330:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929152:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782759078.787460:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929152:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 131us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.787468:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1312 00000100:00100000:2.0:1782759078.789471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759078.789512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.789617:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929280 00000100:00100000:1.0:1782759078.789625:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929280 00000100:00100000:1.0:1782759078.789670:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 719 00000100:00100000:1.0:1782759078.789678:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196929280:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759078.789712:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bc31ab11-ba12-4270-af64-c35b4f15a25b@192.168.204.31@tcp t0 exp 0000000000000000 cur 3147 last 0 00000020:00000080:1.0:1782759078.789744:0:6599:0:(genops.c:1406:class_connect()) connect: client bc31ab11-ba12-4270-af64-c35b4f15a25b, cookie 0xdd99f5c4777dc9b0 00002000:00100000:1.0:1782759078.789756:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc31ab11-ba12-4270-af64-c35b4f15a25b/ffff917081aff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759078.789781:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759078.790060:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782759078.790091:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917081afe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759078.790163:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2360:x1869355196929280:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 484us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.790172:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 719 00000100:00100000:2.0:1782759078.790858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.791156:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929408 00000100:00100000:1.0:1782759078.791165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929408 00000100:00100000:1.0:1782759078.791208:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1773 00000100:00100000:1.0:1782759078.791216:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+10:2362:x1869355196929408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759078.791274:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4d7964-faf5-4b62-bb51-ca396492625e+10:2362:x1869355196929408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759078.791281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1773 00000100:00100000:1.0:1782759078.794095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759078.794142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759078.794230:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929536 00000100:00100000:3.0:1782759078.794239:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929536 00000100:00100000:3.0:1782759078.794302:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:3.0:1782759078.794312:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2362:x1869355196929536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759078.794387:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2362:x1869355196929536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759078.794393:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:0.0:1782759078.794863:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929664 00000100:00100000:0.0:1782759078.794868:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929664 00000100:00100000:0.0:1782759078.794902:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 720 00000100:00100000:0.0:1782759078.794907:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196929664:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782759078.794947:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bc31ab11-ba12-4270-af64-c35b4f15a25b@192.168.204.31@tcp t0 exp 0000000000000000 cur 3147 last 0 00000020:00000080:0.0:1782759078.794979:0:6598:0:(genops.c:1406:class_connect()) connect: client bc31ab11-ba12-4270-af64-c35b4f15a25b, cookie 0xdd99f5c4777dc9b7 00002000:00100000:0.0:1782759078.794991:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc31ab11-ba12-4270-af64-c35b4f15a25b/ffff917182e3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759078.795002:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759078.795277:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1782759078.795284:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929792 00000100:00080000:0.0:1782759078.795308:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917182e38800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759078.795332:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929792 00000100:00100000:0.0:1782759078.795356:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2360:x1869355196929664:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 446us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.795364:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 720 00000100:00100000:2.0:1782759078.795385:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:2.0:1782759078.795399:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929792:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782759078.795751:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782759078.796028:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73251:x1869355196929792:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 628us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759078.796075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:3.0:1782759078.924947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759078.925170:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196929920 00000100:00100000:0.0:1782759078.925181:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196929920 00000100:00100000:0.0:1782759078.925252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1313 00000100:00100000:0.0:1782759078.925263:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:73292:x1869355196929920:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1782759078.925285:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759078.925308:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf651ec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925375:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925389:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925403:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759078.925628:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759078.925632:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759078.925713:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925754:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651ec expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925772:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651ec expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759078.925781:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70000) 00010000:00010000:0.0:1782759078.925784:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759078.925787:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782759078.925916:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc31ab11-ba12-4270-af64-c35b4f15a25b+7:73292:x1869355196929920:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 653us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759078.926032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1313 00000100:00100000:3.0:1782759079.025952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759079.026039:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930048 00000100:00100000:0.0:1782759079.026049:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930048 00000100:00100000:0.0:1782759079.026112:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:0.0:1782759079.026121:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bc31ab11-ba12-4270-af64-c35b4f15a25b+7:73292:x1869355196930048:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:0.0:1782759079.026220:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bc31ab11-ba12-4270-af64-c35b4f15a25b+7:73292:x1869355196930048:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759079.026228:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1782759079.030712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759079.030803:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930304 00000100:00100000:1.0:1782759079.030814:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930304 00000100:00100000:1.0:1782759079.030985:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1314 00000100:00100000:1.0:1782759079.030997:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+7:73292:x1869355196930304:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759079.031052:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759079.031079:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651ec expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031098:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70000) 00010000:00010000:1.0:1782759079.031109:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759079.031408:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031421:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031435:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031506:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031515:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.031521:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759079.032780:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1782759079.032795:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032803:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032810:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032815:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759079.032819:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032847:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032862:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759079.032864:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759079.032868:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.032873:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dc9cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759079.032890:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b0145a3 reply state 0000000076ed78ac transno 4294967796 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759079.032899:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759079.032997:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+8:73292:x1869355196930304:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2000us (2294us total) trans 4294967796 rc 0/0 00000100:00100000:1.0:1782759079.033006:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1314 00010000:00010000:0.0:1782759079.035357:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035373:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035380:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035386:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759079.035390:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035398:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035414:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9cd31e70 (ffff9171889c5d00) 00010000:00010000:0.0:1782759079.035417:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759079.035421:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.035426:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dc9d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759079.078253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759079.078813:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930432 00000100:00100000:0.0:1782759079.078855:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930432 00000100:00100000:0.0:1782759079.078917:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1315 00000100:00100000:0.0:1782759079.078927:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+7:73305:x1869355196930432:12345-192.168.204.31@tcp:101:rmdir.0 00010000:00010000:0.0:1782759079.078949:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759079.079446:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc9da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf651f3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.079510:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.079523:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.079534:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759079.080078:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759079.080084:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759079.080132:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.080162:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dc9da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651f3 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.080179:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651f3 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.080187:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759079.080190:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759079.080194:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50200, rc 0) 00000100:00100000:0.0:1782759079.080264:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+8:73305:x1869355196930432:12345-192.168.204.31@tcp:101:rmdir.0 Request processed in 1338us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759079.080272:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1315 00000100:00100000:2.0:1782759079.082393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759079.082504:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930560 00000100:00100000:0.0:1782759079.082513:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930560 00000100:00100000:0.0:1782759079.082679:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1316 00000100:00100000:0.0:1782759079.082690:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+8:73305:x1869355196930560:12345-192.168.204.31@tcp:101:rmdir.0 00010000:00010000:0.0:1782759079.082709:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759079.082851:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf651fa expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082908:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082922:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082941:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082955:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082963:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.082969:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083491:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083501:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083507:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759079.083632:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 1024 00000004:00200000:0.0:1782759079.083636:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759079.083664:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083677:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083683:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083689:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083698:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759079.083702:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083708:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083721:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759079.083724:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759079.083728:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083735:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dc9ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083748:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083753:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083759:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083764:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759079.083766:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083772:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083782:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9cd31e70 (ffff917183a70100) 00010000:00010000:0.0:1782759079.083784:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759079.083787:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083792:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dc9f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.083994:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dc9e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651fa expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.084010:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651fa expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.084018:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759079.084020:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759079.084023:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51000, rc 0) 00000100:00100000:0.0:1782759079.084101:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+9:73305:x1869355196930560:12345-192.168.204.31@tcp:101:rmdir.0 Request processed in 1413us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759079.084109:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1316 00000100:00100000:3.0:1782759079.087261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759079.087405:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930816 00000100:00100000:1.0:1782759079.087424:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930816 00000100:00100000:1.0:1782759079.087480:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1317 00000100:00100000:1.0:1782759079.087490:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+9:73305:x1869355196930816:12345-192.168.204.31@tcp:36:rmdir.0 00010000:00010000:1.0:1782759079.087625:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759079.087653:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51000/0xdd99f5c4777dc9fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651fa expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.087673:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff917183a70500) 00010000:00010000:1.0:1782759079.087690:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50200/0xdd99f5c4777dc9e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651f3 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.087698:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:1.0:1782759079.087705:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759079.088022:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088039:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088049:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088063:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088069:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088075:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088195:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088203:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088209:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759079.088764:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1782759079.088785:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088793:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088800:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088806:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759079.088810:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088817:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088852:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759079.088854:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759079.088859:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088865:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dca12 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088884:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088889:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088895:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088900:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759079.088903:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088909:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088920:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759079.088922:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759079.088925:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759079.088931:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dca04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759079.088942:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c45bd550 reply state 00000000aece6d14 transno 4294967797 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759079.088950:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759079.089432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc31ab11-ba12-4270-af64-c35b4f15a25b+9:73305:x1869355196930816:12345-192.168.204.31@tcp:36:rmdir.0 Request processed in 1939us (2175us total) trans 4294967797 rc 0/0 00000100:00100000:1.0:1782759079.089441:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1317 00010000:00010000:2.0:1782759079.092352:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092437:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092445:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092452:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759079.092457:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092465:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092482:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9cd31e70 (ffff9171889c5300) 00010000:00010000:2.0:1782759079.092485:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759079.092490:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759079.092496:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dca0b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759079.279536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759079.279969:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196930944 00000100:00100000:0.0:1782759079.279982:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196930944 00000100:00100000:0.0:1782759079.280053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1318 00000100:00100000:0.0:1782759079.280065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+8:73316:x1869355196930944:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:0.0:1782759079.280089:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759079.280112:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dca19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65201 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280180:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280195:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280206:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759079.280268:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759079.280272:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759079.280298:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280325:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50c00/0xdd99f5c4777dca19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65201 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280345:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65201 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759079.280354:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759079.280357:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759079.280361:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50a00, rc 0) 00000100:00100000:0.0:1782759079.280436:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+9:73316:x1869355196930944:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 373us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759079.280444:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1318 00010000:00010000:2.0:1782759079.531993:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782759079.922917:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000001:00080000:3.0:1782759080.410088:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967797 is committed 00000001:00100000:3.0:1782759080.410110:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000001:00100000:3.0:1782759080.410562:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b63da415-9fe7-432d-aaab-047a80aa0861 00000001:00080000:3.0:1782759080.410573:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967795 is committed 00000020:00000080:3.0:1782759080.410587:0:5824:0:(genops.c:906:class_export_put()) final put ffff917189070000/b63da415-9fe7-432d-aaab-047a80aa0861 00000020:00000080:1.0:1782759080.410682:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917189070000/b63da415-9fe7-432d-aaab-047a80aa0861 for lustre-MDT0000 00000020:00000080:1.0:1782759080.410997:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189077000 for lustre-MDT0000 00000100:00100000:3.0:1782759080.483804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759080.483901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759080.483935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759080.483967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759080.484076:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931200 00000100:00100000:0.0:1782759080.484087:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931200 00000100:00100000:0.0:1782759080.484150:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931072 00000100:00100000:0.0:1782759080.484153:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931072 00000100:00100000:0.0:1782759080.484171:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931328 00000100:00100000:0.0:1782759080.484174:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931328 00000100:00100000:0.0:1782759080.484190:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:0.0:1782759080.484198:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+12:2362:x1869355196931200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759080.484214:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759080.484233:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dc99b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651bb expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759080.484250:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759080.484308:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+11:2362:x1869355196931200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759080.484316:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:0.0:1782759080.484333:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1782759080.484339:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+10:2361:x1869355196931072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759080.484346:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759080.484355:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777dc994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65191 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759080.484365:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759080.484389:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+9:2361:x1869355196931072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759080.484395:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1782759080.484412:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:0.0:1782759080.484419:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9381c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+8:2361:x1869355196931328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759080.484426:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759080.484435:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dc9a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf651c2 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759080.484443:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759080.484460:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9381c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd4d7964-faf5-4b62-bb51-ca396492625e+7:2361:x1869355196931328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759080.484466:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:1.0:1782759080.484645:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931456 00000100:00100000:1.0:1782759080.484650:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931456 00000100:00100000:1.0:1782759080.484703:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 721 00000100:00100000:1.0:1782759080.484711:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2360:x1869355196931456:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:1.0:1782759080.484738:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc9b7 00000100:00080000:1.0:1782759080.484748:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917182e38800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759080.484784:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1782759080.485030:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc31ab11-ba12-4270-af64-c35b4f15a25b+3:2360:x1869355196931456:12345-192.168.204.31@tcp:9:umount.0 Request processed in 319us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759080.485037:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 721 00010000:00010000:1.0:1782759080.485063:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782759080.485162:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759080.495319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759080.499075:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931584 00000100:00100000:0.0:1782759080.499088:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931584 00000100:00100000:0.0:1782759080.499177:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 722 00000100:00100000:0.0:1782759080.499187:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+5:2360:x1869355196931584:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759080.499221:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc9b0 00000100:00080000:0.0:1782759080.499229:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917081afe800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759080.499273:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967376 00000100:00100000:0.0:1782759080.499544:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc31ab11-ba12-4270-af64-c35b4f15a25b+2:2360:x1869355196931584:12345-192.168.204.31@tcp:9:umount.0 Request processed in 357us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759080.499551:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 722 00000100:00080000:2.0:1782759080.500770:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759080.501056:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759080.506308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759080.506417:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196931840 00000100:00100000:0.0:1782759080.506427:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196931840 00000100:00100000:0.0:1782759080.506500:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1319 00000100:00100000:0.0:1782759080.506513:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+6:2360:x1869355196931840:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782759080.506549:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc9a9 00000020:00010000:0.0:1782759080.506556:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917081afa000: total 0 00000100:00080000:0.0:1782759080.506562:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917081aff800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759080.506599:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967797 00000100:00080000:2.0:1782759080.507040:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1782759080.507090:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917081afa000: total 0 00010000:00010000:1.0:1782759080.507132:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917081afa000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759080.507166:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70100) 00010000:00010000:1.0:1782759080.507171:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759080.507180:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50a00/0xdd99f5c4777dca20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65201 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759080.507204:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917081afa000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782759080.507214:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759080.507215:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759080.507216:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759080.508714:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc31ab11-ba12-4270-af64-c35b4f15a25b+3:2360:x1869355196931840:12345-192.168.204.31@tcp:39:umount.0 Request processed in 2197us (2409us total) trans 4294967798 rc 0/0 00000100:00100000:0.0:1782759080.508730:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1319 00000100:00100000:0.0:1782759080.521270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759080.522340:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932096 00000100:00100000:2.0:1782759080.522351:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932096 00000100:00100000:2.0:1782759080.522410:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1774 00000100:00100000:2.0:1782759080.522420:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+7:2360:x1869355196932096:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:2.0:1782759080.522467:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dc986 00000020:00010000:2.0:1782759080.522475:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917182e3b800: total 0 00000100:00080000:2.0:1782759080.522480:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917182e3c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782759080.522618:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4d7964-faf5-4b62-bb51-ca396492625e+3:2360:x1869355196932096:12345-192.168.204.31@tcp:251:umount.0 Request processed in 198us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759080.522627:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1774 00000020:00010000:3.0:1782759080.524665:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917182e3b800: total 0 00010000:00010000:3.0:1782759080.524738:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917182e3b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759080.524792:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dc98d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6518a expref: 2 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759080.524812:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917182e3b800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782759080.524931:0:7496:0:(genops.c:906:class_export_put()) final put ffff917182e3b800/fd4d7964-faf5-4b62-bb51-ca396492625e 00010000:00010000:3.0:1782759080.524944:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759080.524946:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759080.524948:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759080.525887:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917182e3b800/fd4d7964-faf5-4b62-bb51-ca396492625e for MGS 00000020:00000080:0.0:1782759080.525938:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917182e3c000 for MGS 00010000:00010000:3.0:1782759080.556157:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759080.877019:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759080.877091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759080.877230:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826560 00000100:00100000:0.0:1782759080.877238:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826560 00000100:00100000:0.0:1782759080.877300:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1782759080.877310:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759080.877342:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759080.877393:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211826560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759080.877400:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00080000:2.0:1782759080.877467:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759080.877500:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211826560:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782759080.932203:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000001:00100000:0.0:1782759080.932220:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000020:00000080:0.0:1782759080.932223:0:7507:0:(genops.c:906:class_export_put()) final put ffff917182e3c800/bc31ab11-ba12-4270-af64-c35b4f15a25b 00000020:00000080:0.0:1782759080.932246:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917182e3c800/bc31ab11-ba12-4270-af64-c35b4f15a25b for lustre-OST0001 00000020:00000080:0.0:1782759080.932284:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917182e38800 for lustre-OST0001 00000020:00000080:3.0:1782759081.194200:0:116268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6d3540c0 20000000:00000080:3.0:1782759081.194220:0:116268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd8c00 uarg=0000000000000000 10000000:01000000:3.0:1782759081.196080:0:116268:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759081.196110:0:116268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759081.196133:0:116268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759081.196141:0:116268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759081.196180:0:116268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759081.196404:0:116268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 18 pid: 5794 timeout: 3249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759081.196421:0:116268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116268:1869355211826688:0@lo:104: 00000100:00100000:3.0:1782759081.196637:0:116268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759081.196697:0:116268:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbba80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759081.196794:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826688 00000100:00100000:1.0:1782759081.196803:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826688 00000100:00100000:1.0:1782759081.196893:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1782759081.196903:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116268:x1869355211826688:12345-0@lo:104: 00010000:00010000:1.0:1782759081.196916:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759081.196980:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759081.196987:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116268:x1869355211826688:12345-0@lo:104: Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759081.196993:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1782759081.197023:0:116268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116268:1869355211826688:0@lo:104: 00010000:00010000:0.0:1782759081.197045:0:116268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197065:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759081.197074:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197083:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759081.197087:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197097:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759081.197110:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759081.197116:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759081.197154:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197165:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759081.197204:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197211:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe51e00/0xdd99f5c4777dc978 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dc97f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759081.197225:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759081.197227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759081.197228:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759081.197518:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211826816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759081.197571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759081.199969:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826816 00000100:00100000:0.0:1782759081.199985:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826816 00010000:00010000:0.0:1782759081.200028:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 3249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759081.200059:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1782759081.200069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211826816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759081.200083:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759081.200088:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 3249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200099:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 3249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200123:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dc97f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dc978 expref: 19 pid: 5794 timeout: 3249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200138:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200146:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200165:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200172:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200179:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200186:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200193:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759081.200198:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200207:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200230:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759081.200240:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759081.200319:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211826816:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (2753us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759081.200321:0:116268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759081.200331:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00010000:00010000:3.0:1782759081.200337:0:116268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759081.200346:0:116268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dca27 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759081.201155:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211826816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759081.590076:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759082.221273:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759082.221282:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759082.221288:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759082.221343:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759082.221355:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759082.221366:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759082.221393:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211826944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759082.221470:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759082.221534:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171896433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759082.221686:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211826944 00000100:00100000:3.0:1782759082.221695:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211826944 00000100:00100000:3.0:1782759082.221745:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:3.0:1782759082.221754:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211826944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759082.221772:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759082.221785:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dca2e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759082.221812:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759082.221849:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759082.221869:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782759082.221906:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211826944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759082.221912:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:0.0:1782759082.222127:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211826944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759082.222142:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759082.222156:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759082.222176:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759082.222181:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759082.222188:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759082.604027:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759082.924721:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211827072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.924740:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211827456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.924771:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211827200:0@lo:400:kworker.0 00000100:00100000:3.0:1782759082.924972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759082.924974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759082.925018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759082.925034:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211827712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.925055:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759082.925063:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211827584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.925073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759082.925098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759082.925104:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759082.925113:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211827328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.925137:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827456 00000100:00100000:0.0:1782759082.925142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759082.925146:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827456 00000100:00100000:3.0:1782759082.925178:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827072 00000100:00100000:3.0:1782759082.925182:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827072 00000100:00100000:0.0:1782759082.925189:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827200 00000100:00100000:0.0:1782759082.925195:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827200 00000100:00100000:1.0:1782759082.925203:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827712 00000100:00100000:1.0:1782759082.925208:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827712 00000100:00100000:3.0:1782759082.925213:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1782759082.925235:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827584 00000100:00100000:0.0:1782759082.925239:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827584 00000100:00100000:0.0:1782759082.925265:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827328 00000100:00100000:0.0:1782759082.925268:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827328 00000100:00100000:0.0:1782759082.925288:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1782759082.925294:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211827200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.925355:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211827200:12345-0@lo:400:kworker.0 Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759082.925367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1782759082.925386:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:0.0:1782759082.925393:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211827584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759082.925421:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211827072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.925433:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211827584:12345-0@lo:400:kworker.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759082.925440:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:0.0:1782759082.925459:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:0.0:1782759082.925467:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211827328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759082.925474:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211827072:12345-0@lo:400:kworker.0 Request processed in 252us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759082.925482:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1782759082.925505:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211827328:12345-0@lo:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759082.925512:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:3.0:1782759082.925624:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211827072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.925851:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782759082.925858:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211827456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.925897:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211827456:12345-0@lo:400:kworker.0 Request processed in 35us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759082.925903:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1782759082.925918:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1782759082.925924:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211827712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759082.926018:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211827712:12345-0@lo:400:kworker.0 Request processed in 94us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759082.926025:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00080000:1.0:1782759082.926043:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759082.926048:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759082.926050:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759082.926915:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211827584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.926927:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211827456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.926955:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211827328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.926966:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211827200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759082.926975:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211827712:0@lo:400:kworker.0 00000100:00100000:3.0:1782759083.436953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759083.436979:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211827840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759083.437068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759083.437144:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827840 00000100:00100000:3.0:1782759083.437152:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827840 00000100:00100000:3.0:1782759083.437200:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1782759083.437210:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211827840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759083.437246:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759083.437291:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211827840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759083.437300:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1782759083.437352:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211827840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759083.627971:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759084.263021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.263770:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932224 00000100:00100000:1.0:1782759084.263781:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932224 00000100:00100000:3.0:1782759084.263911:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1777 00000100:00100000:3.0:1782759084.263921:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355196932224:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759084.264793:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a95c4827-1bf9-4699-9e77-977d2312123d@192.168.204.31@tcp t0 exp 0000000000000000 cur 3152 last 0 00000020:00000080:0.0:1782759084.264849:0:5796:0:(genops.c:1406:class_connect()) connect: client a95c4827-1bf9-4699-9e77-977d2312123d, cookie 0xdd99f5c4777dca3c 00000100:00080000:0.0:1782759084.265050:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917189076000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759084.265266:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+5:2360:x1869355196932224:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 1343us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.265276:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1777 00000100:00100000:0.0:1782759084.272987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759084.273417:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932352 00000100:00100000:3.0:1782759084.273430:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932352 00000100:00100000:0.0:1782759084.273635:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1778 00000100:00100000:0.0:1782759084.273648:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+5:73420:x1869355196932352:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759084.273679:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759084.273705:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dca43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65216 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.273747:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dca43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65216 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.273761:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dca43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65216 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.273773:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51600, rc 0) 00000100:00100000:0.0:1782759084.274083:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+6:73420:x1869355196932352:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 435us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.274092:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1778 00000100:00100000:2.0:1782759084.278943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.279180:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932480 00000100:00100000:1.0:1782759084.279191:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932480 00000100:00100000:1.0:1782759084.279255:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1779 00000100:00100000:1.0:1782759084.279266:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+6:73420:x1869355196932480:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759084.279598:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+6:73420:x1869355196932480:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 332us (662us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759084.279608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1779 00000100:00100000:3.0:1782759084.285151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.285263:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932608 00000100:00100000:0.0:1782759084.285274:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932608 00000100:00100000:0.0:1782759084.285390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1780 00000100:00100000:0.0:1782759084.285401:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+6:73420:x1869355196932608:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759084.285419:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759084.285437:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dca4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6521d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.285466:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dca4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6521d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.285482:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dca4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6521d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759084.285492:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782759084.285563:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+7:73420:x1869355196932608:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.285570:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1780 00000100:00100000:0.0:1782759084.291650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759084.291867:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932736 00000100:00100000:2.0:1782759084.291879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932736 00000100:00100000:2.0:1782759084.291938:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1781 00000100:00100000:2.0:1782759084.291947:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+7:73420:x1869355196932736:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759084.292264:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+8:73420:x1869355196932736:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 317us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759084.292273:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1781 00000100:00100000:2.0:1782759084.296468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.300411:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932864 00000100:00100000:0.0:1782759084.300427:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932864 00000100:00100000:0.0:1782759084.300494:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1782 00000100:00100000:0.0:1782759084.300515:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+8:73420:x1869355196932864:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759084.300898:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+8:73420:x1869355196932864:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 393us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.300908:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1782 00000100:00100000:3.0:1782759084.311659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759084.312052:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196932992 00000100:00100000:2.0:1782759084.312063:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196932992 00000100:00100000:2.0:1782759084.312124:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1783 00000100:00100000:2.0:1782759084.312134:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+8:73438:x1869355196932992:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759084.312419:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+8:73438:x1869355196932992:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 284us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759084.312431:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1783 00000100:00100000:2.0:1782759084.322975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.323397:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933120 00000100:00100000:1.0:1782759084.323409:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933120 00000100:00100000:1.0:1782759084.323469:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1784 00000100:00100000:1.0:1782759084.323481:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+8:73438:x1869355196933120:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759084.323942:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+8:73438:x1869355196933120:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 460us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.323951:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1784 00000100:00100000:3.0:1782759084.336741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.338107:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933248 00000100:00100000:0.0:1782759084.338124:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933248 00000100:00100000:1.0:1782759084.338324:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1785 00000100:00100000:1.0:1782759084.338336:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+8:73420:x1869355196933248:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759084.338355:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759084.338373:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dca51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65247 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.338402:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dca51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65247 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.338413:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dca51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65247 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.338422:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759084.338489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+9:73420:x1869355196933248:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 154us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.338497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1785 00000100:00100000:2.0:1782759084.344306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.345397:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933376 00000100:00100000:1.0:1782759084.345410:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933376 00000100:00100000:1.0:1782759084.345464:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:1.0:1782759084.345474:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+9:73420:x1869355196933376:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782759084.345517:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782759084.345547:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782759084.345551:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782759084.345554:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782759084.345556:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782759084.353337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+9:73420:x1869355196933376:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 7852us (9031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.353353:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:3.0:1782759084.359349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.359768:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933504 00000100:00100000:1.0:1782759084.359779:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933504 00000100:00100000:1.0:1782759084.359872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1787 00000100:00100000:1.0:1782759084.359883:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+9:73420:x1869355196933504:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759084.359901:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759084.359920:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dca58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6524e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.359949:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dca58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6524e expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.359961:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dca58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6524e expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759084.359971:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759084.360025:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+10:73420:x1869355196933504:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 145us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.360037:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1787 00000100:00100000:2.0:1782759084.362583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.362868:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933632 00000100:00100000:1.0:1782759084.362879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933632 00000100:00100000:1.0:1782759084.362945:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1788 00000100:00100000:1.0:1782759084.362956:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+10:73420:x1869355196933632:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759084.363232:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+10:73420:x1869355196933632:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 277us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.363241:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1788 00000100:00100000:3.0:1782759084.373941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.374044:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933760 00000100:00100000:0.0:1782759084.374057:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933760 00000100:00100000:0.0:1782759084.374129:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1789 00000100:00100000:0.0:1782759084.374139:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+10:73420:x1869355196933760:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759084.374388:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a95c4827-1bf9-4699-9e77-977d2312123d+10:73420:x1869355196933760:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 250us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.374401:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1789 00000100:00100000:2.0:1782759084.381391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759084.382028:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196933888 00000100:00100000:3.0:1782759084.382039:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196933888 00000100:00100000:3.0:1782759084.383819:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1790 00000100:00100000:3.0:1782759084.384613:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+10:73443:x1869355196933888:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759084.385322:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+10:73443:x1869355196933888:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 723us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759084.385335:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1790 00000100:00100000:2.0:1782759084.394458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.394670:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934016 00000100:00100000:1.0:1782759084.394682:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934016 00000100:00100000:1.0:1782759084.394785:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1791 00000100:00100000:1.0:1782759084.394797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+10:73443:x1869355196934016:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759084.395651:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a95c4827-1bf9-4699-9e77-977d2312123d+10:73443:x1869355196934016:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 853us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.395661:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1791 00000100:00100000:2.0:1782759084.399237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.399507:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934144 00000100:00100000:0.0:1782759084.399517:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934144 00000100:00100000:0.0:1782759084.399606:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1320 00000100:00100000:0.0:1782759084.399614:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1869355196934144:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782759084.399648:0:5801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5cfede0b-2f0b-46ee-a1e7-848690e865db@192.168.204.31@tcp t0 exp 0000000000000000 cur 3152 last 0 00000020:00000080:0.0:1782759084.399688:0:5801:0:(genops.c:1406:class_connect()) connect: client 5cfede0b-2f0b-46ee-a1e7-848690e865db, cookie 0xdd99f5c4777dca5f 00000004:00100000:0.0:1782759084.399722:0:5801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782759084.400053:0:5801:0:(import.c:65:import_set_state_nolock()) ffff917189075800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759084.400139:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:2360:x1869355196934144:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 523us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.400148:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1320 00000100:00100000:2.0:1782759084.405193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759084.406382:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934272 00000100:00100000:3.0:1782759084.406396:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934272 00000100:00080000:1.0:1782759084.406483:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759084.406628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.406696:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934400 00000100:00100000:1.0:1782759084.406700:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934400 00000100:00100000:3.0:1782759084.409426:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1321 00000100:00100000:3.0:1782759084.409463:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5cfede0b-2f0b-46ee-a1e7-848690e865db+7:0:x1869355196934272:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759084.410100:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1782759084.410203:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5cfede0b-2f0b-46ee-a1e7-848690e865db+7:0:x1869355196934272:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 758us (5018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.411237:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:1.0:1782759084.411269:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfede0b-2f0b-46ee-a1e7-848690e865db+7:73420:x1869355196934400:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759084.411293:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1782759084.411354:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfede0b-2f0b-46ee-a1e7-848690e865db+7:73420:x1869355196934400:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 105us (4726us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759084.411362:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1322 00000100:00100000:2.0:1782759084.413232:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1321 00000100:00100000:2.0:1782759084.414062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759084.414324:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934528 00000100:00100000:0.0:1782759084.414400:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934528 00000100:00100000:0.0:1782759084.414526:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1323 00000100:00100000:0.0:1782759084.414537:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:73420:x1869355196934528:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782759084.414642:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:73420:x1869355196934528:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759084.414649:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1323 00000100:00100000:1.0:1782759084.420797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759084.421080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759084.423031:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934656 00000100:00100000:2.0:1782759084.423045:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934656 00000100:00100000:3.0:1782759084.423246:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934784 00000100:00100000:3.0:1782759084.423251:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934784 00000100:00100000:3.0:1782759084.423289:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:3.0:1782759084.423299:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355196934784:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782759084.423336:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5cfede0b-2f0b-46ee-a1e7-848690e865db@192.168.204.31@tcp t0 exp 0000000000000000 cur 3152 last 0 00000020:00000080:3.0:1782759084.423369:0:6599:0:(genops.c:1406:class_connect()) connect: client 5cfede0b-2f0b-46ee-a1e7-848690e865db, cookie 0xdd99f5c4777dca66 00002000:00100000:3.0:1782759084.423381:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5cfede0b-2f0b-46ee-a1e7-848690e865db/ffff917082a78000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759084.423393:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1782759084.423407:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:2.0:1782759084.423413:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196934656:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759084.423431:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5cfede0b-2f0b-46ee-a1e7-848690e865db@192.168.204.31@tcp t0 exp 0000000000000000 cur 3152 last 0 00000020:00000080:2.0:1782759084.423452:0:6597:0:(genops.c:1406:class_connect()) connect: client 5cfede0b-2f0b-46ee-a1e7-848690e865db, cookie 0xdd99f5c4777dca6d 00002000:00100000:2.0:1782759084.423458:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5cfede0b-2f0b-46ee-a1e7-848690e865db/ffff9171b760d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759084.423479:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759084.423583:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759084.423630:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9171b7609800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1782759084.423702:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1782759084.423702:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:2360:x1869355196934656:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 286us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759084.423715:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00080000:3.0:1782759084.423721:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759084.423750:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:2360:x1869355196934784:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 450us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759084.423758:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:2.0:1782759084.423795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759084.423838:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196934912 00000100:00100000:3.0:1782759084.423842:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196934912 00000100:00100000:3.0:1782759084.423872:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:3.0:1782759084.423878:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:73420:x1869355196934912:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782759084.424058:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782759084.424165:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:73420:x1869355196934912:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 286us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759084.424172:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 135 00010000:00010000:3.0:1782759084.652176:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759084.756989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759084.757091:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935040 00000100:00100000:3.0:1782759084.757102:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935040 00000100:00100000:3.0:1782759084.757168:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1324 00000100:00100000:3.0:1782759084.757181:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:73470:x1869355196935040:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:3.0:1782759084.757201:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759084.757224:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dca74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65278 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757303:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757318:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757331:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759084.757549:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759084.757554:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759084.757643:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757669:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691e00/0xdd99f5c4777dca74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65278 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757686:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65278 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759084.757700:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759084.757703:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759084.757707:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782759084.757777:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfede0b-2f0b-46ee-a1e7-848690e865db+7:73470:x1869355196935040:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 599us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759084.757784:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1324 00000001:00100000:2.0:1782759085.015265:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000020:00000080:2.0:1782759085.015276:0:6622:0:(genops.c:906:class_export_put()) final put ffff917081aff000/bc31ab11-ba12-4270-af64-c35b4f15a25b 00000001:00100000:2.0:1782759085.015318:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:3.0:1782759085.015424:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917081aff000/bc31ab11-ba12-4270-af64-c35b4f15a25b for lustre-OST0000 00000020:00000080:3.0:1782759085.015476:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081afe800 for lustre-OST0000 00000001:00100000:2.0:1782759085.521713:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000001:00100000:2.0:1782759085.521732:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc31ab11-ba12-4270-af64-c35b4f15a25b 00000001:00080000:2.0:1782759085.521740:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967798 is committed 00000020:00000080:2.0:1782759085.521745:0:5824:0:(genops.c:906:class_export_put()) final put ffff917081afa000/bc31ab11-ba12-4270-af64-c35b4f15a25b 00000020:00000080:3.0:1782759085.521816:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917081afa000/bc31ab11-ba12-4270-af64-c35b4f15a25b for lustre-MDT0000 00000020:00000080:3.0:1782759085.521928:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081aff800 for lustre-MDT0000 00010000:00010000:3.0:1782759085.676150:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759085.867714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759085.867816:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935168 00000100:00100000:3.0:1782759085.867853:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935168 00000100:00100000:3.0:1782759085.867922:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:3.0:1782759085.867943:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a95c4827-1bf9-4699-9e77-977d2312123d+10:2363:x1869355196935168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759085.867970:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759085.867994:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51c00/0xdd99f5c4777dca4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6521d expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759085.868011:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759085.868085:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a95c4827-1bf9-4699-9e77-977d2312123d+9:2363:x1869355196935168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759085.868093:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:1.0:1782759085.872152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759085.872197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759085.872290:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935424 00000100:00100000:1.0:1782759085.872299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759085.872342:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935296 00000100:00100000:1.0:1782759085.872347:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935296 00000100:00100000:1.0:1782759085.872398:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935552 00000100:00100000:1.0:1782759085.872402:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935552 00000100:00100000:0.0:1782759085.872413:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935424 00000100:00100000:1.0:1782759085.872426:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:1.0:1782759085.872438:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a95c4827-1bf9-4699-9e77-977d2312123d+10:2361:x1869355196935296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759085.872455:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759085.872457:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:2.0:1782759085.872467:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a95c4827-1bf9-4699-9e77-977d2312123d+10:2361:x1869355196935552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782759085.872484:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 725 00010000:00010000:2.0:1782759085.872487:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759085.872487:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dca51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65247 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759085.872499:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:2360:x1869355196935424:12345-192.168.204.31@tcp:9:umount.0 00010000:00010000:2.0:1782759085.872500:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dca58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6524e expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759085.872505:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759085.872514:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1782759085.872532:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dca66 00000100:00080000:0.0:1782759085.872541:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917082a7a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759085.872562:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a95c4827-1bf9-4699-9e77-977d2312123d+8:2361:x1869355196935296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759085.872570:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00000001:00000004:0.0:1782759085.872583:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00010000:00010000:3.0:1782759085.872594:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782759085.872603:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759085.874080:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a95c4827-1bf9-4699-9e77-977d2312123d+7:2361:x1869355196935552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1608us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759085.874092:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:0.0:1782759085.876121:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfede0b-2f0b-46ee-a1e7-848690e865db+3:2360:x1869355196935424:12345-192.168.204.31@tcp:9:umount.0 Request processed in 3605us (3899us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759085.876138:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 725 00000100:00100000:1.0:1782759085.884203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759085.885093:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935680 00000100:00100000:3.0:1782759085.885105:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935680 00000100:00100000:3.0:1782759085.885188:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 726 00000100:00100000:3.0:1782759085.885198:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfede0b-2f0b-46ee-a1e7-848690e865db+5:2360:x1869355196935680:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782759085.885229:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dca6d 00000100:00080000:3.0:1782759085.885238:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9171b7609800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1782759085.885379:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1782759085.886033:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967376 00000100:00100000:3.0:1782759085.886492:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfede0b-2f0b-46ee-a1e7-848690e865db+2:2360:x1869355196935680:12345-192.168.204.31@tcp:9:umount.0 Request processed in 1290us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759085.886504:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 726 00010000:00010000:2.0:1782759085.888863:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759085.893654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759085.893752:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196935936 00000100:00100000:2.0:1782759085.893763:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196935936 00000100:00100000:2.0:1782759085.893868:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1325 00000100:00100000:2.0:1782759085.893879:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5cfede0b-2f0b-46ee-a1e7-848690e865db+6:2360:x1869355196935936:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:2.0:1782759085.893915:0:19544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dca5f 00000020:00010000:2.0:1782759085.893922:0:19544:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917189071000: total 0 00000100:00080000:2.0:1782759085.893927:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917189075800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759085.893962:0:19544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967798 00000020:00010000:3.0:1782759085.894409:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917189071000: total 0 00010000:00010000:3.0:1782759085.894414:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759085.894458:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189071000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759085.894500:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759085.894504:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759085.894512:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b3691400/0xdd99f5c4777dca7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65278 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759085.894536:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189071000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759085.894546:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759085.894548:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759085.894549:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759085.896101:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5cfede0b-2f0b-46ee-a1e7-848690e865db+3:2360:x1869355196935936:12345-192.168.204.31@tcp:39:umount.0 Request processed in 2214us (2447us total) trans 4294967799 rc 0/0 00000100:00100000:2.0:1782759085.896113:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1325 00000100:00100000:0.0:1782759085.919212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759085.919312:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936192 00000100:00100000:3.0:1782759085.919323:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936192 00000100:00100000:3.0:1782759085.919385:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1792 00000100:00100000:3.0:1782759085.919395:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+7:2360:x1869355196936192:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782759085.919437:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dca3c 00000020:00010000:3.0:1782759085.919444:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917189071800: total 0 00000100:00080000:3.0:1782759085.919449:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917189076000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1782759085.919628:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917189071800: total 0 00010000:00010000:2.0:1782759085.919677:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189071800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759085.919707:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51600/0xdd99f5c4777dca43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65216 expref: 3 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759085.919725:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189071800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782759085.919734:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759085.919736:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759085.919738:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759085.919755:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a95c4827-1bf9-4699-9e77-977d2312123d+1:2360:x1869355196936192:12345-192.168.204.31@tcp:251:umount.0 Request processed in 359us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759085.919764:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1792 00000020:00000080:3.0:1782759085.919775:0:5793:0:(genops.c:906:class_export_put()) final put ffff917189071800/a95c4827-1bf9-4699-9e77-977d2312123d 00000020:00000080:2.0:1782759085.920478:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917189071800/a95c4827-1bf9-4699-9e77-977d2312123d for MGS 00000020:00000080:2.0:1782759085.920526:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189076000 for MGS 00000100:00100000:1.0:1782759086.001531:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211827968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759086.001616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759086.001803:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211827968 00000100:00100000:0.0:1782759086.001814:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211827968 00000100:00100000:0.0:1782759086.001903:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1782759086.001913:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211827968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759086.001960:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759086.002019:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211827968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759086.002027:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:1.0:1782759086.002906:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759086.002965:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211827968:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1782759086.058101:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000001:00100000:2.0:1782759086.058119:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:2.0:1782759086.058122:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082a78000/5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:2.0:1782759086.058145:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917082a78000/5cfede0b-2f0b-46ee-a1e7-848690e865db for lustre-OST0001 00000020:00000080:2.0:1782759086.058184:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082a7a800 for lustre-OST0001 00000020:00000080:1.0:1782759086.531122:0:116515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5cf56a30 20000000:00000080:1.0:1782759086.531141:0:116515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084fa3800 uarg=0000000000000000 10000000:01000000:1.0:1782759086.535360:0:116515:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759086.535386:0:116515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759086.535404:0:116515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759086.535412:0:116515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759086.535451:0:116515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759086.535479:0:116515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 18 pid: 5793 timeout: 3254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759086.535494:0:116515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116515:1869355211828096:0@lo:104: 00000100:00100000:1.0:1782759086.535564:0:116515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759086.535627:0:116515:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3d000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759086.535694:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759086.535706:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828096 00000100:00100000:2.0:1782759086.535713:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828096 00000100:00100000:2.0:1782759086.535797:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1782759086.535807:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b312c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116515:x1869355211828096:12345-0@lo:104: 00010000:00010000:2.0:1782759086.535992:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759086.536095:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759086.536102:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b312c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116515:x1869355211828096:12345-0@lo:104: Request processed in 297us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759086.536111:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00010000:00010000:0.0:1782759086.536222:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759086.536228:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536235:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759086.536239:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536247:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759086.536253:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759086.536258:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759086.536295:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536305:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759086.536327:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536334:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff91719fe50000/0xdd99f5c4777dca2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca35 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536349:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759086.536351:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759086.536352:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759086.536364:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211828224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759086.536394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759086.536439:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828224 00000100:00100000:0.0:1782759086.536443:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828224 00010000:00010000:0.0:1782759086.536473:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 19 pid: 5793 timeout: 3254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759086.536495:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1782759086.536501:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211828224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759086.536511:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759086.536516:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 19 pid: 5793 timeout: 3254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536526:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 19 pid: 5793 timeout: 3254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536542:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536555:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536568:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536574:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536582:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536589:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536594:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759086.536599:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536606:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536615:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759086.536624:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759086.536653:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211828224:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759086.536659:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1782759086.536693:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211828224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759086.537188:0:116515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dca35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dca2e expref: 18 pid: 5793 timeout: 3254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759086.537198:0:116515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116515:1869355211828096:0@lo:104: 00010000:00010000:3.0:1782759086.537214:0:116515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759086.537222:0:116515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759086.537227:0:116515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759086.537233:0:116515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777dca82 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759086.710955:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759087.659968:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759087.659978:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759087.659984:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759087.660035:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759087.660048:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759087.660059:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759087.660086:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211828352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759087.660385:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759087.660512:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759087.660733:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828352 00000100:00100000:2.0:1782759087.660742:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828352 00000100:00100000:2.0:1782759087.660957:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:2.0:1782759087.660967:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211828352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759087.660983:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759087.660998:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dca89 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759087.661023:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759087.661033:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759087.661043:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782759087.661102:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211828352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759087.661108:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1782759087.661227:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211828352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759087.661243:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759087.661376:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759087.661401:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759087.661406:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759087.661413:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759087.727305:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759088.045494:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211828480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759088.045529:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211828736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.045582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759088.045583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759088.045642:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211828608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759088.046068:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828736 00000100:00100000:3.0:1782759088.046076:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828736 00000100:00100000:3.0:1782759088.046128:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:3.0:1782759088.046148:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211828736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759088.046776:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759088.046786:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211828864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759088.046818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759088.046869:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828480 00000100:00100000:2.0:1782759088.046874:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828480 00000100:00100000:2.0:1782759088.046902:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828864 00000100:00100000:2.0:1782759088.046906:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828864 00000100:00100000:2.0:1782759088.046927:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:2.0:1782759088.046934:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211828480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759088.046969:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211828480:12345-0@lo:400:kworker.0 Request processed in 35us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759088.046976:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:0.0:1782759088.047586:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211828480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.047616:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211828992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.047647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759088.048121:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1782759088.048133:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211828864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.048187:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211828864:12345-0@lo:400:kworker.0 Request processed in 55us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759088.048195:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1782759088.048225:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828992 00000100:00100000:0.0:1782759088.048230:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828992 00000100:00100000:0.0:1782759088.048276:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1782759088.048283:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211828992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.048321:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211828992:12345-0@lo:400:kworker.0 Request processed in 38us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759088.048327:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1782759088.048346:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211828864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.048361:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211828992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759088.049505:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211828736:12345-0@lo:400:kworker.0 Request processed in 3363us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759088.049516:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:1.0:1782759088.049618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759088.049642:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211828736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759088.049730:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211828608 00000100:00100000:0.0:1782759088.049736:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211828608 00000100:00100000:0.0:1782759088.049880:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:0.0:1782759088.049889:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211828608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759088.050079:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759088.050084:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211828608:12345-0@lo:400:kworker.0 Request processed in 196us (465us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759088.050086:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759088.050091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759088.050100:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:2.0:1782759088.053205:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211828608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759088.557620:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211829120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759088.557698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759088.557848:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829120 00000100:00100000:0.0:1782759088.557856:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829120 00000100:00100000:0.0:1782759088.557922:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1782759088.557931:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211829120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759088.557968:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759088.561909:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211829120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3969us (4201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759088.561960:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211829120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759088.561998:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00010000:00010000:3.0:1782759088.749103:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759089.028584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.028990:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936320 00000100:00100000:0.0:1782759089.029001:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936320 00000100:00100000:0.0:1782759089.029048:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:0.0:1782759089.029057:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355196936320:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759089.029208:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44@192.168.204.31@tcp t0 exp 0000000000000000 cur 3157 last 0 00000020:00000080:0.0:1782759089.029237:0:5796:0:(genops.c:1406:class_connect()) connect: client fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44, cookie 0xdd99f5c4777dca97 00000100:00080000:0.0:1782759089.029285:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917182e38800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759089.029360:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+5:2360:x1869355196936320:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 302us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759089.029368:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:1.0:1782759089.040967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759089.041069:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936448 00000100:00100000:2.0:1782759089.041079:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936448 00000100:00100000:2.0:1782759089.041137:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1795 00000100:00100000:2.0:1782759089.041148:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+5:73563:x1869355196936448:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759089.041166:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759089.041183:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694a00/0xdd99f5c4777dca9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6528d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759089.041214:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694a00/0xdd99f5c4777dca9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6528d expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759089.041230:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694a00/0xdd99f5c4777dca9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6528d expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759089.041240:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782759089.041302:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+6:73563:x1869355196936448:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759089.041310:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1795 00000100:00100000:3.0:1782759089.045019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.045146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936576 00000100:00100000:0.0:1782759089.045155:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936576 00000100:00100000:0.0:1782759089.045252:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1796 00000100:00100000:0.0:1782759089.045262:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+6:73563:x1869355196936576:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759089.045533:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+6:73563:x1869355196936576:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 271us (521us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759089.045545:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1796 00000100:00100000:1.0:1782759089.047395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759089.047489:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936704 00000100:00100000:3.0:1782759089.047499:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936704 00000100:00100000:3.0:1782759089.047555:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1797 00000100:00100000:3.0:1782759089.047565:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+6:73563:x1869355196936704:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759089.047583:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759089.047599:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dcaa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65294 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.047628:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dcaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65294 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.047653:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dcaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65294 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.047663:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691400, rc 0) 00000100:00100000:3.0:1782759089.047741:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+7:73563:x1869355196936704:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 176us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759089.047748:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1797 00000100:00100000:1.0:1782759089.056125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.056236:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936832 00000100:00100000:0.0:1782759089.056247:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936832 00000100:00100000:0.0:1782759089.056305:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00100000:0.0:1782759089.056315:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+7:73563:x1869355196936832:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759089.056698:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73563:x1869355196936832:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 384us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759089.056706:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00100000:0.0:1782759089.063244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759089.063326:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196936960 00000100:00100000:3.0:1782759089.063336:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196936960 00000100:00100000:3.0:1782759089.063395:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1799 00000100:00100000:3.0:1782759089.063405:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73563:x1869355196936960:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759089.063649:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73563:x1869355196936960:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 244us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759089.063658:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1799 00000100:00100000:1.0:1782759089.072913:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.073040:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937088 00000100:00100000:0.0:1782759089.073051:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937088 00000100:00100000:0.0:1782759089.073103:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1800 00000100:00100000:0.0:1782759089.073112:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73582:x1869355196937088:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759089.073400:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73582:x1869355196937088:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759089.073420:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1800 00000100:00100000:0.0:1782759089.116520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.116767:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937216 00000100:00100000:1.0:1782759089.116778:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937216 00000100:00100000:1.0:1782759089.116863:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1801 00000100:00100000:1.0:1782759089.116873:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73582:x1869355196937216:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759089.117150:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73582:x1869355196937216:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 277us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.117158:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1801 00000100:00100000:1.0:1782759089.121809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759089.121992:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937344 00000100:00100000:3.0:1782759089.122002:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937344 00000100:00100000:3.0:1782759089.122078:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00100000:3.0:1782759089.122099:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:73563:x1869355196937344:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759089.122118:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759089.122134:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dcaac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf652be expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.122164:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dcaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652be expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.122176:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dcaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652be expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.122186:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690200, rc 0) 00000100:00100000:3.0:1782759089.122265:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+9:73563:x1869355196937344:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 178us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759089.122271:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00100000:2.0:1782759089.136131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.136348:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937472 00000100:00100000:0.0:1782759089.136359:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937472 00000100:00100000:0.0:1782759089.136426:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1803 00000100:00100000:0.0:1782759089.136437:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+9:73563:x1869355196937472:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759089.136465:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759089.136491:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759089.136496:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759089.136500:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759089.136503:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782759089.140860:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+9:73563:x1869355196937472:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 4386us (4699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.140876:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1803 00000100:00100000:2.0:1782759089.154097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759089.154187:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937600 00000100:00100000:3.0:1782759089.154199:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937600 00000100:00100000:3.0:1782759089.154263:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1804 00000100:00100000:3.0:1782759089.154273:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+9:73563:x1869355196937600:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759089.154289:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759089.154307:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dcab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf652c5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.154336:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dcab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652c5 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.154348:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dcab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652c5 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759089.154358:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3690e00, rc 0) 00000100:00100000:3.0:1782759089.154431:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73563:x1869355196937600:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759089.154439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1804 00000100:00100000:2.0:1782759089.159627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.159809:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937728 00000100:00100000:1.0:1782759089.159921:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937728 00000100:00100000:1.0:1782759089.160033:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1805 00000100:00100000:1.0:1782759089.160044:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73563:x1869355196937728:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759089.160449:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73563:x1869355196937728:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 405us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.160457:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1805 00000100:00100000:0.0:1782759089.163315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.163550:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937856 00000100:00100000:1.0:1782759089.163561:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937856 00000100:00100000:1.0:1782759089.163619:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:1.0:1782759089.163630:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73563:x1869355196937856:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759089.163953:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73563:x1869355196937856:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 323us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.163962:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:2.0:1782759089.175354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.175490:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196937984 00000100:00100000:1.0:1782759089.175500:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196937984 00000100:00100000:1.0:1782759089.175563:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1807 00000100:00100000:1.0:1782759089.175575:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73584:x1869355196937984:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759089.175864:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73584:x1869355196937984:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 291us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.175873:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1807 00000100:00100000:2.0:1782759089.210085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759089.217427:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196938112 00000100:00100000:3.0:1782759089.217442:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196938112 00000100:00100000:3.0:1782759089.217753:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1808 00000100:00100000:3.0:1782759089.217764:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73584:x1869355196938112:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759089.218094:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:73584:x1869355196938112:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 331us (8018us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759089.219764:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1808 00000100:00100000:0.0:1782759089.221659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759089.222016:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196938240 00000100:00100000:2.0:1782759089.222027:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196938240 00000100:00100000:2.0:1782759089.222262:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1326 00000100:00100000:2.0:1782759089.222271:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355196938240:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782759089.222303:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc@192.168.204.31@tcp t0 exp 0000000000000000 cur 3157 last 0 00000020:00000080:2.0:1782759089.222372:0:5802:0:(genops.c:1406:class_connect()) connect: client 7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc, cookie 0xdd99f5c4777dcaba 00000004:00100000:2.0:1782759089.222421:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782759089.222571:0:5802:0:(import.c:65:import_set_state_nolock()) ffff9171b760f800 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1782759089.222591:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcaba 00000100:00080000:2.0:1782759089.222604:0:5802:0:(import.c:65:import_set_state_nolock()) ffff9171b760f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759089.222632:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967799 00000100:00100000:2.0:1782759089.222855:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc+4:2360:x1869355196938240:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 583us (1206us total) trans 4294967800 rc -13/-13 00000100:00100000:2.0:1782759089.222868:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1326 00010000:00010000:3.0:1782759089.222928:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759089.258531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759089.258579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.258871:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196938752 00000100:00100000:1.0:1782759089.258882:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196938752 00000100:00100000:1.0:1782759089.258936:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196938624 00000100:00100000:1.0:1782759089.258939:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196938624 00000100:00100000:1.0:1782759089.258966:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:1.0:1782759089.258977:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+11:2361:x1869355196938752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759089.258993:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759089.259012:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690200/0xdd99f5c4777dcaac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652be expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759089.259030:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759089.259095:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+10:2361:x1869355196938752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.259102:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:1.0:1782759089.259122:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:1.0:1782759089.259128:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9381850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+9:2361:x1869355196938624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759089.259135:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759089.259144:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691400/0xdd99f5c4777dcaa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65294 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759089.259152:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759089.259171:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9381850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:2361:x1869355196938624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759089.259176:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:2.0:1782759089.259988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759089.260241:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196938880 00000100:00100000:0.0:1782759089.260248:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196938880 00000100:00100000:0.0:1782759089.260299:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:0.0:1782759089.260312:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+8:2361:x1869355196938880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759089.260323:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759089.260336:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690e00/0xdd99f5c4777dcab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652c5 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759089.260349:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759089.260382:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+7:2361:x1869355196938880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759089.260389:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:0.0:1782759089.283384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759089.283491:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939136 00000100:00100000:1.0:1782759089.283501:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939136 00000100:00100000:1.0:1782759089.283562:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1809 00000100:00100000:1.0:1782759089.283571:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+7:2360:x1869355196939136:12345-192.168.204.31@tcp:251:mount.lustre.0 00000020:00000080:1.0:1782759089.283612:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dca97 00000020:00010000:1.0:1782759089.283630:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917182e3b800: total 0 00000100:00080000:1.0:1782759089.283634:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917182e38800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759089.283713:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44+3:2360:x1869355196939136:12345-192.168.204.31@tcp:251:mount.lustre.0 Request processed in 143us (344us total) trans 0 rc 0/0 00000020:00010000:3.0:1782759089.284049:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917182e3b800: total 0 00010000:00010000:3.0:1782759089.284184:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917182e3b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759089.284219:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694a00/0xdd99f5c4777dca9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6528d expref: 3 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759089.285902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1809 00010000:00010000:3.0:1782759089.288258:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917182e3b800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782759089.288303:0:5789:0:(genops.c:906:class_export_put()) final put ffff917182e3b800/fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44 00010000:00010000:3.0:1782759089.288400:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759089.288411:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759089.288414:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759089.291997:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff917182e3b800/fd4ebcef-ee8b-45fa-a3bb-21a5fcb3bf44 for MGS 00000020:00000080:0.0:1782759089.292055:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917182e38800 for MGS 00010000:00010000:3.0:1782759089.772779:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782759090.128721:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:0.0:1782759090.128730:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171b760d800/5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:0.0:1782759090.128757:0:102685:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b760d800/5cfede0b-2f0b-46ee-a1e7-848690e865db for lustre-OST0000 00000020:00000080:0.0:1782759090.128798:0:102685:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b7609800 for lustre-OST0000 00000001:00100000:0.0:1782759090.630259:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc 00000001:00080000:0.0:1782759090.630273:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967800 is committed 00000001:00100000:0.0:1782759090.630279:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc 00000020:00000080:0.0:1782759090.630282:0:5824:0:(genops.c:906:class_export_put()) final put ffff9171b760b800/7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc 00000001:00100000:0.0:1782759090.630298:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cfede0b-2f0b-46ee-a1e7-848690e865db 00000001:00080000:0.0:1782759090.630303:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967799 is committed 00000020:00000080:0.0:1782759090.630305:0:5824:0:(genops.c:906:class_export_put()) final put ffff917189071000/5cfede0b-2f0b-46ee-a1e7-848690e865db 00000020:00000080:1.0:1782759090.630348:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b760b800/7b3cfa24-826b-4b49-af0f-d8cf9f7ea5fc for lustre-MDT0000 00000020:00000080:1.0:1782759090.630417:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917189071000/5cfede0b-2f0b-46ee-a1e7-848690e865db for lustre-MDT0000 00000020:00000080:1.0:1782759090.630441:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b760f800 for lustre-MDT0000 00000020:00000080:1.0:1782759090.630449:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189075800 for lustre-MDT0000 00010000:00010000:3.0:1782759090.796135:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759091.119803:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211829248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759091.119899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759091.119970:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829248 00000100:00100000:1.0:1782759091.119977:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829248 00000100:00100000:1.0:1782759091.120029:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1782759091.120037:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211829248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759091.120077:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759091.120119:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211829248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759091.120126:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:1.0:1782759091.120148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759091.120178:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211829248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759091.820920:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759092.844968:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759093.164151:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211829504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759093.164297:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211830016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759093.164353:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211829376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164369:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759093.164378:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211829632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759093.164398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759093.164409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759093.164439:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211829888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164452:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830016 00000100:00100000:0.0:1782759093.164461:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830016 00000100:00100000:1.0:1782759093.164470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759093.164498:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759093.164505:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211829760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164518:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1782759093.164529:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211830016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759093.164536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759093.164567:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829504 00000100:00100000:1.0:1782759093.164572:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829504 00000100:00100000:0.0:1782759093.164590:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211830016:12345-0@lo:400:kworker.0 Request processed in 61us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.164600:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:1.0:1782759093.164605:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829632 00000100:00100000:1.0:1782759093.164610:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829632 00000100:00100000:0.0:1782759093.164618:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829760 00000100:00100000:0.0:1782759093.164623:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829760 00000100:00100000:1.0:1782759093.164632:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829888 00000100:00100000:1.0:1782759093.164636:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829888 00000100:00100000:0.0:1782759093.164652:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1782759093.164658:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211829760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164693:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211829760:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.164700:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1782759093.164730:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1782759093.164737:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211829504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164765:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211829504:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.164774:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1782759093.164791:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1782759093.164797:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211829632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164856:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211829632:12345-0@lo:400:kworker.0 Request processed in 58us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.164862:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00080000:0.0:1782759093.164879:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759093.164884:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759093.164887:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759093.164915:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211829760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759093.164932:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1782759093.164941:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211829888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759093.164943:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759093.164965:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211829632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759093.164980:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211829504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759093.164988:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211829888:12345-0@lo:400:kworker.0 Request processed in 47us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.164993:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211830016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759093.164999:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1782759093.165029:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211829888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759093.165211:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211829376 00000100:00100000:3.0:1782759093.165216:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211829376 00000100:00100000:3.0:1782759093.165250:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:3.0:1782759093.165257:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211829376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759093.165300:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211829376:12345-0@lo:400:kworker.0 Request processed in 44us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759093.165307:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1782759093.165430:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211829376:0@lo:400:kworker.0 00000020:00000080:2.0:1782759093.336717:0:116859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7dff5c50 20000000:00000080:2.0:1782759093.336737:0:116859:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084eed000 uarg=0000000000000000 10000000:01000000:2.0:1782759093.337530:0:116859:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759093.337555:0:116859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759093.337573:0:116859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759093.337583:0:116859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759093.337626:0:116859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759093.337641:0:116859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 18 pid: 5794 timeout: 3261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759093.337657:0:116859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116859:1869355211830144:0@lo:104: 00000100:00100000:2.0:1782759093.337720:0:116859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759093.337861:0:116859:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759093.338014:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830144 00000100:00100000:1.0:1782759093.338022:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830144 00000100:00100000:1.0:1782759093.338103:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1782759093.338114:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116859:x1869355211830144:12345-0@lo:104: 00010000:00010000:1.0:1782759093.338128:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759093.338196:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759093.338203:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:116859:x1869355211830144:12345-0@lo:104: Request processed in 92us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759093.338210:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1782759093.338275:0:116859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:116859:1869355211830144:0@lo:104: 00010000:00010000:3.0:1782759093.338294:0:116859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338359:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759093.338366:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338373:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759093.338378:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338391:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759093.338399:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759093.338405:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759093.338444:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338451:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759093.338471:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338478:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5000/0xdd99f5c4777dca89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dca90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338492:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759093.338493:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759093.338495:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759093.338506:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211830272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759093.338539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759093.338584:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830272 00000100:00100000:0.0:1782759093.338588:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830272 00010000:00010000:0.0:1782759093.338607:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 3261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759093.338629:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1782759093.338636:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211830272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759093.338647:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759093.338652:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 3261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338662:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 3261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338675:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777dca90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dca89 expref: 19 pid: 5794 timeout: 3261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338686:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338695:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338707:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338714:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338719:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338726:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338731:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759093.338735:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338746:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338758:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759093.338766:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759093.338793:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211830272:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759093.338800:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1782759093.338856:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211830272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759093.338928:0:116859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759093.338936:0:116859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759093.338943:0:116859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694800/0xdd99f5c4777dcac1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759093.676198:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759093.676592:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211830400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759093.676664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759093.677343:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830400 00000100:00100000:3.0:1782759093.677351:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830400 00000100:00100000:2.0:1782759093.678174:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1782759093.678187:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211830400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759093.678227:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759093.678307:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211830400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759093.678314:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1782759093.678382:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211830400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759093.868112:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759094.008864:0:116907:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc484333d0 20000000:00000080:0.0:1782759094.008884:0:116907:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082737c00 uarg=0000000000000000 10000000:01000000:0.0:1782759094.009109:0:116907:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759094.009128:0:116907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009143:0:116907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009153:0:116907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009160:0:116907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009167:0:116907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009174:0:116907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009179:0:116907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759094.009183:0:116907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009190:0:116907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009203:0:116907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009210:0:116907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759094.009217:0:116907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe51200/0xdd99f5c4777dcac8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759094.686672:0:116955:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7ea709d0 20000000:00000080:3.0:1782759094.686690:0:116955:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d83400 uarg=0000000000000000 10000000:01000000:3.0:1782759094.687064:0:116955:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759094.687087:0:116955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687104:0:116955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687115:0:116955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687123:0:116955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687129:0:116955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687137:0:116955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687143:0:116955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759094.687148:0:116955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687156:0:116955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687169:0:116955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687176:0:116955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.687183:0:116955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691200/0xdd99f5c4777dcacf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759094.894330:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759095.019947:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759095.019957:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759095.019963:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759095.020012:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.020025:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.020037:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759095.020068:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211830528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759095.020143:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759095.020206:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171982739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759095.020343:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830528 00000100:00100000:1.0:1782759095.020352:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830528 00000100:00100000:1.0:1782759095.020405:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:1.0:1782759095.020416:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211830528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759095.020434:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759095.020447:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dcad6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.020472:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.020483:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.020494:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782759095.020547:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211830528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759095.020554:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:1.0:1782759095.020606:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211830528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759095.020620:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.020630:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759095.020650:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759095.020656:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.020663:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759095.366452:0:117003:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed0b81500 20000000:00000080:3.0:1782759095.366469:0:117003:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d81000 uarg=0000000000000000 10000000:01000000:3.0:1782759095.366917:0:117003:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759095.366937:0:117003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.366954:0:117003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.366964:0:117003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.367002:0:117003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.367018:0:117003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 18 pid: 5796 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759095.367032:0:117003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:117003:1869355211830656:0@lo:104: 00000100:00100000:3.0:1782759095.367092:0:117003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759095.367186:0:117003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171982739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759095.367412:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830656 00000100:00100000:1.0:1782759095.367420:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830656 00000100:00100000:1.0:1782759095.367518:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1782759095.367528:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:117003:x1869355211830656:12345-0@lo:104: 00010000:00010000:1.0:1782759095.367541:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759095.367616:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759095.367622:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:117003:x1869355211830656:12345-0@lo:104: Request processed in 96us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759095.367629:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00010000:00010000:0.0:1782759095.367681:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759095.367687:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759095.367694:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759095.367698:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759095.367711:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759095.367719:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759095.367724:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759095.367758:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759095.367765:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759095.367785:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759095.367792:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b3691200/0xdd99f5c4777dcad6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dcadd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759095.367809:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759095.367811:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759095.367812:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759095.367844:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211830784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759095.367878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759095.368054:0:117003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:117003:1869355211830656:0@lo:104: 00010000:00010000:3.0:1782759095.368072:0:117003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759095.368105:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830784 00000100:00100000:3.0:1782759095.368109:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830784 00010000:00010000:3.0:1782759095.368127:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759095.368156:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1782759095.368163:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211830784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759095.368173:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759095.368177:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368186:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368198:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4c00/0xdd99f5c4777dcadd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dcad6 expref: 19 pid: 5796 timeout: 3263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368219:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368227:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368239:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368247:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368253:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368259:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368264:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759095.368268:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368276:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368303:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368312:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759095.368341:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211830784:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759095.368348:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00010000:00010000:3.0:1782759095.368367:0:117003:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368379:0:117003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759095.368385:0:117003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcae4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759095.369411:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211830784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759095.917021:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759096.004002:0:117054:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec53ab970 20000000:00000080:3.0:1782759096.004020:0:117054:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081254400 uarg=0000000000000000 10000000:01000000:3.0:1782759096.004493:0:117054:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759096.004516:0:117054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004532:0:117054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004542:0:117054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004548:0:117054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004554:0:117054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004560:0:117054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004570:0:117054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b3691e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759096.004575:0:117054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004582:0:117054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004673:0:117054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004683:0:117054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.004690:0:117054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcaeb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 117054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759096.235997:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211830912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759096.236070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759096.236154:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211830912 00000100:00100000:1.0:1782759096.236161:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211830912 00000100:00100000:1.0:1782759096.236221:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1782759096.236232:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211830912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759096.236281:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759096.236332:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211830912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759096.236340:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:1.0:1782759096.236366:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759096.236408:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211830912:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759096.556152:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759096.556159:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759096.556215:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759096.556336:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.556349:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.556361:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759096.556387:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211831040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759096.556474:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759096.556537:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759096.556540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831040 00000100:00100000:0.0:1782759096.556548:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831040 00000100:00100000:0.0:1782759096.556767:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1782759096.556778:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211831040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759096.556794:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759096.556808:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dcaf9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dcaf2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759096.556858:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dcaf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dcaf2 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759096.556871:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50800/0xdd99f5c4777dcaf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dcaf2 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759096.556881:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50800, rc 0) 00000100:00100000:0.0:1782759096.556932:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211831040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759096.556939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1782759096.557026:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211831040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759096.557042:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcaf9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759096.557051:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dcaf9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759096.557075:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759096.557080:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcaf9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759096.557088:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b3690000/0xdd99f5c4777dcaf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dcaf9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759096.941176:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759097.964908:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759098.288314:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211831168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759098.288444:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211831680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759098.288494:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759098.288500:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211831552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759098.288548:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831168 00000100:00100000:2.0:1782759098.288555:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831168 00000100:00100000:2.0:1782759098.288594:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1782759098.288602:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211831168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288652:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211831168:12345-0@lo:400:kworker.0 Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759098.288659:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1782759098.288692:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831552 00000100:00100000:2.0:1782759098.288696:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831552 00000100:00100000:2.0:1782759098.288734:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:2.0:1782759098.288740:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211831552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288772:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211831552:12345-0@lo:400:kworker.0 Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759098.288778:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00080000:2.0:1782759098.288797:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759098.288843:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211831552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759098.288857:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211831168:0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.289843:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211831296:0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.289888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759098.289920:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211831808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.289941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759098.289966:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759098.289972:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211831424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.289994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759098.290026:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831680 00000100:00100000:0.0:1782759098.290031:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831680 00000100:00100000:0.0:1782759098.290065:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831296 00000100:00100000:0.0:1782759098.290068:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831296 00000100:00100000:0.0:1782759098.290082:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831424 00000100:00100000:0.0:1782759098.290085:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831424 00000100:00100000:0.0:1782759098.290101:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1782759098.290108:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211831680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.290151:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211831680:12345-0@lo:400:kworker.0 Request processed in 43us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759098.290158:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1782759098.290171:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1782759098.290177:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.290210:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211831296:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759098.290216:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1782759098.290239:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:0.0:1782759098.290246:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211831424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.290273:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211831424:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759098.290279:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:0.0:1782759098.290313:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211831424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759098.290323:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211831296:0@lo:400:kworker.0 00000100:00080000:2.0:1782759098.290435:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759098.290459:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211831680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759098.293319:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831808 00000100:00100000:3.0:1782759098.293334:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831808 00000100:00100000:3.0:1782759098.293426:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1782759098.293438:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211831808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759098.293535:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211831808:12345-0@lo:400:kworker.0 Request processed in 99us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759098.293559:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:0.0:1782759098.293770:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211831808:0@lo:400:kworker.0 00000100:00080000:0.0:1782759098.293800:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759098.797320:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759098.797346:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211831936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759098.797421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759098.797515:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211831936 00000100:00100000:3.0:1782759098.797523:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211831936 00000100:00100000:3.0:1782759098.797585:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1782759098.797594:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211831936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759098.797634:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759098.797682:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211831936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759098.797689:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1782759098.797750:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211831936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759098.990518:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759100.013169:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759101.036709:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759101.356217:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211832064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759101.356307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759101.356897:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832064 00000100:00100000:1.0:1782759101.356906:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832064 00000100:00100000:1.0:1782759101.356979:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1782759101.356990:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211832064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759101.357027:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759101.359575:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211832064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2571us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759101.359589:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1782759101.360078:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211832064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759101.362110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759102.061668:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759103.029299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759103.029442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939264 00000100:00100000:0.0:1782759103.029453:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939264 00000100:00100000:0.0:1782759103.029504:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:0.0:1782759103.029513:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355196939264:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759103.029543:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bbff858f-c344-4ac1-9fb4-eb0cd4e20565@192.168.204.31@tcp t0 exp 0000000000000000 cur 3171 last 0 00000020:00000080:0.0:1782759103.029573:0:5794:0:(genops.c:1406:class_connect()) connect: client bbff858f-c344-4ac1-9fb4-eb0cd4e20565, cookie 0xdd99f5c4777dcb00 00000100:00080000:0.0:1782759103.029617:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917189071800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759103.030191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+5:2360:x1869355196939264:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 675us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759103.030199:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:0.0:1782759103.036839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759103.037056:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939392 00000100:00100000:2.0:1782759103.037067:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939392 00000100:00100000:2.0:1782759103.037423:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1815 00000100:00100000:2.0:1782759103.037435:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+5:74263:x1869355196939392:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759103.037454:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759103.037471:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694200/0xdd99f5c4777dcb07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf652e8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.037499:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694200/0xdd99f5c4777dcb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652e8 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.037510:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694200/0xdd99f5c4777dcb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652e8 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.037519:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694200, rc 0) 00000100:00100000:2.0:1782759103.037583:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+6:74263:x1869355196939392:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 150us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.037590:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1815 00000100:00100000:3.0:1782759103.039698:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759103.039795:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939520 00000100:00100000:0.0:1782759103.039804:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939520 00000100:00100000:0.0:1782759103.039881:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1816 00000100:00100000:0.0:1782759103.039890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+6:74263:x1869355196939520:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759103.040185:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+6:74263:x1869355196939520:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 295us (495us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759103.040197:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1816 00000100:00100000:1.0:1782759103.042242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759103.042543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939648 00000100:00100000:2.0:1782759103.042552:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939648 00000100:00100000:2.0:1782759103.042655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1817 00000100:00100000:2.0:1782759103.042665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+6:74263:x1869355196939648:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759103.042680:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759103.042693:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694c00/0xdd99f5c4777dcb0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf652ef expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.042714:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694c00/0xdd99f5c4777dcb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652ef expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.042722:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694c00/0xdd99f5c4777dcb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652ef expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759103.042729:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694c00, rc 0) 00000100:00100000:2.0:1782759103.042785:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+7:74263:x1869355196939648:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 122us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.042792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1817 00000100:00100000:2.0:1782759103.044955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.045028:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939776 00000100:00100000:3.0:1782759103.045037:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939776 00000100:00100000:3.0:1782759103.045147:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:3.0:1782759103.045157:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+7:74263:x1869355196939776:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759103.045492:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74263:x1869355196939776:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 336us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.045501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:3.0:1782759103.047337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759103.048685:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196939904 00000100:00100000:2.0:1782759103.048697:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196939904 00000100:00100000:2.0:1782759103.048762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1819 00000100:00100000:2.0:1782759103.048774:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74263:x1869355196939904:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759103.049055:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74263:x1869355196939904:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 283us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.049064:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1819 00000100:00100000:1.0:1782759103.063498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.063691:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940032 00000100:00100000:3.0:1782759103.063702:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940032 00000100:00100000:3.0:1782759103.063763:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1820 00000100:00100000:3.0:1782759103.063774:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74282:x1869355196940032:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759103.064090:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74282:x1869355196940032:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 317us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.064098:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1820 00000100:00100000:3.0:1782759103.074535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759103.074648:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940160 00000100:00100000:0.0:1782759103.074661:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940160 00000100:00100000:0.0:1782759103.074744:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1821 00000100:00100000:0.0:1782759103.074757:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74282:x1869355196940160:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759103.075968:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74282:x1869355196940160:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 1207us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.075979:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1821 00010000:00010000:3.0:1782759103.085012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759103.085658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.086034:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940288 00000100:00100000:3.0:1782759103.086044:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940288 00000100:00100000:3.0:1782759103.086282:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:3.0:1782759103.086293:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:74263:x1869355196940288:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759103.086309:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759103.086326:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691800/0xdd99f5c4777dcb15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65319 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.086355:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691800/0xdd99f5c4777dcb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65319 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.086366:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691800/0xdd99f5c4777dcb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65319 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.086375:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691800, rc 0) 00000100:00100000:3.0:1782759103.086442:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+9:74263:x1869355196940288:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 150us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.086552:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:0.0:1782759103.089448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.089708:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940416 00000100:00100000:1.0:1782759103.089734:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940416 00000100:00100000:1.0:1782759103.089853:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1823 00000100:00100000:1.0:1782759103.090213:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+9:74263:x1869355196940416:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782759103.090255:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782759103.090291:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782759103.090296:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782759103.090299:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782759103.090302:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782759103.092565:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+9:74263:x1869355196940416:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 2347us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.092586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1823 00000100:00100000:0.0:1782759103.097540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.097636:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940544 00000100:00100000:3.0:1782759103.097649:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940544 00000100:00100000:3.0:1782759103.097713:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1824 00000100:00100000:3.0:1782759103.097734:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+9:74263:x1869355196940544:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759103.097757:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759103.097787:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcb1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65320 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.097874:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65320 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.097888:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65320 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759103.097898:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b3691e00, rc 0) 00000100:00100000:3.0:1782759103.097965:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74263:x1869355196940544:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 241us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.097973:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1824 00000100:00100000:0.0:1782759103.101338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.102017:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940672 00000100:00100000:1.0:1782759103.102034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940672 00000100:00100000:1.0:1782759103.102108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1825 00000100:00100000:1.0:1782759103.102190:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74263:x1869355196940672:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759103.102740:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74263:x1869355196940672:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 621us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.102750:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1825 00000100:00100000:3.0:1782759103.105524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759103.105765:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940800 00000100:00100000:2.0:1782759103.105779:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940800 00000100:00100000:2.0:1782759103.105867:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:2.0:1782759103.105877:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74263:x1869355196940800:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759103.106112:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74263:x1869355196940800:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 234us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.106122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:0.0:1782759103.111040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.111371:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196940928 00000100:00100000:1.0:1782759103.111382:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196940928 00000100:00100000:1.0:1782759103.111726:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:1.0:1782759103.111740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74287:x1869355196940928:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759103.112345:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74287:x1869355196940928:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 605us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.112356:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:2.0:1782759103.124564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.124725:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941056 00000100:00100000:3.0:1782759103.124735:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941056 00000100:00100000:3.0:1782759103.124786:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1828 00000100:00100000:3.0:1782759103.124795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74287:x1869355196941056:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759103.125080:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:74287:x1869355196941056:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 285us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.125088:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1828 00000100:00100000:3.0:1782759103.131065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759103.131277:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941184 00000100:00100000:0.0:1782759103.131287:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941184 00000100:00100000:0.0:1782759103.131346:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1327 00000100:00100000:0.0:1782759103.131354:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2360:x1869355196941184:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782759103.132516:0:19544:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8e5f8e19-fe92-4d98-ab69-0cd2a907138a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3171 last 0 00000020:00000080:0.0:1782759103.132558:0:19544:0:(genops.c:1406:class_connect()) connect: client 8e5f8e19-fe92-4d98-ab69-0cd2a907138a, cookie 0xdd99f5c4777dcb23 00000004:00100000:0.0:1782759103.132592:0:19544:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782759103.132872:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917189077000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759103.133079:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:2360:x1869355196941184:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1723us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759103.133090:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1327 00000100:00100000:1.0:1782759103.142322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.142374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.142986:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941440 00000100:00100000:3.0:1782759103.142998:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941440 00000100:00100000:1.0:1782759103.143242:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941312 00000100:00100000:1.0:1782759103.143246:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941312 00000100:00100000:1.0:1782759103.143274:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1328 00000100:00100000:1.0:1782759103.143284:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:74263:x1869355196941440:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759103.143326:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1782759103.143392:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:74263:x1869355196941440:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 109us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.143404:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1328 00000100:00100000:1.0:1782759103.143423:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1329 00000100:00100000:1.0:1782759103.143427:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:0:x1869355196941312:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759103.143436:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1782759103.143451:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:0:x1869355196941312:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 24us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.143455:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1329 00000100:00080000:0.0:1782759103.143515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759103.147410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759103.147521:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941568 00000100:00100000:0.0:1782759103.147531:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941568 00000100:00100000:0.0:1782759103.147594:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1330 00000100:00100000:0.0:1782759103.147603:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:74263:x1869355196941568:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782759103.147699:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:74263:x1869355196941568:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759103.147707:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1330 00000100:00100000:3.0:1782759103.149930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759103.150406:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941696 00000100:00100000:2.0:1782759103.150416:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941696 00000100:00100000:2.0:1782759103.150471:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:2.0:1782759103.150479:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196941696:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759103.150511:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8e5f8e19-fe92-4d98-ab69-0cd2a907138a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3171 last 0 00000020:00000080:2.0:1782759103.150542:0:6598:0:(genops.c:1406:class_connect()) connect: client 8e5f8e19-fe92-4d98-ab69-0cd2a907138a, cookie 0xdd99f5c4777dcb2a 00002000:00100000:2.0:1782759103.150554:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e5f8e19-fe92-4d98-ab69-0cd2a907138a/ffff9171b7608000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759103.150580:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759103.150813:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759103.150864:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171b760c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759103.151580:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:2360:x1869355196941696:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 1096us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.151590:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:0.0:1782759103.151739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.152123:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941824 00000100:00100000:1.0:1782759103.152130:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941824 00000100:00100000:1.0:1782759103.152173:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 728 00000100:00100000:1.0:1782759103.152180:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196941824:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759103.152205:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8e5f8e19-fe92-4d98-ab69-0cd2a907138a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3171 last 0 00000020:00000080:1.0:1782759103.152230:0:6597:0:(genops.c:1406:class_connect()) connect: client 8e5f8e19-fe92-4d98-ab69-0cd2a907138a, cookie 0xdd99f5c4777dcb31 00002000:00100000:1.0:1782759103.152240:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e5f8e19-fe92-4d98-ab69-0cd2a907138a/ffff917081afe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759103.152260:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759103.152438:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759103.152566:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081aff000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759103.152707:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:2360:x1869355196941824:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 521us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.152714:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 728 00000100:00100000:0.0:1782759103.153546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759103.153659:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196941952 00000100:00100000:3.0:1782759103.153670:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196941952 00000100:00100000:3.0:1782759103.153719:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:3.0:1782759103.153728:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:74263:x1869355196941952:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782759103.154127:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782759103.154347:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:74263:x1869355196941952:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 617us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759103.154357:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:2.0:1782759103.241325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.242724:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942080 00000100:00100000:1.0:1782759103.242736:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942080 00000100:00100000:1.0:1782759103.243044:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1331 00000100:00100000:1.0:1782759103.243056:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:74304:x1869355196942080:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759103.243077:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759103.243101:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dcb38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6534a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243170:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243184:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243198:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759103.243413:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759103.243418:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759103.243511:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243536:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dcb38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6534a expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243552:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6534a expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.243561:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759103.243564:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759103.243568:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759103.243634:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:74304:x1869355196942080:12345-192.168.204.31@tcp:101:rm.0 Request processed in 579us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.243641:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1331 00000100:00100000:2.0:1782759103.246441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759103.247882:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942208 00000100:00100000:1.0:1782759103.247894:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942208 00000100:00100000:1.0:1782759103.247959:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1332 00000100:00100000:1.0:1782759103.247969:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:74304:x1869355196942208:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759103.247990:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759103.248009:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dcb46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65351 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248065:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248077:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248102:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248116:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248123:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248129:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248414:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248422:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248437:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248443:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759103.248447:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248454:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248466:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759103.248469:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759103.248472:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248476:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dcb4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248491:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248495:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248498:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248501:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759103.248503:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248509:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248513:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9cd31e70 (ffff9171889c5c00) 00010000:00010000:1.0:1782759103.248514:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759103.248516:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248520:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dcb54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9cd31e70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248548:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dcb46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65351 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248557:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759103.248559:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759103.248563:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dcb46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65351 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759103.248573:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782759103.248648:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:74304:x1869355196942208:12345-192.168.204.31@tcp:101:rm.0 Request processed in 680us (2217us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759103.248655:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1332 00000100:00100000:0.0:1782759103.405858:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211832192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.405931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759103.406043:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832192 00000100:00100000:1.0:1782759103.406052:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832192 00000100:00100000:1.0:1782759103.406103:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:1.0:1782759103.406112:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211832192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406348:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211832192:12345-0@lo:400:kworker.0 Request processed in 236us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.406356:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:1.0:1782759103.406419:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211832448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759103.406470:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759103.406485:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211832320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759103.406540:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832448 00000100:00100000:1.0:1782759103.406543:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832448 00000100:00100000:1.0:1782759103.406571:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832320 00000100:00100000:1.0:1782759103.406573:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832320 00000100:00100000:1.0:1782759103.406587:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1782759103.406593:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406629:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211832448:12345-0@lo:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.406635:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1782759103.406645:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1782759103.406652:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406673:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211832320:12345-0@lo:400:kworker.0 Request processed in 23us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.406678:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1782759103.406778:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211832320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759103.406782:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211832576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.406791:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211832448:0@lo:400:kworker.0 00000100:00080000:1.0:1782759103.406881:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759103.406951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759103.407123:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832576 00000100:00100000:1.0:1782759103.407149:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832576 00000100:00100000:1.0:1782759103.407191:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1782759103.407197:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211832576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.407243:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211832192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.407473:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211832704:0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.407500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759103.407552:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832704 00000100:00100000:0.0:1782759103.407556:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832704 00000100:00100000:0.0:1782759103.407588:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1782759103.407595:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211832704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.407629:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211832704:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759103.407635:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1782759103.407659:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211832704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.407705:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211832576:12345-0@lo:400:kworker.0 Request processed in 505us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759103.407710:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211832576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.407717:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:0.0:1782759103.407735:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211832832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759103.407762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759103.409560:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832832 00000100:00100000:1.0:1782759103.409572:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832832 00000100:00100000:1.0:1782759103.409644:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:1.0:1782759103.409654:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211832832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759103.409752:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211832832:12345-0@lo:400:kworker.0 Request processed in 99us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759103.409759:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00080000:3.0:1782759103.410487:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759103.410494:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759103.410497:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759103.413266:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211832832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759103.916611:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211832960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759103.916700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759103.917171:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211832960 00000100:00100000:3.0:1782759103.917181:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211832960 00000100:00100000:3.0:1782759103.917287:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1782759103.917299:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211832960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759103.917326:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759103.917391:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211832960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759103.917399:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1782759103.917442:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211832960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759104.112811:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759104.458037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.458095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759104.458282:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942336 00000100:00100000:3.0:1782759104.458292:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942336 00000100:00100000:2.0:1782759104.458324:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942464 00000100:00100000:2.0:1782759104.458331:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942464 00000100:00100000:3.0:1782759104.458409:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:3.0:1782759104.458420:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+11:2364:x1869355196942336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759104.458455:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759104.458475:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694c00/0xdd99f5c4777dcb0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652ef expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759104.458492:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759104.458543:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+10:2364:x1869355196942336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.458550:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:3.0:1782759104.458566:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:3.0:1782759104.458571:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+9:2364:x1869355196942464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759104.458579:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759104.458589:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691800/0xdd99f5c4777dcb15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65319 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759104.458597:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759104.458612:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:2364:x1869355196942464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.458618:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1782759104.461416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.461492:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942592 00000100:00100000:0.0:1782759104.461502:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942592 00000100:00100000:2.0:1782759104.461541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.461564:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:0.0:1782759104.461575:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+8:2361:x1869355196942592:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759104.461590:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759104.461608:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691e00/0xdd99f5c4777dcb1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65320 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759104.461623:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759104.461673:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+7:2361:x1869355196942592:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.461681:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:3.0:1782759104.461802:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942720 00000100:00100000:3.0:1782759104.461806:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942720 00000100:00100000:3.0:1782759104.462085:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 729 00000100:00100000:3.0:1782759104.462092:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:2360:x1869355196942720:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782759104.462126:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb31 00000100:00080000:3.0:1782759104.462135:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917081aff000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759104.462173:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:3.0:1782759104.462359:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+3:2360:x1869355196942720:12345-192.168.204.31@tcp:9:umount.0 Request processed in 266us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.462366:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 729 00010000:00010000:3.0:1782759104.462383:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782759104.464207:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759104.466396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.466489:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196942848 00000100:00100000:0.0:1782759104.466499:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196942848 00000100:00100000:0.0:1782759104.466563:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 730 00000100:00100000:0.0:1782759104.466572:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+6:2360:x1869355196942848:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759104.466602:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb2a 00000100:00080000:0.0:1782759104.466609:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9171b760c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759104.466659:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967376 00000100:00080000:3.0:1782759104.466935:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759104.467072:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+3:2360:x1869355196942848:12345-192.168.204.31@tcp:9:umount.0 Request processed in 500us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.467080:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 730 00010000:00010000:2.0:1782759104.467265:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759104.479669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.479786:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943104 00000100:00100000:1.0:1782759104.479796:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943104 00000100:00100000:1.0:1782759104.479901:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1333 00000100:00100000:1.0:1782759104.479913:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+7:2360:x1869355196943104:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1782759104.479952:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb23 00000020:00010000:1.0:1782759104.479961:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917189076000: total 0 00000100:00080000:1.0:1782759104.479965:0:5803:0:(import.c:65:import_set_state_nolock()) ffff917189077000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759104.479995:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967800 00000020:00010000:0.0:1782759104.480569:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917189076000: total 0 00010000:00010000:0.0:1782759104.480575:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759104.480615:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189076000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759104.480645:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:0.0:1782759104.480649:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759104.480657:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dcb3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6534a expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759104.480680:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189076000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759104.480691:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759104.480693:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759104.480695:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759104.480800:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5f8e19-fe92-4d98-ab69-0cd2a907138a+4:2360:x1869355196943104:12345-192.168.204.31@tcp:39:umount.0 Request processed in 888us (1140us total) trans 4294967801 rc 0/0 00000100:00100000:1.0:1782759104.480846:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1333 00000100:00100000:3.0:1782759104.502481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.502629:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943360 00000100:00100000:2.0:1782759104.502640:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943360 00000100:00100000:2.0:1782759104.502702:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:2.0:1782759104.502712:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+7:2360:x1869355196943360:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:2.0:1782759104.502760:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb00 00000020:00010000:2.0:1782759104.502767:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917189075800: total 0 00000100:00080000:2.0:1782759104.502771:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917189071800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782759104.503041:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbff858f-c344-4ac1-9fb4-eb0cd4e20565+3:2360:x1869355196943360:12345-192.168.204.31@tcp:251:umount.0 Request processed in 329us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.503049:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000020:00010000:3.0:1782759104.505708:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917189075800: total 0 00010000:00010000:3.0:1782759104.506029:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917189075800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759104.506130:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694200/0xdd99f5c4777dcb07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf652e8 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759104.506149:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917189075800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782759104.506161:0:5789:0:(genops.c:906:class_export_put()) final put ffff917189075800/bbff858f-c344-4ac1-9fb4-eb0cd4e20565 00010000:00010000:3.0:1782759104.506259:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759104.506262:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759104.506264:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759104.506415:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917189075800/bbff858f-c344-4ac1-9fb4-eb0cd4e20565 for MGS 00000020:00000080:0.0:1782759104.506645:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189071800 for MGS 00000100:00100000:3.0:1782759104.678051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.678169:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943488 00000100:00100000:0.0:1782759104.678180:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943488 00000100:00100000:0.0:1782759104.678237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1831 00000100:00100000:0.0:1782759104.678261:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355196943488:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759104.678290:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 16c92705-da49-46f9-8780-28e2164dae76@192.168.204.31@tcp t0 exp 0000000000000000 cur 3173 last 0 00000020:00000080:0.0:1782759104.678322:0:5796:0:(genops.c:1406:class_connect()) connect: client 16c92705-da49-46f9-8780-28e2164dae76, cookie 0xdd99f5c4777dcb5b 00000100:00080000:0.0:1782759104.678369:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917182e3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759104.678445:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+5:2360:x1869355196943488:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.678453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1831 00000100:00100000:0.0:1782759104.689389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.690563:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943616 00000100:00100000:2.0:1782759104.690577:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943616 00000100:00100000:2.0:1782759104.690643:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1832 00000100:00100000:2.0:1782759104.690653:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+5:74339:x1869355196943616:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759104.690673:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759104.690693:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181695400/0xdd99f5c4777dcb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65366 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.690929:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181695400/0xdd99f5c4777dcb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65366 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.690942:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181695400/0xdd99f5c4777dcb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65366 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.690952:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181695400, rc 0) 00000100:00100000:2.0:1782759104.691019:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+6:74339:x1869355196943616:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 367us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.691027:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1832 00000100:00100000:3.0:1782759104.692956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.693067:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943744 00000100:00100000:1.0:1782759104.693076:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943744 00000100:00100000:1.0:1782759104.693144:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1833 00000100:00100000:1.0:1782759104.693156:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+6:74339:x1869355196943744:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759104.694971:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+6:74339:x1869355196943744:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 1807us (2023us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759104.694985:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1833 00000100:00100000:3.0:1782759104.701230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.701395:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196943872 00000100:00100000:2.0:1782759104.701405:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196943872 00000100:00100000:2.0:1782759104.701527:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:2.0:1782759104.701538:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+6:74339:x1869355196943872:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759104.701557:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759104.701574:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917181694400/0xdd99f5c4777dcb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6536d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.701617:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917181694400/0xdd99f5c4777dcb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6536d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.701628:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917181694400/0xdd99f5c4777dcb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6536d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759104.701642:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694400, rc 0) 00000100:00100000:2.0:1782759104.701708:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+7:74339:x1869355196943872:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 171us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.701715:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:3.0:1782759104.712543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.712764:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944000 00000100:00100000:0.0:1782759104.712774:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944000 00000100:00100000:0.0:1782759104.712863:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1835 00000100:00100000:0.0:1782759104.712873:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+7:74339:x1869355196944000:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759104.713197:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+8:74339:x1869355196944000:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 324us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.713209:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1835 00000100:00100000:3.0:1782759104.714897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.714998:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944128 00000100:00100000:2.0:1782759104.715006:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944128 00000100:00100000:2.0:1782759104.715060:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1836 00000100:00100000:2.0:1782759104.715070:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+8:74339:x1869355196944128:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759104.715671:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+8:74339:x1869355196944128:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 599us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.715680:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1836 00000100:00100000:3.0:1782759104.728011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.728474:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944256 00000100:00100000:1.0:1782759104.728484:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944256 00000100:00100000:1.0:1782759104.728555:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1837 00000100:00100000:1.0:1782759104.728565:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+8:74358:x1869355196944256:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759104.728879:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+8:74358:x1869355196944256:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 313us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759104.728887:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1837 00000100:00100000:3.0:1782759104.746772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.747070:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944384 00000100:00100000:2.0:1782759104.747080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944384 00000100:00100000:2.0:1782759104.747156:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00100000:2.0:1782759104.747168:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+8:74358:x1869355196944384:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759104.748807:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+8:74358:x1869355196944384:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 1635us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.748817:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00100000:3.0:1782759104.754166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.754216:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944512 00000100:00100000:0.0:1782759104.754226:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944512 00000100:00100000:0.0:1782759104.754278:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1839 00000100:00100000:0.0:1782759104.754287:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+8:74339:x1869355196944512:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759104.754304:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759104.754320:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dcb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65397 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759104.754348:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dcb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65397 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759104.754358:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dcb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65397 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759104.754366:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe50c00, rc 0) 00000100:00100000:0.0:1782759104.754431:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+9:74339:x1869355196944512:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 141us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.754437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1839 00000100:00100000:3.0:1782759104.760747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.760902:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944640 00000100:00100000:2.0:1782759104.760911:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944640 00000100:00100000:2.0:1782759104.760968:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1840 00000100:00100000:2.0:1782759104.760979:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+9:74339:x1869355196944640:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782759104.761004:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782759104.761028:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782759104.761033:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782759104.761037:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782759104.761039:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782759104.762914:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+9:74339:x1869355196944640:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1926us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.762928:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1840 00000100:00100000:3.0:1782759104.765478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.765605:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944768 00000100:00100000:1.0:1782759104.765614:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944768 00000100:00100000:1.0:1782759104.765666:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1841 00000100:00100000:1.0:1782759104.765675:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+9:74339:x1869355196944768:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759104.765690:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759104.765705:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcb77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6539e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759104.765741:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6539e expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759104.765762:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6539e expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759104.765771:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759104.765848:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+10:74339:x1869355196944768:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 173us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759104.765856:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1841 00000100:00100000:1.0:1782759104.767711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759104.768070:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196944896 00000100:00100000:3.0:1782759104.768081:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196944896 00000100:00100000:3.0:1782759104.768144:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00100000:3.0:1782759104.768154:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:74339:x1869355196944896:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759104.769942:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:74339:x1869355196944896:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 1779us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.769955:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00100000:2.0:1782759104.773403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.773714:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945024 00000100:00100000:0.0:1782759104.773723:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945024 00000100:00100000:0.0:1782759104.773873:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1843 00000100:00100000:0.0:1782759104.773883:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+10:74339:x1869355196945024:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759104.774121:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+10:74339:x1869355196945024:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 238us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.774129:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1843 00000100:00100000:0.0:1782759104.777922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759104.778327:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945152 00000100:00100000:3.0:1782759104.778337:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945152 00000100:00100000:3.0:1782759104.778435:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1844 00000100:00100000:3.0:1782759104.778445:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:74359:x1869355196945152:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759104.778705:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:74359:x1869355196945152:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 259us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.778714:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1844 00000100:00100000:1.0:1782759104.788012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.792910:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945280 00000100:00100000:2.0:1782759104.792926:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945280 00000100:00100000:2.0:1782759104.793004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1845 00000100:00100000:2.0:1782759104.793014:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+10:74359:x1869355196945280:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759104.793300:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16c92705-da49-46f9-8780-28e2164dae76+10:74359:x1869355196945280:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 285us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.793307:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1845 00000100:00100000:2.0:1782759104.798448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.798496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.798570:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945408 00000100:00100000:1.0:1782759104.798580:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945408 00000100:00100000:1.0:1782759104.798628:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1334 00000100:00100000:1.0:1782759104.798637:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1869355196945408:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759104.798665:0:5801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 15b2f2d2-67f1-417d-8593-3e56b59b032c@192.168.204.31@tcp t0 exp 0000000000000000 cur 3173 last 0 00000020:00000080:1.0:1782759104.798703:0:5801:0:(genops.c:1406:class_connect()) connect: client 15b2f2d2-67f1-417d-8593-3e56b59b032c, cookie 0xdd99f5c4777dcb7e 00000004:00100000:1.0:1782759104.798740:0:5801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759104.798893:0:5801:0:(import.c:65:import_set_state_nolock()) ffff917081af9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759104.798968:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:2360:x1869355196945408:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 330us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759104.798976:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1334 00000100:00100000:3.0:1782759104.799604:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945792 00000100:00100000:3.0:1782759104.799609:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945792 00000100:00100000:3.0:1782759104.799646:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:3.0:1782759104.799654:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:2364:x1869355196945792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759104.800135:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:2364:x1869355196945792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 478us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759104.800143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:2.0:1782759104.803372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759104.803456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.803475:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945664 00000100:00100000:0.0:1782759104.803486:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945664 00000100:00080000:3.0:1782759104.803550:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759104.803557:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945536 00000100:00100000:0.0:1782759104.803562:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945536 00000100:00100000:0.0:1782759104.803593:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1335 00000100:00100000:0.0:1782759104.803603:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+7:74339:x1869355196945664:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:2.0:1782759104.803607:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000004:00000024:0.0:1782759104.803650:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1782759104.803676:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15b2f2d2-67f1-417d-8593-3e56b59b032c+7:0:x1869355196945536:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759104.803695:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782759104.803720:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+7:74339:x1869355196945664:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 116us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.803736:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15b2f2d2-67f1-417d-8593-3e56b59b032c+7:0:x1869355196945536:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.810686:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1335 00000100:00100000:2.0:1782759104.811098:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1336 00000100:00100000:0.0:1782759104.811394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.811482:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196945920 00000100:00100000:1.0:1782759104.811493:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196945920 00000100:00100000:1.0:1782759104.811559:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1337 00000100:00100000:1.0:1782759104.811571:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:74339:x1869355196945920:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782759104.811675:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:74339:x1869355196945920:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759104.811681:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1337 00000100:00100000:1.0:1782759104.814361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.814409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759104.814443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759104.814673:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946304 00000100:00100000:0.0:1782759104.814683:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946304 00000100:00100000:0.0:1782759104.814742:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:0.0:1782759104.814752:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:74339:x1869355196946304:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782759104.815179:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782759104.815326:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:74339:x1869355196946304:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 573us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759104.815333:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:2.0:1782759104.816366:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946048 00000100:00100000:2.0:1782759104.816379:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946048 00000100:00100000:2.0:1782759104.816441:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946176 00000100:00100000:2.0:1782759104.816445:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946176 00000100:00100000:2.0:1782759104.816474:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:2.0:1782759104.816482:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196946048:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759104.816519:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 15b2f2d2-67f1-417d-8593-3e56b59b032c@192.168.204.31@tcp t0 exp 0000000000000000 cur 3173 last 0 00000020:00000080:2.0:1782759104.816563:0:9120:0:(genops.c:1406:class_connect()) connect: client 15b2f2d2-67f1-417d-8593-3e56b59b032c, cookie 0xdd99f5c4777dcb85 00002000:00100000:2.0:1782759104.816576:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15b2f2d2-67f1-417d-8593-3e56b59b032c/ffff9171b760f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759104.816604:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759104.816701:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759104.816913:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171b760b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759104.816967:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:2360:x1869355196946048:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 484us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.816975:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:2.0:1782759104.817152:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:2.0:1782759104.817157:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355196946176:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759104.817174:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 15b2f2d2-67f1-417d-8593-3e56b59b032c@192.168.204.31@tcp t0 exp 0000000000000000 cur 3173 last 0 00000020:00000080:2.0:1782759104.817193:0:9120:0:(genops.c:1406:class_connect()) connect: client 15b2f2d2-67f1-417d-8593-3e56b59b032c, cookie 0xdd99f5c4777dcb8c 00002000:00100000:2.0:1782759104.817199:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15b2f2d2-67f1-417d-8593-3e56b59b032c/ffff9171b760f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759104.817212:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759104.817266:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782759104.817286:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171b7609800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759104.817308:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:2360:x1869355196946176:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 150us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759104.817315:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 732 00010000:00010000:3.0:1782759105.132211:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782759105.520027:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000001:00100000:1.0:1782759105.524544:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000001:00100000:1.0:1782759105.524563:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000020:00000080:1.0:1782759105.524567:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171b7608000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000020:00000080:0.0:1782759105.526859:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b7608000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a for lustre-OST0000 00000020:00000080:0.0:1782759105.526921:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b760c800 for lustre-OST0000 00000001:00100000:1.0:1782759106.015030:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000001:00100000:1.0:1782759106.015052:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000001:00100000:1.0:1782759106.015057:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000001:00080000:1.0:1782759106.015064:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967801 is committed 00000020:00000080:1.0:1782759106.015069:0:5824:0:(genops.c:906:class_export_put()) final put ffff917189076000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000020:00000080:2.0:1782759106.015254:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917189076000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a for lustre-MDT0000 00000020:00000080:2.0:1782759106.015319:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917189077000 for lustre-MDT0000 00010000:00010000:0.0:1782759106.158567:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759106.480088:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759106.480110:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211833088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759106.480179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759106.480330:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833088 00000100:00100000:0.0:1782759106.480338:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833088 00000100:00100000:0.0:1782759106.480406:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1782759106.480416:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211833088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759106.480442:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759106.480488:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211833088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759106.480496:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00080000:1.0:1782759106.480535:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759106.480574:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211833088:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1782759106.536483:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000001:00100000:2.0:1782759106.537286:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000001:00100000:2.0:1782759106.537450:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000020:00000080:2.0:1782759106.537455:0:7507:0:(genops.c:906:class_export_put()) final put ffff917081afe000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a 00000020:00000080:3.0:1782759106.537529:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917081afe000/8e5f8e19-fe92-4d98-ab69-0cd2a907138a for lustre-OST0001 00000020:00000080:3.0:1782759106.537699:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081aff000 for lustre-OST0001 00010000:00010000:2.0:1782759107.181449:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759107.643418:0:117552:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 37: simple encrypted file ============= 14:51:45 (1782759105) 00010000:00010000:3.0:1782759108.204080:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759108.528909:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211833344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759108.528982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759108.529062:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211833856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759108.529074:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833344 00000100:00100000:1.0:1782759108.529084:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833344 00000100:00100000:0.0:1782759108.529093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759108.529118:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759108.529125:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211833472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759108.529141:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:0.0:1782759108.529154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759108.529156:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211833344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759108.529196:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833472 00000100:00100000:0.0:1782759108.529201:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833472 00000100:00100000:1.0:1782759108.529238:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211833344:12345-0@lo:400:kworker.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759108.529239:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:0.0:1782759108.529252:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211833472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759108.529253:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00080000:1.0:1782759108.529286:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759108.529296:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211833472:12345-0@lo:400:kworker.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759108.529304:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1782759108.529325:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211833472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759108.529347:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211833344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529501:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211833216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759108.529582:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211833728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759108.529631:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759108.529636:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170893a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211833600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759108.529691:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833728 00000100:00100000:2.0:1782759108.529695:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833728 00000100:00100000:2.0:1782759108.529728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1782759108.529734:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211833728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529769:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211833728:12345-0@lo:400:kworker.0 Request processed in 34us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759108.529774:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1782759108.529797:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833856 00000100:00100000:2.0:1782759108.529800:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833856 00000100:00100000:2.0:1782759108.529847:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833600 00000100:00100000:2.0:1782759108.529850:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833600 00000100:00100000:2.0:1782759108.529874:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1782759108.529880:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170893a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211833856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529915:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170893a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211833856:12345-0@lo:400:kworker.0 Request processed in 35us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759108.529920:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1782759108.529932:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1782759108.529938:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211833600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.529963:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211833600:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759108.529969:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00080000:2.0:1782759108.529988:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759108.529991:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759108.529993:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759108.530009:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211833600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.530018:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211833728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759108.530056:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211833856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759108.530289:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833216 00000100:00100000:0.0:1782759108.530294:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833216 00000100:00100000:0.0:1782759108.530328:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1782759108.530335:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211833216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759108.530378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211833216:12345-0@lo:400:kworker.0 Request processed in 43us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759108.530384:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1782759108.530447:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170893a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211833216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759109.040234:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759109.040265:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211833984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759109.040366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759109.044708:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211833984 00000100:00100000:3.0:1782759109.044729:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211833984 00000100:00100000:3.0:1782759109.046340:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1782759109.046363:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211833984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759109.046422:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759109.046552:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211833984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759109.046560:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1782759109.046667:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211833984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759109.228785:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759109.673795:0:117600:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_37 ldiskfs only test (using debugfs) 00010000:00010000:2.0:1782759110.252023:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759110.327014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759110.327056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759110.327095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759110.327132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759110.327261:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946432 00000100:00100000:3.0:1782759110.327272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946432 00000100:00100000:3.0:1782759110.327329:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1848 00000100:00100000:3.0:1782759110.327340:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:2364:x1869355196946432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759110.327412:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16c92705-da49-46f9-8780-28e2164dae76+10:2364:x1869355196946432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759110.327420:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1848 00000100:00100000:0.0:1782759110.327888:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946560 00000100:00100000:0.0:1782759110.327894:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946560 00000100:00100000:0.0:1782759110.327961:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2285 00000100:00100000:0.0:1782759110.327970:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759110.328020:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759110.328027:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2285 00000100:00080000:3.0:1782759110.328117:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759110.329074:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946688 00000100:00100000:2.0:1782759110.329084:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946688 00000100:00100000:2.0:1782759110.329150:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946816 00000100:00100000:2.0:1782759110.329154:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946816 00000100:00100000:2.0:1782759110.329190:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1755 00000100:00100000:2.0:1782759110.329200:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759110.329262:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759110.329269:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1755 00000100:00100000:2.0:1782759110.329283:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1756 00000100:00100000:2.0:1782759110.329290:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759110.329312:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2364:x1869355196946816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759110.329329:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1756 00000100:00080000:3.0:1782759110.329388:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759110.329392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1782759110.903604:0:117649:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 38: encrypted file with hole ========== 14:51:48 (1782759108) 00010000:00010000:3.0:1782759111.276329:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759111.612190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759111.612216:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211834112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759111.612295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759111.612370:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834112 00000100:00100000:3.0:1782759111.612377:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834112 00000100:00100000:3.0:1782759111.612437:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1782759111.612446:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211834112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759111.612490:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759111.612537:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211834112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759111.612545:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1782759111.612566:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759111.612605:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211834112:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1782759112.095252:0:117697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_38 skip ZFS backend 00010000:00010000:0.0:1782759112.302057:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759113.324283:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759113.415067:0:117745:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 39: rewrite data in already encrypted page ========================================================== 14:51:51 (1782759111) 00000100:00100000:0.0:1782759113.644971:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759113.645117:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211834368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759113.645254:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759113.645260:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211834496:0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759113.645305:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834368 00000100:00100000:2.0:1782759113.645311:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834368 00000100:00100000:2.0:1782759113.645343:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834496 00000100:00100000:2.0:1782759113.645344:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834496 00000100:00100000:2.0:1782759113.645365:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1782759113.645371:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211834368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645415:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211834368:12345-0@lo:400:kworker.0 Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759113.645420:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1782759113.645433:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:2.0:1782759113.645437:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211834496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759113.645442:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759113.645457:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211834624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645484:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211834496:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759113.645491:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:3.0:1782759113.645499:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782759113.645516:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759113.645531:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834624 00000100:00100000:2.0:1782759113.645534:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834624 00000100:00100000:2.0:1782759113.645570:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1782759113.645577:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211834496:0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645584:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211834624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759113.645606:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211834368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.645628:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211834624:12345-0@lo:400:kworker.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759113.645640:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1782759113.645646:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211834624:0@lo:400:kworker.0 00000100:00080000:2.0:1782759113.645659:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759113.646073:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211834240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759113.646113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759113.646198:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834240 00000100:00100000:2.0:1782759113.646203:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834240 00000100:00100000:2.0:1782759113.646243:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1782759113.646250:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211834240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759113.646294:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211834240:12345-0@lo:400:kworker.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759113.646300:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:0.0:1782759113.646480:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211834240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759113.646689:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211834752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759113.646719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759113.646777:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834752 00000100:00100000:0.0:1782759113.646781:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834752 00000100:00100000:0.0:1782759113.646838:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:0.0:1782759113.646845:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211834752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759113.646969:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211834880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759113.647001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759113.647035:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211834880 00000100:00100000:1.0:1782759113.647038:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211834880 00000100:00100000:1.0:1782759113.647066:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1782759113.647073:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211834880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759113.647109:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211834880:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759113.647115:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1782759113.647149:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211834880:0@lo:400:kworker.0 00000100:00080000:2.0:1782759113.647216:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759113.647221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759113.647317:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211834752:12345-0@lo:400:kworker.0 Request processed in 472us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759113.647324:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1782759113.647370:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211834752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759113.732912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759113.732986:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196946944 00000100:00100000:2.0:1782759113.732999:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196946944 00000100:00100000:2.0:1782759113.733074:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00100000:2.0:1782759113.733084:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:75154:x1869355196946944:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:2.0:1782759113.733110:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759113.733134:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dcb93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf653c8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733192:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733205:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733219:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759113.733352:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782759113.733436:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759113.733441:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759113.733523:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733548:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694000/0xdd99f5c4777dcb93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653c8 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733564:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653c8 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759113.733573:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6e00) 00010000:00010000:2.0:1782759113.733576:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759113.733579:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917181694a00, rc 0) 00000100:00100000:2.0:1782759113.733642:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:75154:x1869355196946944:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 558us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759113.733650:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1338 00000100:00100000:2.0:1782759114.157367:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211835008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759114.157457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759114.157623:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211835008 00000100:00100000:3.0:1782759114.157630:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211835008 00000100:00100000:3.0:1782759114.157684:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1782759114.157693:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211835008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759114.157727:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759114.158323:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211835008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 627us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759114.158332:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1782759114.159575:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211835008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759114.349183:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759114.759392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759114.759423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759114.759468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759114.759559:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947200 00000100:00100000:1.0:1782759114.759570:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947200 00000100:00100000:1.0:1782759114.759639:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947072 00000100:00100000:1.0:1782759114.759642:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947072 00000100:00100000:1.0:1782759114.759655:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947328 00000100:00100000:1.0:1782759114.759658:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947328 00000100:00100000:1.0:1782759114.759674:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:1.0:1782759114.759684:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171a9382850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+12:2361:x1869355196947200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759114.759703:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759114.759723:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91719fe50c00/0xdd99f5c4777dcb70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65397 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759114.759742:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759114.759793:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171a9382850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+11:2361:x1869355196947200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 109us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759114.759801:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:1.0:1782759114.759898:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:1.0:1782759114.759915:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+10:2361:x1869355196947072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759114.759923:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759114.759932:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181694400/0xdd99f5c4777dcb69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6536d expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759114.759942:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759114.759960:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+9:2361:x1869355196947072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759114.759967:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:1.0:1782759114.759980:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:1.0:1782759114.759986:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+8:2361:x1869355196947328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759114.759993:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759114.760001:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcb77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6539e expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759114.760009:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759114.760026:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c92705-da49-46f9-8780-28e2164dae76+7:2361:x1869355196947328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759114.760032:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:1.0:1782759114.761111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759114.761180:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947456 00000100:00100000:2.0:1782759114.761187:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947456 00000100:00100000:2.0:1782759114.761248:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:2.0:1782759114.761257:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2360:x1869355196947456:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1782759114.761284:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb8c 00000100:00080000:2.0:1782759114.761293:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171b7609800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759114.761337:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:2.0:1782759114.761682:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+2:2360:x1869355196947456:12345-192.168.204.31@tcp:9:umount.0 Request processed in 427us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759114.761690:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00080000:0.0:1782759114.761900:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759114.761961:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759114.768016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759114.768129:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947584 00000100:00100000:0.0:1782759114.768140:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947584 00000100:00080000:2.0:1782759114.768194:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759114.768201:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 734 00000100:00100000:0.0:1782759114.768210:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+5:2360:x1869355196947584:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759114.768241:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb85 00000100:00080000:0.0:1782759114.768250:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171b760b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759114.768296:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967376 00000100:00100000:0.0:1782759114.768684:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15b2f2d2-67f1-417d-8593-3e56b59b032c+2:2360:x1869355196947584:12345-192.168.204.31@tcp:9:umount.0 Request processed in 474us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759114.768693:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 734 00010000:00010000:3.0:1782759114.769487:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759114.785555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759114.785803:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196947840 00000100:00100000:1.0:1782759114.785814:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196947840 00000100:00100000:1.0:1782759114.785902:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1339 00000100:00100000:1.0:1782759114.785923:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+6:2360:x1869355196947840:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1782759114.785961:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb7e 00000020:00010000:1.0:1782759114.785970:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917081aff800: total 0 00000100:00080000:1.0:1782759114.785975:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917081af9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759114.786004:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967801 00000020:00010000:3.0:1782759114.786706:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917081aff800: total 0 00010000:00010000:3.0:1782759114.786754:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917081aff800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759114.786787:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6e00) 00010000:00010000:3.0:1782759114.786791:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759114.786803:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917181694a00/0xdd99f5c4777dcb9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653c8 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759114.786865:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917081aff800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759114.786879:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759114.786881:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759114.786884:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759114.786943:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15b2f2d2-67f1-417d-8593-3e56b59b032c+3:2360:x1869355196947840:12345-192.168.204.31@tcp:39:umount.0 Request processed in 1022us (1399us total) trans 4294967802 rc 0/0 00000100:00100000:1.0:1782759114.786952:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1339 00000100:00100000:2.0:1782759114.836161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759114.836303:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948096 00000100:00100000:1.0:1782759114.836316:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948096 00000100:00100000:1.0:1782759114.836410:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000100:00100000:1.0:1782759114.836422:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+7:2360:x1869355196948096:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:1.0:1782759114.836466:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dcb5b 00000020:00010000:1.0:1782759114.836473:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917182e38800: total 0 00000100:00080000:1.0:1782759114.836477:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917182e3c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759114.836563:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16c92705-da49-46f9-8780-28e2164dae76+3:2360:x1869355196948096:12345-192.168.204.31@tcp:251:umount.0 Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759114.836570:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000020:00010000:0.0:1782759114.836819:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917182e38800: total 0 00010000:00010000:0.0:1782759114.836848:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759114.836895:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917182e38800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759114.836941:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917181695400/0xdd99f5c4777dcb62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65366 expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759114.836962:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917182e38800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782759114.836972:0:5788:0:(genops.c:906:class_export_put()) final put ffff917182e38800/16c92705-da49-46f9-8780-28e2164dae76 00010000:00010000:0.0:1782759114.836995:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759114.836997:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759114.836999:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759114.837143:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917182e38800/16c92705-da49-46f9-8780-28e2164dae76 for MGS 00000020:00000080:3.0:1782759114.837190:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917182e3c800 for MGS 00000100:00100000:2.0:1782759115.074281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.074442:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948224 00000100:00100000:0.0:1782759115.074459:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948224 00000100:00100000:0.0:1782759115.074524:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1851 00000100:00100000:0.0:1782759115.074534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1869355196948224:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782759115.074565:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 17ba5bd4-c8cb-4332-9103-15c1ecfa1fef@192.168.204.31@tcp t0 exp 0000000000000000 cur 3183 last 0 00000020:00000080:0.0:1782759115.074595:0:5793:0:(genops.c:1406:class_connect()) connect: client 17ba5bd4-c8cb-4332-9103-15c1ecfa1fef, cookie 0xdd99f5c4777dcba1 00000100:00080000:0.0:1782759115.074658:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917189076000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759115.074811:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+5:2360:x1869355196948224:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 276us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.074820:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1851 00000100:00100000:3.0:1782759115.086525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.086662:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948352 00000100:00100000:1.0:1782759115.086676:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948352 00000100:00100000:1.0:1782759115.086783:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1852 00000100:00100000:1.0:1782759115.086795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+5:75174:x1869355196948352:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759115.086817:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759115.086867:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf653dd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.086917:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653dd expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.086931:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dcba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653dd expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.086942:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759115.087022:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+6:75174:x1869355196948352:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 229us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.087030:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1852 00000100:00100000:2.0:1782759115.094537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.095820:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948480 00000100:00100000:0.0:1782759115.095879:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948480 00000100:00100000:0.0:1782759115.095961:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1853 00000100:00100000:0.0:1782759115.095971:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+6:75174:x1869355196948480:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759115.096278:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+6:75174:x1869355196948480:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 306us (1753us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759115.096288:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1853 00000100:00100000:2.0:1782759115.107708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.107888:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948608 00000100:00100000:1.0:1782759115.107914:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948608 00000100:00100000:1.0:1782759115.107983:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00100000:1.0:1782759115.107997:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+6:75174:x1869355196948608:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759115.108021:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759115.108043:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dcbaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf653e4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.108081:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dcbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653e4 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.108094:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dcbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf653e4 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.108106:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759115.108178:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+7:75174:x1869355196948608:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 185us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.108186:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00100000:3.0:1782759115.109752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.109937:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948736 00000100:00100000:0.0:1782759115.109948:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948736 00000100:00100000:0.0:1782759115.110005:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1855 00000100:00100000:0.0:1782759115.110014:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+7:75174:x1869355196948736:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759115.110345:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75174:x1869355196948736:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 329us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.110354:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1855 00000100:00100000:2.0:1782759115.113865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.113975:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948864 00000100:00100000:3.0:1782759115.113989:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948864 00000100:00100000:3.0:1782759115.114055:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1856 00000100:00100000:3.0:1782759115.114067:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75174:x1869355196948864:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759115.114387:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75174:x1869355196948864:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.114396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1856 00000100:00100000:2.0:1782759115.117340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.117450:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196948992 00000100:00100000:1.0:1782759115.117465:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196948992 00000100:00100000:1.0:1782759115.117542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1857 00000100:00100000:1.0:1782759115.117553:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75193:x1869355196948992:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759115.117922:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75193:x1869355196948992:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 369us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.117931:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1857 00000100:00100000:2.0:1782759115.128732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.128865:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949120 00000100:00100000:3.0:1782759115.128879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949120 00000100:00100000:3.0:1782759115.129028:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:3.0:1782759115.129041:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75193:x1869355196949120:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759115.129428:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75193:x1869355196949120:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 388us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.129438:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:2.0:1782759115.133527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.133804:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949248 00000100:00100000:0.0:1782759115.133817:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949248 00000100:00100000:0.0:1782759115.133925:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1859 00000100:00100000:0.0:1782759115.133938:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+8:75174:x1869355196949248:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759115.133965:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759115.134003:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dcbb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6540e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.134040:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dcbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6540e expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.134054:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91719fe51e00/0xdd99f5c4777dcbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6540e expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.134069:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51e00, rc 0) 00000100:00100000:0.0:1782759115.134150:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+9:75174:x1869355196949248:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 214us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.134158:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1859 00000100:00100000:2.0:1782759115.142965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.143082:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949376 00000100:00100000:3.0:1782759115.143098:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949376 00000100:00100000:3.0:1782759115.143155:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1860 00000100:00100000:3.0:1782759115.143165:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+9:75174:x1869355196949376:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782759115.143206:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782759115.143241:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782759115.143245:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782759115.143249:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782759115.143251:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782759115.147575:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+9:75174:x1869355196949376:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 4392us (4608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.147594:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1860 00000100:00100000:2.0:1782759115.153318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.153457:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949504 00000100:00100000:1.0:1782759115.153473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949504 00000100:00100000:1.0:1782759115.153602:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1861 00000100:00100000:1.0:1782759115.153615:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+9:75174:x1869355196949504:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759115.153639:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759115.153663:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dcbbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65415 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.153704:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dcbbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65415 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.153719:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777dcbbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65415 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759115.153730:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759115.153870:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75174:x1869355196949504:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 256us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.153877:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1861 00000100:00100000:2.0:1782759115.155482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.157001:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949632 00000100:00100000:0.0:1782759115.157019:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949632 00000100:00100000:0.0:1782759115.157089:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:0.0:1782759115.157100:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75174:x1869355196949632:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759115.157712:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75174:x1869355196949632:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 611us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.157723:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:2.0:1782759115.165556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.165695:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949760 00000100:00100000:1.0:1782759115.165707:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949760 00000100:00100000:1.0:1782759115.165961:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1863 00000100:00100000:1.0:1782759115.165977:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75174:x1869355196949760:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759115.166403:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75174:x1869355196949760:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 428us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.166413:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1863 00000100:00100000:2.0:1782759115.173015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.173357:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196949888 00000100:00100000:3.0:1782759115.173370:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196949888 00000100:00100000:3.0:1782759115.173431:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1864 00000100:00100000:3.0:1782759115.173443:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75196:x1869355196949888:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759115.173869:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75196:x1869355196949888:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 424us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.173879:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1864 00000100:00100000:2.0:1782759115.195430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759115.195541:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950016 00000100:00100000:1.0:1782759115.195555:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950016 00000100:00100000:1.0:1782759115.195625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1865 00000100:00100000:1.0:1782759115.195637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75196:x1869355196950016:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759115.196219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17ba5bd4-c8cb-4332-9103-15c1ecfa1fef+10:75196:x1869355196950016:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 580us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.196229:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1865 00000100:00100000:2.0:1782759115.204606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.204856:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950144 00000100:00100000:0.0:1782759115.204870:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950144 00000100:00100000:0.0:1782759115.204934:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00100000:0.0:1782759115.204945:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1869355196950144:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782759115.204986:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bc467066-7296-4ab5-ba08-f16beeef3998@192.168.204.31@tcp t0 exp 0000000000000000 cur 3183 last 0 00000020:00000080:0.0:1782759115.205377:0:5803:0:(genops.c:1406:class_connect()) connect: client bc467066-7296-4ab5-ba08-f16beeef3998, cookie 0xdd99f5c4777dcbc4 00000004:00100000:0.0:1782759115.205533:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782759115.205767:0:5803:0:(import.c:65:import_set_state_nolock()) ffff917189075800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759115.205955:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc467066-7296-4ab5-ba08-f16beeef3998+6:2360:x1869355196950144:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1009us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.205966:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1340 00000100:00100000:2.0:1782759115.213116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759115.213225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.213556:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950400 00000100:00100000:0.0:1782759115.213572:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950400 00000100:00100000:0.0:1782759115.213663:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950272 00000100:00100000:0.0:1782759115.213666:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950272 00000100:00100000:0.0:1782759115.213705:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1341 00000100:00100000:0.0:1782759115.213716:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc467066-7296-4ab5-ba08-f16beeef3998+7:75174:x1869355196950400:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782759115.213780:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782759115.213912:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc467066-7296-4ab5-ba08-f16beeef3998+7:75174:x1869355196950400:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 196us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.213921:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1341 00000100:00100000:0.0:1782759115.213944:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00100000:0.0:1782759115.213951:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc467066-7296-4ab5-ba08-f16beeef3998+6:0:x1869355196950272:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782759115.213963:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1782759115.213984:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc467066-7296-4ab5-ba08-f16beeef3998+6:0:x1869355196950272:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.213991:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1342 00000100:00080000:2.0:1782759115.214148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759115.216730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.216975:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950528 00000100:00100000:0.0:1782759115.216988:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950528 00000100:00100000:0.0:1782759115.217093:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1343 00000100:00100000:0.0:1782759115.217105:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc467066-7296-4ab5-ba08-f16beeef3998+6:75174:x1869355196950528:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782759115.217234:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc467066-7296-4ab5-ba08-f16beeef3998+6:75174:x1869355196950528:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 130us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.217244:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1343 00000100:00100000:2.0:1782759115.220471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759115.220522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.220656:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950656 00000100:00100000:3.0:1782759115.220670:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950656 00000100:00100000:3.0:1782759115.220738:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950784 00000100:00100000:3.0:1782759115.220741:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950784 00000100:00100000:3.0:1782759115.220768:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 735 00000100:00100000:3.0:1782759115.220777:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355196950656:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782759115.220846:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bc467066-7296-4ab5-ba08-f16beeef3998@192.168.204.31@tcp t0 exp 0000000000000000 cur 3183 last 0 00000020:00000080:3.0:1782759115.220890:0:6597:0:(genops.c:1406:class_connect()) connect: client bc467066-7296-4ab5-ba08-f16beeef3998, cookie 0xdd99f5c4777dcbcb 00002000:00100000:3.0:1782759115.220915:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc467066-7296-4ab5-ba08-f16beeef3998/ffff9171bc19a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759115.220949:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782759115.220961:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:1.0:1782759115.220970:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355196950784:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759115.220991:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bc467066-7296-4ab5-ba08-f16beeef3998@192.168.204.31@tcp t0 exp 0000000000000000 cur 3183 last 0 00000020:00000080:1.0:1782759115.221023:0:6598:0:(genops.c:1406:class_connect()) connect: client bc467066-7296-4ab5-ba08-f16beeef3998, cookie 0xdd99f5c4777dcbd2 00002000:00100000:1.0:1782759115.221032:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc467066-7296-4ab5-ba08-f16beeef3998/ffff917081afc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759115.221040:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782759115.221080:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782759115.221121:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9171bc198800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1782759115.221123:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759115.221147:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917081afe000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759115.221355:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc467066-7296-4ab5-ba08-f16beeef3998+6:2360:x1869355196950656:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 577us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.221365:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 735 00000100:00100000:1.0:1782759115.224779:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc467066-7296-4ab5-ba08-f16beeef3998+6:2360:x1869355196950784:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 3792us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759115.224799:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:3.0:1782759115.229046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.229171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196950912 00000100:00100000:0.0:1782759115.229186:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196950912 00000100:00100000:0.0:1782759115.229276:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:0.0:1782759115.229288:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc467066-7296-4ab5-ba08-f16beeef3998+6:75174:x1869355196950912:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782759115.229611:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782759115.229775:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc467066-7296-4ab5-ba08-f16beeef3998+6:75174:x1869355196950912:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 487us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.229784:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00010000:00010000:3.0:1782759115.372251:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759115.392992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.396020:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196951040 00000100:00100000:0.0:1782759115.396044:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196951040 00000100:00100000:0.0:1782759115.396150:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1344 00000100:00100000:0.0:1782759115.396165:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc467066-7296-4ab5-ba08-f16beeef3998+6:75213:x1869355196951040:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1782759115.396196:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759115.396230:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6543f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396316:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396333:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396346:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759115.396622:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759115.396627:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759115.396713:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396744:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6543f expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396771:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6543f expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.396782:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759115.396785:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759115.396789:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51800, rc 0) 00000100:00100000:0.0:1782759115.398098:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc467066-7296-4ab5-ba08-f16beeef3998+7:75213:x1869355196951040:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 1928us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.398109:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1344 00000100:00100000:2.0:1782759115.442314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759115.442649:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196951168 00000100:00100000:3.0:1782759115.442673:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196951168 00000100:00100000:3.0:1782759115.442754:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:3.0:1782759115.442766:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc467066-7296-4ab5-ba08-f16beeef3998+7:75213:x1869355196951168:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:3.0:1782759115.443000:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc467066-7296-4ab5-ba08-f16beeef3998+7:75213:x1869355196951168:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 233us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759115.443010:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:2.0:1782759115.456659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.456938:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196951424 00000100:00100000:0.0:1782759115.456952:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196951424 00000100:00100000:0.0:1782759115.457039:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1345 00000100:00100000:0.0:1782759115.457051:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bc467066-7296-4ab5-ba08-f16beeef3998+7:75213:x1869355196951424:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759115.457122:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759115.457158:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcbe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6543f expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.457183:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759115.457196:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759115.457583:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.457603:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.457617:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.459744:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.459769:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.459782:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759115.461599:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 1024 00010000:00010000:0.0:1782759115.461616:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461627:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461635:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461641:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759115.461646:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461653:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461669:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759115.461672:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759115.461677:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.461688:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbe7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759115.461707:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f4b66ba reply state 0000000020466997 transno 4294967803 ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759115.461716:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759115.461857:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bc467066-7296-4ab5-ba08-f16beeef3998+8:75213:x1869355196951424:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 4774us (5184us total) trans 4294967803 rc 0/0 00000100:00100000:0.0:1782759115.461866:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1345 00010000:00010000:0.0:1782759115.463621:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463637:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463644:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463650:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759115.463654:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463661:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463676:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdda7411e (ffff917183a70d00) 00010000:00010000:0.0:1782759115.463679:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759115.463683:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.463694:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759115.603056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.603644:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196951552 00000100:00100000:0.0:1782759115.603654:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196951552 00000100:00100000:0.0:1782759115.603882:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1346 00000100:00100000:0.0:1782759115.603907:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc467066-7296-4ab5-ba08-f16beeef3998+7:75220:x1869355196951552:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759115.603931:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759115.603955:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf65446 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604022:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604053:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604068:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759115.604130:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759115.604134:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759115.604161:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604185:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50400/0xdd99f5c4777dcbf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65446 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604203:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51200/0xdd99f5c4777dcbfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf65446 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.604225:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759115.604229:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759115.604232:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51200, rc 0) 00000100:00100000:0.0:1782759115.604297:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc467066-7296-4ab5-ba08-f16beeef3998+8:75220:x1869355196951552:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 404us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.604303:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1346 00000100:00100000:2.0:1782759115.608301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759115.608902:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355196951680 00000100:00100000:0.0:1782759115.608913:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355196951680 00000100:00100000:0.0:1782759115.608983:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1347 00000100:00100000:0.0:1782759115.608999:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc467066-7296-4ab5-ba08-f16beeef3998+8:75220:x1869355196951680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759115.609022:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759115.609041:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcc03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6544d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609099:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609113:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609123:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609137:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609144:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609155:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609269:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dcc18 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609277:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dcc18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609284:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dcc18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759115.609317:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 1024 00000004:00200000:0.0:1782759115.609321:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759115.609350:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dcc18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609361:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609367:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609374:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609379:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe50000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759115.609383:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609389:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609402:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759115.609405:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759115.609409:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609415:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe50000/0xdd99f5c4777dcc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609427:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609433:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609439:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609444:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91719fe51600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759115.609447:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609453:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609460:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdda7411e (ffff917183a70100) 00010000:00010000:0.0:1782759115.609462:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759115.609465:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609471:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51600/0xdd99f5c4777dcc11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdda7411e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609504:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51800/0xdd99f5c4777dcc03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6544d expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609517:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91719fe51c00/0xdd99f5c4777dcc18 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6544d expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759115.609524:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759115.609526:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759115.609528:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91719fe51c00, rc 0) 00000100:00100000:0.0:1782759115.609610:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc467066-7296-4ab5-ba08-f16beeef3998+9:75220:x1869355196951680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 618us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759115.609617:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1347 00000001:00100000:1.0:1782759115.734803:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000020:00000080:1.0:1782759115.734811:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171b760f000/15b2f2d2-67f1-417d-8593-3e56b59b032c 00000001:00100000:1.0:1782759115.735380:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc467066-7296-4ab5-ba08-f16beeef3998 00000020:00000080:3.0:1782759115.735415:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b760f000/15b2f2d2-67f1-417d-8593-3e56b59b032c for lustre-OST0000 00000020:00000080:3.0:1782759115.735548:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b760b800 for lustre-OST0000 00000001:00080000:0.0:1782759116.270109:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967803 is committed 00000001:00100000:0.0:1782759116.270126:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc467066-7296-4ab5-ba08-f16beeef3998 00000001:00100000:0.0:1782759116.270133:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000001:00080000:0.0:1782759116.270140:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967802 is committed 00000020:00000080:0.0:1782759116.270143:0:5824:0:(genops.c:906:class_export_put()) final put ffff917081aff800/15b2f2d2-67f1-417d-8593-3e56b59b032c 00000020:00000080:2.0:1782759116.270205:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917081aff800/15b2f2d2-67f1-417d-8593-3e56b59b032c for lustre-MDT0000 00000020:00000080:2.0:1782759116.270262:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081af9000 for lustre-MDT0000 00010000:00010000:3.0:1782759116.396553:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759116.716016:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211835136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759116.716104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759116.716199:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211835136 00000100:00100000:1.0:1782759116.716206:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211835136 00000100:00100000:1.0:1782759116.716286:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1782759116.716297:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211835136:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759116.716304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782759116.716336:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759116.716383:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211835136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759116.716391:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1782759116.716450:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211835136:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782759116.757200:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc467066-7296-4ab5-ba08-f16beeef3998 00000001:00100000:0.0:1782759116.757220:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15b2f2d2-67f1-417d-8593-3e56b59b032c 00000020:00000080:0.0:1782759116.757223:0:7507:0:(genops.c:906:class_export_put()) final put ffff9171b760f800/15b2f2d2-67f1-417d-8593-3e56b59b032c 00000020:00000080:1.0:1782759116.757399:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9171b760f800/15b2f2d2-67f1-417d-8593-3e56b59b032c for lustre-OST0001 00000020:00000080:1.0:1782759116.757465:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171b7609800 for lustre-OST0001 00000001:02000400:0.0:1782759116.861365:0:117799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_39: @@@@@@ FAIL: file /mnt/lustre/d39.sanity-sec/f39.sanity-sec is corrupted in memory 00010000:00010000:0.0:1782759117.423669:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 75999 lines, 75999 kept, 0 dropped, 0 bad.